Jobs Data Engineer

N-iX is looking for a Senior Data Engineer to support our client's Data Licensing team, which develops training datasets for frontier AI labs. You will own the onboarding and enrichment of new multimedia content. Extend scalable event-driven and batch-processing systems that produce reliable metadata for curation and customer-facing applications.
 

Our customer is a leading global provider of high-quality licensed images, videos, and music. Our customer helps inspire graphic designers, creative directors, video editors, filmmakers, web developers, and other creative professionals by providing diverse content to businesses, marketing agencies and media organizations around the world. Content creators contribute their work to our client, where end users buy and use it in a diverse array of creative personal and business projects. It's a two-sided marketplace that empowers the world's storytellers.

Responsibilities:

• Partner with the Principal Engineer, senior technical leaders and platform teams to implement and evolve the architectural direction for metadata-processing systems; independently own the design and delivery of assigned components.
• Evaluate and evolve orchestration for enrichment and backfill workloads, either by extending existing ingestion capabilities or integrating with new cloud-native services, while maintaining consistent contracts and lifecycle handling.
• Evolve shared frameworks so data scientists can package, test, validate and run production enrichment workloads with minimal data engineering support.
• Define and maintain metadata contracts, lineage, validation and quality controls.
• Contribute to and apply shared engineering standards, and provide technical guidance through design reviews, documentation and collaboration with data engineering and data science teams.
• Estimate and refine the cost, capacity and completion time of enrichment and backfill workloads.
• Partner with platform teams responsible for operating the underlying cloud infrastructure.
• Own time-sensitive customer and partner deliverables through production release.

Requirements:

• 6+ years of experience in data engineering, backend software engineering or distributed systems, including hands-on ownership of large-scale production data workloads.
• Demonstrated experience designing and operating large-scale ingestion or distributed data-processing systems.
• Strong Python software engineering and distributed processing experience.
• Practical knowledge of high-volume batch and event-driven architectures, including idempotency, replay, backpressure, retries and failure recovery.
• Experience enabling data science or ML workloads to move from prototype to production through reusable frameworks and engineering guardrails.
• Production experience with AWS and GCP, with the ability to design workflows spanning multiple cloud environments.
• Experience managing evolving data contracts, schemas, lineage and data-quality expectations.
• Ability to benchmark distributed workloads and translate results into credible capacity, execution-time and cloud-cost projections.
• Experience setting engineering standards, reviewing system designs and mentoring engineers or data scientists.
• Track record of delivering critical, time-sensitive systems into production.
• English level - upper-intermediate

Nice to have:

• Containerized CPU/GPU batch and ML workloads using managed compute services such as SageMaker, AWS Batch, ECS, Cloud Batch or GKE/EKS.
• Event-driven orchestration and messaging using services such as Step Functions, Lambda, EventBridge, Kinesis, Workflows or Pub/Sub.
• Snowflake, ClickHouse or Apache Iceberg.
• Production-scale image, video or audio processing

We offer*:

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

*not applicable for freelancers

Job Description 

We are seeking an experienced AWS Data Engineer / Data Platform Developer with 3–5 years of experience in data engineering, database development, and cloud-based application development.
The role focuses on designing, developing, and supporting scalable data platforms and cloud solutions using AWS, Snowflake, Amazon Redshift, SQL, and Python, while ensuring strong performance, reliability, security, and compliance.
The ideal candidate should have hands-on experience with:
 - Snowflake and Amazon Redshift
 - Strong SQL skills, including complex queries, stored procedures, UDFs, database objects, and performance optimization
 - Strong Python skills for data processing, scripting, integration, and automation
 - ETL/ELT pipeline development and data integration
 - Data modelling, data warehousing, and data lake concepts
 - Performance tuning, monitoring, troubleshooting, and production support
 - Data quality, reliability, and data integrity practices
 - Technical documentation and system specification development
Nice to have experience includes:
 - Familiarity with AWS services and cloud architecture
 - AWS Lambda
 - Node.js
 - REST API development and integration
 - Security concepts, authentication, authorization, and access management
 - CI/CD practices
 - Cloud-native and microservices-based architectures
 - Infrastructure as Code practices
 - Relevant AWS certifications such as AWS Certified Data Engineer – Associate or AWS Certified Solutions Architect
The successful candidate should demonstrate strong attention to detail, analytical and troubleshooting skills, effective communication with technical and business stakeholders, the ability to work independently and collaboratively, adaptability, ownership, and a continuous learning mindset.

Job Responsibilities

• Design, develop, document, and support scalable data and cloud solutions aligned with architecture standards and business requirements.
• Build and maintain ETL/ELT data pipelines and data processing workflows.
• Develop and support data solutions using Snowflake, Amazon Redshift, SQL, and Python.
• Design and maintain data lakes, data warehouses, databases, and related data platform components.
• Develop and optimize SQL queries, stored procedures, UDFs, views, and other database objects.
• Develop Python-based data processing, integration, and automation solutions.
• Develop and support REST APIs and cloud-based services using AWS technologies in scalable and microservices-oriented architectures.
• Participate in system and production deployment planning and support production releases.
• Monitor, troubleshoot, and optimize data pipelines, databases, APIs, and cloud services to improve performance, reliability, and scalability.
• Identify functionality, performance, or data quality deficiencies and implement improvements to data handling, integrity, conversion, storage, and system behavior.
• Implement data quality, validation, monitoring, and governance mechanisms.
• Ensure solutions comply with applicable security, regulatory, and company standards, including authentication, authorization, access management, and data protection requirements.
• Support compliance with standards and frameworks such as HIPAA, SOC 2, and ISO 27001, where applicable.
• Evaluate existing platform capabilities and determine whether standard functionality or custom development is required to address business needs.
• Create and maintain detailed technical documentation, system specifications, architecture documentation, and operational procedures.
• Collaborate with technical teams, architects, business stakeholders, and external technology vendors.
• Support testing, deployment, maintenance, and continuous improvement of platform components.

Department/Project Description

The project focuses on developing and supporting a scalable cloud-based data platform for healthcare and robotics data.

The platform enables efficient data storage, processing, transformation, and analytics using Snowflake, Amazon Redshift, SQL, Python, and AWS services. It is designed to support reliable data workflows, automation, and integration across multiple data sources while maintaining high standards of performance, security, and scalability.

The team is responsible for developing and optimizing data solutions, automating data processing workflows, monitoring platform performance, troubleshooting data-related issues, and supporting reliable production deployments.

Шукаємо Senior / Lead Software Engineer (Data), який допоможе будувати й масштабувати production-grade data systems: пайплайни, сервіси та storage-рішення для збору, обробки, зберігання й доставки даних. Це роль для інженера з сильним software engineering mindset, який вміє працювати не лише на рівні реалізації, а й на рівні архітектури, data modeling, reliability, performance та technical leadership. Очікуємо, що людина зможе брати end-to-end ownership за критичні data workflows і впливати на стандарти команди.
 

Обовʼязки:

• Проєктувати, розробляти та підтримувати batch/streaming data pipelines і data services.
• Приймати технічні рішення щодо ingestion, orchestration, storage, трансформацій і delivery.
• Будувати ETL/ELT-рішення з використанням Python, Airflow, Cron.
• Інтегрувати дані з API, логів, NoSQL, IoT/embedded-джерел та внутрішніх сервісів.
• Проєктувати схеми зберігання, моделі даних і структури баз даних.
• Оптимізувати рішення з погляду performance, scalability, cost та maintainability.
• Забезпечувати data quality, observability, reliability і стабільність production-процесів.
• Планувати та реалізовувати міграції даних між платформами й форматами.
• Документувати схеми, трансформації, data lineage та ключові технічні рішення.
• Брати участь у code review, design discussions, incident resolution.
• Менторити інших інженерів і розвивати engineering standards у data-напрямку.
   

Вимоги:

• Значний досвід як Senior / Lead Software Engineer, Data Engineer або Backend Engineer у data-intensive середовищі.
• Сильний Python і досвід побудови production-ready рішень.
• Досвід роботи з Apache Airflow.
• Досвід роботи з MongoDB або іншими NoSQL-рішеннями.
• Сильне розуміння проєктування баз даних і data models: schema design, indexing, normalization/denormalization.
• Досвід роботи з великими обсягами даних, high-throughput або streaming workloads.
• Досвід із Azure Blob Storage або аналогічними object storage.
• Впевнене знання SQL та оптимізації запитів.
• Глибоке розуміння ETL/ELT, incremental processing, datalake/warehouse principles.
• Розуміння testing, observability, fault tolerance, idempotency, recovery для data systems.
• Досвід із Git, CI/CD, production deployment.
• Досвід технічного лідерства, mentoring, design review і роботи зі стейкхолдерами.
   

Буде плюсом:

• Snowflake, Elasticsearch
• Kafka або інші streaming-платформи
• Grafana / Prometheus
• Ansible або інші IaC / automation tools
• Power BI
• Досвід із cloud DWH, governance, lineage, internal data tools
  
  Надаємо бронювання*
  Офіс з повноцінним укриттям*

Company Description

Are you a Senior Data Engineer passionate about building scalable, high-performance data platforms and working with modern Lakehouse technologies? Join Sigma Software’s Data Engineering Center of Excellence and contribute to the modernization of an enterprise-scale analytics ecosystem for the retail domain.
We are looking for a Senior specialist with strong Databricks, PySpark, and cloud data engineering expertise to participate in the migration of a large-scale analytical platform from BigQuery to Databricks. You will collaborate with international teams, contribute to architectural decisions, and help shape reliable and scalable data solutions.
We at Sigma Software create opportunities for continuous learning, technology growth, and meaningful engineering impact while working on complex international projects.

CUSTOMER

Our Customer is a leading retail technology company specializing in AI-driven pricing optimization solutions for enterprise retailers. The company helps businesses improve profitability and competitiveness through advanced analytics, automation, and intelligent pricing strategies. Their platform combines business intelligence with sophisticated algorithms to support data-informed pricing decisions at scale for global retail organizations.

PROJECT

The project focuses on the strategic migration of a large-scale analytical platform from a legacy BigQuery ecosystem to a modern Databricks Lakehouse architecture. The platform processes high-volume retail datasets, machine learning workloads, analytics pipelines, and customer-specific business logic.
As part of the modernization initiative, the engineering team is implementing scalable Spark-based processing, Delta Lake architecture, medallion data layers, and modern governance practices. The role offers an opportunity to work with distributed data processing systems, optimize large-scale workloads, and contribute to the evolution of an enterprise-grade data platform.

Key Technologies: Databricks, Apache Spark, PySpark, Delta Lake, Python, SQL, Airflow, GCP, CI/CD, Unity Catalog

Job Description

• Participate in the migration of a large-scale analytical platform from BigQuery to Databricks
• Design and implement scalable Lakehouse architectures using Databricks and Delta Lake
• Analyze existing ETL / ELT workloads and define migration approaches
• Develop and optimize data pipelines processing large volumes of retail and analytical data
• Implement incremental processing strategies and scalable transformation frameworks
• Build and maintain Spark-based data processing solutions using PySpark
• Design and maintain medallion architecture layers including Bronze, Silver, and Gold
• Implement data governance and security best practices using Unity Catalog
• Collaborate with Data Science, Analytics, Product, and Customer Engineering teams
• Participate in architecture discussions and technical solution design
• Develop reusable data platform components and engineering standards
• Conduct code reviews and contribute to platform reliability and maintainability
• Troubleshoot and optimize complex SQL and Spark workloads
• Support production deployments and platform modernization activities

Qualifications

• 5+ years of professional experience as a Data Engineer
• Strong programming skills in Python and advanced SQL
• Hands-on commercial experience with Databricks
• Strong knowledge of Apache Spark, primarily PySpark
• Experience designing and building modern cloud-based data platforms
• Experience developing ETL / ELT pipelines and large-scale data processing solutions
• Hands-on experience with Delta Lake
• Experience with Spark Declarative Pipelines
• Experience with cluster monitoring, metrics analysis, and performance optimization
• Strong understanding of distributed data processing architectures
• Solid understanding of data warehousing concepts and dimensional modeling
• Experience with Airflow or similar orchestration tools
• Experience optimizing complex analytical SQL workloads
• Experience implementing CI / CD practices for data engineering platforms
• Strong troubleshooting and performance optimization skills
• Ability to work collaboratively in cross-functional international teams
• Upper-Intermediate or higher English level

WILL BE A PLUS

• Experience working with GCP cloud services
• Experience with AWS or Azure cloud platforms
• Experience in retail analytics or pricing optimization domains
• Experience supporting machine learning or AI-related data workloads
• Experience with platform modernization and cloud migration initiatives

Additional information

PERSONAL PROFILE

• Strong analytical and problem-solving mindset
• Proactive and ownership-driven approach
• Ability to work independently and collaboratively
• Good communication and stakeholder collaboration skills
• Passion for scalable data engineering and modern data platforms
• Interest in continuous learning and technology innovation

Dataforest is looking for a Data Engineer to join an interesting software development project in the field of Cybersecurity. Our client’s platform offers Identity Insights drives real-time, multi-contextual digital forensics to protect new account opening workflows and expose fake accounts already in a customer database.

You'll be a great fit if you have:

- 3+ years of hands on in data engineering;
- 3+ years of commercial experience with Python;
- Advanced experience with SQL DBs (optimisations, monitoring, etc.);
- Advanced experience with PySpark;
- Solid understanding of ETL principles (architecture/ monitoring/ alerting/search and resolve bottlenecks);
- Familiar with AWS infrastructure (boto3, S3 buckets, etc);
- Experience working with large volumes of data;
- Understanding the principles of medallion architecture.

Would be a plus:

- Cassandra/Scylla
- PostgreSQL
- Pandas
- Experience with Kafka and Redis

What you'll do:

- Maintain data processing architecture using Python and PySpark that interacts with ScyllaDB & PostgreSQL.
- Work with Databricks infrastructure to ensure reliability, scalability, and cost efficiency.
- Proactively identify bottlenecks and suggest technical improvements.

We ensure your growth with:

- Working in a fast-growing company;
- Great networking opportunities with international clients, challenging tasks;
- Personal and professional development opportunities;
- Competitive salary fixed in USD;
- Paid vacation and sick leaves;
- Flexible work schedule;
- Friendly working environment with minimal hierarchy;
- Team building activities, corporate events.

Back End Data Engineer

Company: NeuCurrent

Location: Remote / Hybrid

NeuCurrent is an AI powered CRM and omnichannel marketing platform for retailers. NeuCurrent empowers brands to connect with their customers more intelligently – through real-time personalization across email, SMS, WhatsApp, and push. 

We are looking for a motivated, bright and independent Data and Back End Engineer with at least 3 years experience who is willing to take broad responsibilities across product development and wants to progress quickly to a senior role within a company. 

Why you should apply:

This is a challenging job. Building something new is not easy.

We are building a new product.

It takes time to grow and get results.

Working for a start up you are going through lots of challenges.

We often multi-task as we grow our company.

BUT If you want to be part of the fast growing business and team, generate your own ideas, and see the direct impact of your work on the business of the users, you should consider applying for this job. 

Apply if you want to try yourself in something new!

About company:

At NeuCurrent we are building a disruptive technology for retail which enables all retailers to implement data driven customer retention without expensive data analytics and marketing resources. We are actively expanding in Europe at present. 

Our values:

We care for our people and customers

We develop innovation that generates real benefit

We are not afraid to take risks and see failure as a learning opportunity

We are determined and always look for solutions to move forward

Responsibilities and Tech Stacks:

Data Processing

• Maintain and improve data collection pipelines, which are the backbone of our product
• Create new integrations
• Maintain DWH architecture
• Support and improve Kubernetes infrastructure on GCP
• Developer infrastructure for ML pipelines

Tech stack:

Redis, Argo

Python 3, Pandas, Numpy, Sqlalchemy

PostgreSQL, Google BigQuery

Docker, Kubernetes, Google Cloud Platform

Flask

Backend Development

• Support and further develop the product backend API
• Developer infrastructure for ML pipelines

Tech stack:

Python, Flask

PostgreSQL

Docker, Kubernetes, Google Cloud Platform

Other Requirements:

Work closely with the founders on product development and improvement

Actively contribute ideas to product innovation including AI implementation

Customer focused 

An excellent / good working English is a must as you will deal with the English speaking customers

Personal Qualities:

A self-starter who has the experience and confidence to act independently

Have a positive mindset and attitude to solve problems and represent NeuCurrent with our customers

A strong team player who is keen to learn and share her/his knowledge

Enthusiasm and desire to progress professionally to a managerial role quickly

Be structured and a good communicator 

What we offer:

You will have a lot of freedom in your field to create direct impact on our clients and NeuCurrent business and product development

We have a young, highly motivated, and talented team

You will become an integral part of new product development

You will have plenty of opportunities to make your own decisions

You will have unlimited opportunities to progress to managerial roles in our fast growing company

Options / shares are available for a proven candidate

Are you passionate about safeguarding countries, societies, and businesses from hybrid threats?

Look no further! Our rapidly scaling company is committed to this crucial mission, collaborating with some of the world’s most influential organizations, including NATO and the EU.

If you’re ready to join a high-impact team shaping the future of intelligence and security, we invite you to become part of our journey. Join us and help defend the digital world with purpose and innovation!

Role Overview

We are looking for a Senior Data Engineer to work on the data architecture behind our intelligence platform, across both our production data infrastructure and our work with multimodal data.

We operate on text, social media, geospatial, and time-series data at scale. A large part of the engineering challenge is in how that data is represented and connected: the same real-world entity can be modelled on a map, as a node in a graph, and as a pattern over time, and the value comes from being able to query and reason across those views together.

You'll bring hands-on experience with geospatial data, knowledge graphs, or entity-relationship systems across multiple data types. We care more about how you reason through architectural and technology choices than about any specific tool.

This is a hands-on, senior role with real ownership over architecture, execution, and technical direction.
 

Key Responsibilities

Multimodal Data & Entity Modelling

• Extract entities and relationships from text, social media, geospatial, and time-series data, and model them across map, graph, and temporal representations.
• Evolve our knowledge graph layer and make connected data usable for analytics, visualisation, and AI agents.
• Evaluate and prototype technologies for geospatial and graph workloads at scale

Core Data Platform

• Migrate production workloads from PostgreSQL to StarRocks.
• Improve ingestion and processing performance, and redesign product storage architecture for billion-row scale.
• Own the infrastructure your pipelines run on, including deployment, performance, and cost.

Requirements

• Hands-on experience building data systems for geospatial data, graph data, or knowledge graphs, ideally combining several data types.
• Experience with GIS tooling (e.g. PostGIS), graph databases (e.g. Neo4j, TigerGraph), or modelling graph data on relational or columnar storage.
• Strong architectural thinking and the ability to justify technology choices, run experiments, and change course based on results.
• Proven experience moving and processing data at large scale, with resumable, idempotent, and memory-safe pipelines.
• Experience working with data infrastructure beneath the managed layer, not only inside a ready-made SaaS platform.
• Ability to read query plans and change physical data layout to fix performance issues.
• Experience building and shipping production backend services in Python.
• Comfort owning infrastructure, including Kubernetes, Helm, Terraform, or similar tools.
• Fluent English.

Nice to Have

• Production experience with a columnar or MPP engine such as StarRocks, Doris, ClickHouse, BigQuery, or Snowflake, including partitioning, distribution, and indexing.
• Experience with Elasticsearch or OpenSearch at scale, including mappings, ILM, tiering, and reindexing.
• Experience with a long-running migration involving dual-write, reconciliation, and cutover.
• Knowledge of PostgreSQL internals.
• Experience with event-driven ingestion using Kafka or RabbitMQ.
• Experience with observability tools (Prometheus, Grafana, Loki), lakehouse formats (Parquet, Iceberg), and orchestrators such as Airflow.
• Background in threat intelligence, OSINT, geospatial intelligence, or defence.

We Offer

• Opportunity to contribute to a mission-driven startup and support prestigious clients, including governments worldwide, enterprise clients, and leading NGOs in tackling global security challenges.
• Autonomy and freedom to drive experiments and bring your own ideas to life.
• Flexibility of fully remote work.
• Flexible, unlimited time-off policy.

ZentixSoft is looking for two Senior Data Ingestion Engineers! 🚀

Format: Direct Contract Engagement (1-Year Contract, 100% Full-Time Remote). 
 

💡 Why ZentixSoft Partner Network?
 💸 Transparent Compensation: Direct payroll arrangement with $40 USD/hour base compensation. 
⚖️ Work-Life Balance: Sustainable engineering workflows with predictable long-term deliverables. 
🦾 Trust & Transparency: Zero micromanagement and full autonomy over your technical pipeline architecture. 
🎁 Culture & Growth: Long-term project stability within large-scale financial and insurance data domains.
 

🧩 Responsibilities:

• Pipeline Design & Engineering: Design and deploy scalable data ingestion pipelines for high-volume structured/unstructured documents (PDFs, scans, emails, Word, Excel, PowerPoint).
• Document Extraction & OCR: Implement OCR and document processing workflows using AWS Textract (or equivalent) for text extraction, cleaning, normalization, and metadata tagging.
• RAG & Vector Storage Prep: Execute semantic chunking, metadata extraction, vector storage schema design, and retrieval mechanism preparation for downstream AI models.
• Integrations & Connectors: Build robust connectors with enterprise sources, including SharePoint, email servers, and public cloud repositories.
• Validation & Observability: Implement automated error monitoring, OCR extraction validation, and CI/CD automated testing using AWS Step Functions and CloudWatch.
   

🎓 Our Perfect Match (Requirements):

• Senior Data Engineering: 7+ years of commercial Data Engineering experience, with strong proficiency in Python and SQL.
• AWS Expertise: 5+ years of hands-on experience in AWS environments, specifically AWS S3, Step Functions, CloudWatch, and public cloud data processing.
• Unstructured Data & OCR: Proven background in building document extraction pipelines (handling PDFs, scanned images, emails, Office documents) and utilizing OCR technology (AWS Textract or similar).
• Source Connectors & Pipeline Operations: Practical experience integrating sources like SharePoint and email, performing text normalization, metadata tagging, and maintaining CI/CD/Git testing standards.
• EU Residency & Location: Candidates MUST reside in an EU member country (with active legal residency; citizenship can be non-EU/global).
• Language & Communication: C1 Advanced English (verbal and written) for direct technical collaboration.
   

➕ Good to Have:

• Experience with Vector Databases, RAG architectures, semantic chunking, and vector retrieval mechanisms.
• Background in Insurance or Financial Services industries handling enterprise security standards.
• Exposure to Azure or Databricks platform components.
   

📍 Project Details:

⏳ Duration: 1 Year (Full-time contract).

🚀 Target Start: End of October.

📍 Location: 100% Remote (Must be physically located in an EU member state with valid residency).

About the role:

Our digital business depends on reliable financial and marketing data. We are looking for a highly reliable, detail-oriented Analytics Engineer who will take ownership of the core data architecture behind our Finance and Marketing operations.

In this role, you will be responsible for the daily data operations that support our Payment Service Providers (PSP), Tax reporting, Controlling, Finance reporting, and marketing campaign cost tracking.

You will ensure that our Pentaho ETL pipelines run smoothly through Jenkins, our MariaDB databases remain performant, and our Qlik Sense dashboards consistently deliver accurate, business-critical numbers.

This is a hands-on, high-impact role where precision, stability, and reliability are essential.

What you’ll do:

ETL & Data Architecture

• Own, maintain, and optimize core ETL pipelines built with Pentaho Kettle 9.3 Community.
• Ensure reliable and accurate data transformations across critical business processes.
• Monitor and improve the stability and performance of existing data flows.

Database & Automation

• Work with complex data transformations and queries in MariaDB.
• Optimize database performance and ensure data processes run efficiently.
• Manage and monitor automated jobs orchestrated through Jenkins.

Finance & Marketing Data

• Work daily with transactional and financial data.
• Support data processes related to Payment Service Providers (PSP), Tax reporting, and Controlling reconciliations.
• Manage the ingestion and processing of marketing campaign costs and ad spend from different advertising platforms.

BI & Reporting

• Design, develop, and maintain critical Qlik Sense dashboards and reports.
• Ensure stakeholders receive accurate and consistent financial and operational data.
• Analyze data and translate it into logical conclusions and actionable insights.

Production Support & Troubleshooting

• Investigate and resolve data issues in a live production environment.
• Identify root causes and implement reliable fixes.

• Ensure that daily reporting and month-end financial closing processes are not delayed due to data issues.

   

What we’re looking for:

Experience

• 4+ years of experience working with ETL processes, databases, and BI solutions.

Core technical expertise

• Strong hands-on experience with Pentaho Kettle or similar legacy ETL tools such as Talend or Informatica.
• Solid experience with relational databases: MariaDB, MySQL, PostgreSQL or similar.
• Experience with Jenkins and automated job orchestration.
• Advanced SQL skills.
• Strong understanding of production data processes and error handling.

BI

• Strong experience with Qlik Sense.
• Experience with Power BI or Tableau is also relevant.

Domain experience

• Practical experience working with Finance data, including:
  • Payment Service Providers (PSP)
  • Tax reporting
  • Controlling and financial reconciliations
• Experience working with Marketing data, particularly campaign cost and advertising spend tracking.
   

Soft skills

• Comfortable working under time constraints, especially during month-end financial closing.
• Strong communication and collaboration skills.
• A structured, methodical, and diagnostic approach to problem-solving.
• High attention to detail and a strong sense of ownership.
   

Tech stack

Pentaho Kettle 9.3 Community · MariaDB · Jenkins · Qlik Sense · SQL

Why Join Us? 

    🌍 Remote-first & flexible work

• Fully remote working model.
• Access to an office if there is one available in your location.
• Monday–Friday, 40-hour working week.

• Flexible working hours: schedule options between 08:00 and 19:00, including a 1-hour lunch break (the only requirement is a minimum of 5 hours of overlap with the team)

  🏖️ Vacation & sick leave

• 20 paid working days of vacation during the first year.
• 10 paid sick days per year (for childcare would also be covered), compensated at 100% of salary.

• Public holidays are days off by default.

  ❤️ Health & family benefits

• Medical insurance or medical insurance compensation.
• Company gifts for:
  • Birthday
  • Wedding
  • Birth of a child
• Paid lunches at the office.
• Family days etc.
• 📑 FOP / Individual Entrepreneur Support if needed
  🔄 Paid Bench period between projects
  🤝 No time-tracking software — transparent and trust-based time reporting.
  🎁 Referral Program

About Zoral

Zoral is an IT product and professional services company serving banks, insurers, wealth managers and fintechs. Alongside its flagship product, Zoral fOS (Financial Operating System), Zoral delivers data, analytics and AI programmes for regulated financial-services firms in Europe, the UK, the US and Asia.

About the role

We are looking for a Data Architect / Senior Data Engineer to define the target architecture and actively design, develop and deliver enterprise data platforms on Azure Databricks for regulated financial-services clients. Typical platforms integrate tens of source systems and millions of customer and policy records, support several hundred regulatory, management and operational reports, and are delivered by growing multidisciplinary teams of data engineers, architects, analysts and client specialists.

This is a hands-on architecture and engineering role within a collaborative delivery team. You will assess the client’s existing data landscape, help refine the target architecture, establish modelling and engineering standards, and act as a senior technical authority throughout delivery. You will work closely with other architects and engineers, providing direction, reviewing designs and supporting implementation rather than operating as a standalone architect.

At the same time, you will remain close to the engineering work: developing transformation logic and data models, profiling and cleansing data, implementing data-quality controls, and contributing to production engineering where your experience has the greatest impact. The successful candidate should be comfortable moving between architecture, technical leadership and hands-on implementation while enabling the wider team to deliver effectively.

Responsibilities

• Assess existing data lakes, warehouses, pipelines, models, jobs, notebooks and tooling; work with client architects and the wider delivery team to confirm or refine the target architecture and document decisions, options, trade-offs and rationale.
• Design the layered data architecture (landing, bronze, silver and gold) and guide its implementation across the engineering team, covering ingestion, standardisation, transformation, integration, conformance, data products and reporting marts.
• Develop and review production-grade data transformations using SQL and Python/PySpark, including reusable and metadata-driven pipelines that are idempotent, re-runnable, testable and observable.
• Define data-modelling standards and contribute to the development of integrated and consumption-layer models, including Data Vault 2.0, Kimball dimensional models, slowly changing dimensions, historical and as-at reporting, and model-generation approaches.
• Define the data-quality and data-cleansing approach together with the engineering team: establish profiling and baseline measures; define rule catalogues, quality gates and scorecards; design quarantine, remediation, reconciliation, audit, balance and control processes; and ensure these are implemented consistently.
• Guide and contribute to data cleansing, standardisation, de-duplication, customer matching and entity-resolution approaches, including match rules, survivorship and persistent identifiers.
• Design how the new platform is separated from and coexists with legacy platforms, including catalogue and environment layout, access boundaries, dependencies, migration, reconciliation and decommissioning.
• Define practical standards for layering, naming, ownership, classification, lineage, security, masking, resilience and retention, and work with engineers to ensure these standards are applied consistently in delivery.
• Evaluate tools for ingestion, transformation, orchestration, data quality, catalogue, lineage, master data and reporting, working with other technical stakeholders to present recommendations and trade-offs.
• Review engineering designs and code, contribute directly to complex or critical implementation areas, troubleshoot difficult data and pipeline issues, and support automated testing and CI/CD practices.
• Provide technical leadership to engineers and client staff through design reviews, pairing, mentoring and collaborative problem solving.
• Produce architecture documents, decision records, technical standards, runbooks and handover material in collaboration with the wider project team.

Requirements

• 8+ years in data architecture and/or senior data engineering, with substantial hands-on delivery responsibility, including at least three years designing and engineering Databricks platforms in production.
• Demonstrated ability to operate as both an architect and a senior engineer within a delivery team: define target-state designs and standards, guide other engineers, and implement or materially contribute to pipelines, transformations and data models.
• Experience providing technical leadership within multidisciplinary data teams, including design reviews, mentoring, engineering standards and collaborative delivery.
• Expert SQL and strong Python/PySpark skills, with experience developing, testing, optimising and supporting production data transformations.
• Hands-on knowledge of Azure Databricks, including Unity Catalog governance (grants, row filters, column masks, tags and lineage), Delta Lake, Lakeflow Declarative Pipelines, Lakeflow Jobs and Lakeflow Connect.
• Proven experience designing and developing layered lakehouse or data-warehouse architectures using Data Vault 2.0 and Kimball dimensional modelling, including slowly changing history and as-at data.
• Experience defining and implementing data-quality and cleansing strategies, including profiling, rule design, quality gates, monitoring, scorecards, quarantine, remediation and reconciliation controls.
• Experience with master data management, customer matching, de-duplication or entity resolution.
• Experience migrating data, pipelines and models from legacy warehouses or lakes, including coexistence, reconciliation, parallel running and decommissioning.
• Practical experience with Git, code review, automated testing, CI/CD and production support for data pipelines.
• Ability to write clear architecture and engineering documentation and present technical decisions to senior stakeholders.
• Excellent written and spoken English; willingness to work on site at client premises, including in the UK, for periods of several weeks.

• Provide governed data, enterprise knowledge, document intelligence, knowledge graph, and retrieval capabilities that ground AI agents in trusted evidence

   

• Responsibilities:

  Design RAG and enterprise-search architectures.
  Build ingestion, transformation, enrichment, document extraction, embedding, and indexing pipelines in Databricks.
  Create and maintain Azure AI Search, vector search, and access-controlled retrieval indexes.
  Implement Azure Document Intelligence pipelines for extracting structured data from PDFs, forms, engineering documents, reports, and scanned content.
  Design and maintain knowledge graph models to represent entities, relationships, metadata, lineage, and domain context for agent reasoning and search enrichment.
  Implement metadata, filtering, citations, lineage, data freshness, and security-trimmed access controls.
  Measure and optimize retrieval relevance and knowledge quality.
  Support structured data products used by agents and deterministic services.

   

• Mandatory Skills Description:

  Bachelor's degree in Computer Science, Data Engineering, Data Science, Information Systems, or a related field.
  5+ years of data engineering, search engineering, analytics engineering, or knowledge-platform experience.
  Strong SQL skills and experience building production data pipelines in Databricks.
  Experience with data quality, metadata, lineage, and governance practices.
  Understanding of structured and unstructured enterprise information retrieval, including document extraction and knowledge graph patterns.
  Hands-on Azure AI Search, Databricks, RAG, or vector-search experience.
  Experience with Azure Document Intelligence, document processing, chunking, embeddings, ranking, metadata, and citation design.
  Hands-on knowledge graph experience using Neo4j, RDF, graph databases, semantic modeling, ontology design, or entity-relationship mapping.

   

• Nice-to-Have Skills Description:

  Azure Data Engineer or Databricks certification.

   

• Languages:
  • English: B2 Upper Intermediate

• We are embarking on a critical initiative to achieve ISO 81001 compliance for our esteemed client. ISO 81001 is a pivotal standard for health informatics, specifically focusing on the management and security of health information systems. This project aims to ensure Client's digital infrastructure aligns with the stringent requirements set forth by ISO 81001, safeguarding sensitive healthcare data and bolstering cyber resilience.

   

• Responsibilities:

  Conduct a thorough assessment of Client's existing IT infrastructure, policies, and procedures against ISO 81001 requirements.
  Identify gaps and vulnerabilities that need to be addressed to achieve compliance.
  Collaborate with cross-functional teams to design and implement robust security controls aligned with ISO 81001 standards.
  Deploy necessary security measures to protect Client's health information systems and data assets.
  Draft and enhance security policies, procedures, and guidelines tailored to ISO 81001 specifications.
  Ensure policies are communicated effectively and integrated into Client's operational framework.
  Perform risk assessments and develop risk management strategies to mitigate cyber threats and vulnerabilities.
  Implement proactive measures to enhance Client's cyber resilience in alignment with ISO 81001.
  Conduct training sessions and workshops to enhance cyber security awareness among Client staff.
  Foster a culture of security consciousness and best practices across the organization.
  Establish monitoring mechanisms to track ongoing compliance with ISO 81001 requirements.
  Conduct regular audits and assessments to ensure sustained adherence to security standards.
  Develop incident response protocols and procedures to swiftly address and mitigate security incidents.
  Continuously assess and refine security strategies based on emerging threats and industry developments.

   

• Mandatory Skills Description:

  Bachelor's degree in Cyber Security, Information Technology, or a related field.
  Proven experience in cyber security, particularly in compliance initiatives (ISO standards preferred).
  Strong understanding of health informatics and data security within healthcare environments.
  Excellent analytical skills with the ability to assess complex systems and processes.
  Effective communication skills to engage stakeholders and drive security initiatives forward.

   

• Nice-to-Have Skills Description:

  Agile

   

• Languages:
  • English: C1 Advanced

About Our Client

Our client is a leading enterprise data platform company building an open, high-performance data lakehouse for AI and analytical workloads. The platform combines an intelligent SQL query engine, an AI-ready semantic layer, and an open catalog built on Apache Iceberg — enabling Fortune 500 companies across finance, energy, manufacturing, and logistics to unify, query, and govern data at massive scale across cloud and on-premise sources.

About the Role

We are looking for a Senior Software Engineer for the team that owns the reliability and operational excellence of a large-scale data platform, delivered both as a cloud service and as self-managed software. You will work across the full platform — observability, security, control plane, and core services — diagnosing complex issues and delivering durable fixes across cloud, hybrid, and on-premises environments, in close collaboration with product engineering, SRE, support, and field teams.

This is a backend platform engineering role focused on distributed systems reliability — not application development or CRUD services.

Responsibilities

• Investigate, diagnose, and resolve complex issues across cloud and self-managed deployments — distributed systems failures, performance degradation, and reliability incidents
• Own bug fixes and targeted improvements across core services, control plane, security, and observability infrastructure
• Support automated deployment and integration frameworks that enable consistent, repeatable delivery across cloud, hybrid, and on-premises environments
• Contribute to cluster lifecycle management, observability, and operational supportability capabilities
• Partner with SRE, support, and field teams to triage and resolve escalated customer issues
• Build runbooks, root cause analyses, and internal tooling that reduce time-to-resolution over time
• Collaborate with product engineering so that fixes are integrated back into the main codebase effectively

Required Qualifications

• Bachelor's or Master's degree in Computer Science or a related field, or equivalent experience
• 5+ years of software engineering experience with strong hands-on Java development at production scale
• Proficiency in Python and Bash for scripting, automation, and tooling
• Solid foundation in data structures, algorithms, and multi-threaded / asynchronous programming models
• Experience designing, debugging, and operating large-scale distributed systems or microservices
• Hands-on experience with Kubernetes and Docker across cloud, hybrid, or on-premises deployments
• Cloud-native development experience on one or more of AWS, Azure, or GCP
• Strong understanding of networking fundamentals (TCP/IP, DNS, HTTP)
• Clear communicator — able to explain problems, root causes, and solutions to technical and non-technical audiences
• Comfortable with AI-assisted development workflows — using modern AI tools productively while critically validating their output
• English Upper-Intermediate or higher (B2+) — daily written and verbal communication with a US-based engineering team
• Availability to work EU business hours shifted 2–3 hours later for daily overlap with US West Coast mornings

Desired Skills

• Observability platforms: OpenTelemetry, distributed tracing, metrics, logging
• Background in data processing, data warehouse, data lake, or analytics systems
• Distributed file and object storage: S3, ADLS, or HDFS
• Infrastructure-as-code (Helm, Terraform) and CI/CD tooling (Jenkins, ArgoCD)
• Identity, authentication, and authorization systems: SSO, OAuth, SAML, RBAC
• NoSQL databases (MongoDB, RocksDB), Redis, or partner/OEM integration patterns
• Query processing, concurrency control, data replication, or storage systems

Details

• Engagement: Long-term contract
• Location: Europe (EU / EEA / UK), remote
• Working hours: EU business hours, shifted 2–3 hours later for daily overlap with the US West Coast team

Project Description:

We are embarking on a critical initiative to achieve ISO 81001 compliance for our esteemed client. ISO 81001 is a pivotal standard for health informatics, specifically focusing on the management and security of health information systems. This project aims to ensure Client's digital infrastructure aligns with the stringent requirements set forth by ISO 81001, safeguarding sensitive healthcare data and bolstering cyber resilience.

Responsibilities:

Conduct a thorough assessment of Client's existing IT infrastructure, policies, and procedures against ISO 81001 requirements.
Identify gaps and vulnerabilities that need to be addressed to achieve compliance.
Collaborate with cross-functional teams to design and implement robust security controls aligned with ISO 81001 standards.
Deploy necessary security measures to protect Client's health information systems and data assets.
Draft and enhance security policies, procedures, and guidelines tailored to ISO 81001 specifications.
Ensure policies are communicated effectively and integrated into Client's operational framework.
Perform risk assessments and develop risk management strategies to mitigate cyber threats and vulnerabilities.
Implement proactive measures to enhance Client's cyber resilience in alignment with ISO 81001.
Conduct training sessions and workshops to enhance cyber security awareness among Client staff.
Foster a culture of security consciousness and best practices across the organization.
Establish monitoring mechanisms to track ongoing compliance with ISO 81001 requirements.
Conduct regular audits and assessments to ensure sustained adherence to security standards.
Develop incident response protocols and procedures to swiftly address and mitigate security incidents.
Continuously assess and refine security strategies based on emerging threats and industry developments.

Mandatory Skills Description:

Bachelor's degree in Cyber Security, Information Technology, or a related field.
Proven experience in cyber security, particularly in compliance initiatives (ISO standards preferred).
Strong understanding of health informatics and data security within healthcare environments.
Excellent analytical skills with the ability to assess complex systems and processes.
Effective communication skills to engage stakeholders and drive security initiatives forward.

Nice-to-Have Skills Description:

Agile

Languages:

English: C1 Advanced

Project Description:

Provide governed data, enterprise knowledge, document intelligence, knowledge graph, and retrieval capabilities that ground AI agents in trusted evidence

Responsibilities:

Design RAG and enterprise-search architectures.
Build ingestion, transformation, enrichment, document extraction, embedding, and indexing pipelines in Databricks.
Create and maintain Azure AI Search, vector search, and access-controlled retrieval indexes.
Implement Azure Document Intelligence pipelines for extracting structured data from PDFs, forms, engineering documents, reports, and scanned content.
Design and maintain knowledge graph models to represent entities, relationships, metadata, lineage, and domain context for agent reasoning and search enrichment.
Implement metadata, filtering, citations, lineage, data freshness, and security-trimmed access controls.
Measure and optimize retrieval relevance and knowledge quality.
Support structured data products used by agents and deterministic services.

Mandatory Skills Description:

Bachelor's degree in Computer Science, Data Engineering, Data Science, Information Systems, or a related field.
5+ years of data engineering, search engineering, analytics engineering, or knowledge-platform experience.
Strong SQL skills and experience building production data pipelines in Databricks.
Experience with data quality, metadata, lineage, and governance practices.
Understanding of structured and unstructured enterprise information retrieval, including document extraction and knowledge graph patterns.
Hands-on Azure AI Search, Databricks, RAG, or vector-search experience.
Experience with Azure Document Intelligence, document processing, chunking, embeddings, ranking, metadata, and citation design.
Hands-on knowledge graph experience using Neo4j, RDF, graph databases, semantic modeling, ontology design, or entity-relationship mapping.

Nice-to-Have Skills Description:

Azure Data Engineer or Databricks certification.

Languages:

English: B2 Upper Intermediate