Jobs Data Engineer

Шукаємо Senior Data Engineer з досвідом BigQuery, Python, DBT та Data Modeling в дуже велику і стабільну продуктову компанію. Компанія розробляє софт для найбільших страхових компаній світу.

Проект – побудова нової Data Platform на базі BigQuery з використанням DBT, Python, GCP. Сінйорна команда, адекватний і професійний менеджмент.

Шукаємо виключно українських девелоперів закордоном. Нажаль, в Україні цього разу не розглядаємо, через обмеження по доступу до критичних даних. Пропонуємо дуже гнучкі умови: віддалена робота, цікаві задачі і хороше/спокійне керівництво.

Опис вакансії:

What You’ll Do: 

• Design & run pipelines – create, deploy, and monitor robust data flows on GCP. 
• Model data – design star/snowflake schemas for analytics and reporting. 
• Write BigQuery SQL – build procedures, views, and functions. ● Build ML pipelines – automate training, validation, deployment, and model monitoring. 
• Optimize ETL – speed up workflows and cut costs. 
• Use the GCP stack – BigQuery, DBT + Dataflow, Dataproc, Airflow/Composer, Celigo.
• Guard quality & uptime – add tests, validation, and alerting; fix issues fast. 
• Document everything – pipelines, models, and processes. 

• Keep learning – track new tools and best practices. 

   

What You’ll Need: 

• 6+ yrs building data/ETL solutions; 2+ yrs heavy GCP work. 
• Proven BigQuery warehouse design and scaling. 
• Deep SQL, Python, DBT, Git; Talend, Fivetran, or similar ETL tools. 
• Strong data‑modeling skills (star, snowflake, normalization).
• Solid grasp of Data Lake vs. Data Warehouse concepts. 
• Problem‑solver who works well solo or with a team. 
• Clear communicator with non‑technical partners. 
• Bachelor’s in CS, MIS, CIS, or equivalent experience. 

We are looking for a highly motivated and results-driven Head of Data & AI to join our team full-time. In this strategic role, you will shape the vision, architecture, and delivery frameworks for Data Engineering, Data Science, Quant and Data Analytics, unifying these teams into a single, high-impact function. This is a key leadership position, guiding both technical and managerial directions for our data organization.
We drive fintech innovation through deep analytical expertise and a data-first, engineering-driven approach.
 

Key Responsibilities
 

Data Engineering

• Design and evolve a scalable, reliable, and maintainable data platform architecture
• Oversee development of robust ETL/ELT pipelines and real-time data streaming systems
• Establish engineering best practices, including code reviews, CI/CD, data contracts, and observability
• Lead technology selection and resource planning across ClickHouse, Spark, and supporting infrastructure
• Ensure data quality through monitoring, alerting, SLA ownership, and remediation processes
• Manage infrastructure costs and drive optimization across storage, compute, and cloud resources
   

Artificial Intelligence & Large Language Models

• Define and develop the company's overall AI direction and roadmap, aligning initiatives with long-term business strategy
• Ensure operational stability and observability of ML services
• Define and drive LLM strategy, including identifying high-value use cases, evaluating model providers (OpenAI, Anthropic, open-source), and leading end-to-end implementation
• Architect and oversee LLM-powered products, including RAG pipelines, AI agents, and intelligent automation workflows integrated into core business processes
• Establish MLOps/LLMOps best practices, including model versioning, evaluation frameworks, prompt management, and drift/hallucination monitoring
• Drive responsible AI governance, including bias detection, explainability (SHAP, LIME), fairness auditing, and compliance with emerging AI regulations
• Evaluate and integrate vector databases (Pinecone, Weaviate, pgvector) and embedding strategies to power semantic search and knowledge retrieval
• Champion AI-assisted development practices (e.g., GitHub Copilot, Cursor) and foster an AI-augmented engineering culture across data teams
   

Data Analytics & Quant

• Drive advanced analytics, strategy, and Quant development
• Partner with stakeholders to translate complex business challenges into data-driven solutions
• Define and own key metrics, dashboards, and reporting frameworks to support executive and board-level decision-making
• Lead experimentation practices to validate business impact of models and initiatives
• Mentor teams, setting technical standards and career development paths
   

Requirements

• 7+ years of hands-on experience across Data Engineering, Data Science, Quant, Data Analytics, delivering end-to-end solutions
• 3+ years of managerial experience, leading data teams
• Bachelor’s or Master’s degree in Computer Science, Mathematics, Physics, Engineering, or a related field
• Strong programming skills in Python, with experience writing clean, production-grade code
• Solid understanding of software engineering best practices (CI/CD, testing, code reviews, clean architecture)
• Deep understanding of core ML algorithms: regression, gradient boosting, time series, etc.
• Practical experience with ML libraries and platforms (e.g., scikit-learn, XGBoost, TensorFlow, PyTorch)
• Strong foundation in mathematical statistics, probability theory, and quantitative modeling
• Proficient in SQL and experience with analytical and OLAP databases
• English Upper-Intermediate
   

Nice to Have

• Background in trading or fintech
• Experience analyzing and modeling time series or high-frequency data
• Familiarity with anti-fraud systems, risk modeling, or portfolio analytics
• Practical experience with integration of LLM with corporate systems for internal users
   

We offer

• 20 paid vacation days per year
• 10 paid sick leave days per year
• Public holidays according to current legislation
• Medical insurance
• Opportunity to work remotely
• Professional education budget
• Language learning budget
• Wellness budget (gym membership, sports gear and related expenses)

Job Description

• Bachelor's degree in Computer Science or equivalent experience.
• 3+ years of experience in iOS testing.
• Experience in both manual and automation testing.
• Knowledge of XCTest/XCUITest is preferred.
• Strong understanding of mobile QA processes.
• Experience testing REST APIs.
• Familiarity with Agile methodologies.
• Strong communication and analytical skills.

Job Responsibilities

• Execute manual and automated testing.
• Create and maintain test documentation.
• Report and validate software defects.
• Work closely with development teams.
• Improve automation coverage where applicable.
• Participate in release verification.
• Support continuous quality improvement.

Department / Project Description

We are seeking a QA Engineer who enjoys both hands-on manual testing and automation development. You will contribute to delivering secure, high-quality iOS applications used by healthcare professionals worldwide.

Dataforest is looking for a growth-oriented Data Engineer to join our friendly team. As a Data Engineer, you will solve engaging problems using cutting-edge technologies for data collection, processing, analysis, and monitoring.

If you aren't afraid of challenges, this position is just for you!

You'll be a great fit if you have:

- 1+ years of experience as a Data Engineer;
- Strong experience with Python;
- Proven experience with Databricks and Datafactory;
- Experience with AWS/Azure;
- Experience building ETL / ELT pipelines;
- Proficiency in SQL.

What you'll do:

- Developing ETL/ELT pipelines and data management solutions;
- Implementing data processing algorithms;
- Writing and optimizing SQL queries for data extraction and analysis;
- Analyzing data and applying processing algorithms to solve business problems.

We ensure your growth with:

- Working with a high-skilled engineering team on engaging and complex projects;
- Hands-on experience with the latest technologies;
- Direct communication with international clients and challenging tasks;
- Opportunities for personal and professional growth;
- Competitive salary pegged to USD;
- Paid vacation and sick leave;
- Flexible working hours;
- Friendly working atmosphere with zero bureaucracy;
- Plenty of team traditions — corporate parties, team buildings, themed events, and much more!

Чи захоплює вас перетворення даних на практичні інсайти? Ми шукаємо Senior BI Engineer, який приєднається до нашої команди Data & Analytics і допоможе формувати звітність, створювати дашборди та розвивати підхід до прийняття рішень на основі даних у різноманітних бізнес- та потенційно державних проєктах.

Це роль рівня Senior із можливістю гібридного або віддаленого формату роботи, що забезпечує гнучкість та можливість співпрацювати з талановитими професіоналами з усього світу. Ідеальний кандидат має значний практичний досвід роботи з BI-інструментами, поглиблені знання SQL, моделювання даних та досвід тісної взаємодії з бізнес-стейкхолдерами. Ця роль вимагає не лише технічної експертизи, але й здатності розуміти потреби бізнесу, трансформувати їх у зрозумілі рішення для звітності та забезпечувати точність і надійність даних.

У Sigma Software ми цінуємо інноваційність, точність і командну роботу та створюємо підтримуюче середовище, де ваші знання та досвід можуть мати реальний вплив.

Чому варто приєднатися до нас? Ви працюватимете над важливими проєктами, отримаєте досвід у різних доменах та матимете доступ до переваг, таких як можливості професійного розвитку, міжнародна командна культура та сучасні технології.

Обов’язки:

— Проєктувати, створювати та підтримувати BI-звіти та дашборди
— Аналізувати бізнес-вимоги та перетворювати їх на звітні рішення
— Працювати зі стейкхолдерами для визначення KPI, метрик та логіки даних
— Писати та оптимізувати SQL-запити
— Перевіряти точність даних та досліджувати невідповідності
— Підтримувати покращення моделювання даних та звітного шару
— Співпрацювати з Data Engineers, Business Analysts, PMs та стейкхолдерами з боку замовника
— Готувати документацію для звітів, метрик та джерел даних
— Вносити вклад у розвиток BI best practices у межах юніту

Вимоги:

— 5+ років досвіду у BI, data analytics або data engineering
— Досвід роботи з Power BI, Tableau, Looker чи подібними інструментами буде плюсом
— Просунуті навички роботи з SQL
— Досвід моделювання даних, роботи зі структурами даних та data warehousing
— Розуміння процесів ETL/ELT та data pipelines
— Досвід очищення, валідації та контролю якості даних
— Вміння працювати з великими наборами даних та складною бізнес-логікою
— Добре розуміння бізнес-звітності, KPI та дизайну дашбордів
— Досвід прямої роботи зі стейкхолдерами для збору вимог та уточнення звітних потреб
— Рівень англійської Upper-Intermediate+

Буде плюсом:

— Досвід роботи з урядовими, державними, медичними, фінансовими або іншими регульованими доменами
— Досвід роботи з Azure, AWS, Snowflake, BigQuery, Databricks або Redshift
— Python або R для аналізу даних
— Досвід роботи з dbt, Airflow, Dagster чи подібними інструментами
— Знання data governance, access control та звітності, пов’язаної з комплаєнсом
— Досвід роботи за Agile

Are you passionate about turning data into actionable insights? We are looking for a Senior BI Engineer to join our Data & Analytics team and help shape reporting, dashboarding, and data-driven decision-making across diverse business and potentially government-related projects.

This is a Senior-level role with hybrid or remote work options, offering flexibility and opportunities to collaborate with talented professionals worldwide. The ideal candidate has strong hands-on experience with BI tools, advanced SQL, data modeling, and close collaboration with business stakeholders. This role requires not only technical expertise but also the ability to understand business needs, translate them into clear reporting solutions, and ensure data accuracy and reliability.

At Sigma Software, we value innovation, precision, and teamwork, and we provide a supportive environment where your expertise can make a real impact.

Why join us? You’ll work on meaningful projects, gain exposure to different domains, and enjoy benefits such as professional growth opportunities, a global team culture, and access to cutting-edge technologies.

Responsibilities:

— Design, build, and maintain BI reports and dashboards
— Analyze business requirements and translate them into reporting solutions
— Work with stakeholders to define KPIs, metrics, and data logic
— Write and optimize SQL queries
— Validate data accuracy and investigate inconsistencies
— Support data modeling and reporting layer improvements
— Collaborate with Data Engineers, Business Analysts, PMs, and customer-side stakeholders
— Prepare documentation for reports, metrics, and data sources
— Contribute to BI best practices within the unit

Requirements:

— 5+ years of experience in BI, data analytics, or data engineering-related roles
— Strong experience with Power BI, Tableau, Looker, or similar tools
— Advanced SQL skills
— Experience with data modeling, data structures, and data warehousing
— Understanding of ETL/ELT processes and data pipelines
— Experience with data cleaning, validation, and data quality control
— Ability to work with large datasets and complex business logic
— Good understanding of business reporting, KPIs, and dashboard design
— Experience working directly with stakeholders to gather requirements and clarify reporting needs
— Upper-Intermediate+ English level

Will be a plus:

— Experience with government, public sector, healthcare, finance, or other regulated domains
— Experience with Azure, AWS, Snowflake, BigQuery, Databricks, or Redshift
— Python or R for data analysis
— Experience with dbt, Airflow, Dagster, or similar tools
— Knowledge of data governance, access control, and compliance-related reporting
— Experience with Agile delivery

Чи захоплює вас перетворення даних на практичні інсайти? Ми шукаємо Senior BI Engineer, який приєднається до нашої команди Data & Analytics і допоможе формувати звітність, створювати дашборди та розвивати підхід до прийняття рішень на основі даних у різноманітних бізнес- та потенційно державних проєктах.

Looking for a Data Engineer to join the Dataforest team. If you are looking for a friendly team, a healthy working environment, and a flexible schedule ‒ you have found the right place to send your CV.

You'll be a great fit if you have:

- 2+ years of experience with Python;
- 2+ years of experience as a Data Engineer;
- Experience with Pandas;
- Experience with SQL DB / NoSQL (Redis, Mongo, Elasticsearch) / BigQuery;
- Familiarity with Amazon Web Services;
- Experience with Kafka;
- Knowledge of data algorithms and data structures is a MUST;
- Working with high volume tables 10m+.

What you'll do:

- Create ETL pipelines and data management solutions (API, Integration logic);
- Different data processing algorithms;
- Involvement in creation of forecasting, recommendation, and classification models.

Would be a plus:

- Experience with Spark (pyspark);
- Experience with Airflow;
- Experience in statistics;
- Knowledge of DS and Machine learning algorithms.

We ensure your growth with:

- Great networking opportunities with international clients, challenging tasks;
- Building interesting projects from scratch using new technologies;
- Personal and professional development opportunities;
- Competitive salary fixed in USD;
- Paid vacation and sick leaves;
- Flexible work schedule;
- Friendly working environment with minimal hierarchy;
- Team building activities, corporate events.

We are looking for a Integration Manager to join a project focused on AI-powered pricing solutions for enterprise retail businesses. In this role, you will drive customer integrations, support data quality processes, and help build scalable onboarding and integration workflows.

You will work closely with Customer IT and business stakeholders, external integration partners, and internal teams to ensure seamless platform adoption and reliable integration performance. This position is a great fit for specialists who enjoy solving data challenges while balancing technical and business communication.

We at Sigma Software offer the opportunity to work on impactful international projects, collaborate with experienced professionals, and contribute to modern data-driven solutions used by global retailers.

CUSTOMER

Our Customer is a leading retail technology company specializing in AI-driven pricing optimization solutions for enterprise retailers. The company helps businesses improve profitability and competitiveness through advanced analytics, automation, and data-informed pricing strategies. Their platform combines business intelligence with sophisticated algorithms to support smarter pricing decisions at scale.

PROJECT

The project focuses on implementing and optimizing a modern pricing platform for large-scale retail organizations. As an Integration Engineer, you will support Customer onboarding, ensure reliable and scalable integrations, and contribute to seamless platform adoption. The role involves close collaboration with Customer IT and business teams, external partners, and internal stakeholders in an international environment.

Job Description

• Lead end-to-end technical integrations between the platform and Customer systems
• Coordinate onboarding activities and support successful Customer adoption
• Support, maintain, and optimize integrations for existing enterprise Customers
• Ensure reliability, consistency, and quality of integrated data flows
• Translate business requirements into technical integration solutions
• Collaborate directly with Customer IT and business stakeholders
• Coordinate external integration vendors and contractors during implementation activities
• Identify and resolve integration and data-related issues
• Contribute to scalable and repeatable integration processes and best practices
• Participate in Customer workshops, technical discussions, and solution presentations

Qualifications

• 3+ years of commercial experience in integration, data engineering, or related roles
• Strong SQL skills
• Upper-Intermediate or higher English level
• Experience translating business requirements into technical solutions
• Understanding of data integration concepts and enterprise system integrations
• Strong analytical thinking and problem-solving skills
• Excellent communication and presentation abilities
• Experience working directly with Customers and stakeholders
• Ability to work independently with minimal supervision
• Strong attention to detail and fast-learning mindset

WILL BE A PLUS:

• Basic Python knowledge
• Experience with Apache Airflow
• Understanding of ETL processes and data integration best practices
• Experience working on retail industry projects
• Experience supporting enterprise-level Customer

Level: Middle Engagement: Long-term contract Location: Europe (EU / EEA / UK), remote Working hours: EU business hours, shifted 2–3 hours later to ensure daily overlap with US West Coast (PST/PDT) mornings

About the Client

Our client is a leading enterprise data platform company building an open, high-performance data lakehouse for AI and analytical workloads. The platform combines an intelligent SQL query engine, an AI-ready semantic layer, and an open catalog built on Apache Iceberg — enabling Fortune 500 companies across finance, energy, manufacturing, and logistics to unify, query, and govern data at massive scale across cloud and on-premise sources.

About the Role

We are looking for a Middle-level Software Engineer to work on the core query engine of a large-scale distributed data platform. You will develop features across query planning, optimization, and execution, contribute to performance-critical components, and help evolve the platform's ability to process massive analytical workloads across heterogeneous data sources.

This is a systems-level, backend engineering role focused on distributed data processing internals — not application development or CRUD services.

Responsibilities

• Develop and maintain features across the query engine — planning, optimization, execution, and data access layers.
• Write high-quality, performance-conscious code in Java and/or C++.
• Work with SQL semantics, query plans, and execution operators over large-scale distributed data.
• Integrate with columnar formats, open table formats, and connectivity drivers used across the platform.
• Contribute to CI/CD pipelines and automated testing — participate in build, test, and release workflows in Jenkins.
• Deploy and validate work in Kubernetes (GKE / EKS / AKS) across GCP, AWS, and Azure using Docker.
• Debug complex issues spanning query planning, distributed execution, memory management, and I/O.
• Collaborate closely with US-based engineering teams on design reviews, code reviews, and technical decisions.

Required Qualifications

• Education: B.S. or M.S. in Computer Science, Computer Engineering, or a related technical field.
• Programming: Strong proficiency in Java or C++, with solid OOP and software design fundamentals. Candidates comfortable with both are especially valued.
• SQL & Data: Strong SQL skills and solid understanding of relational and analytical data systems, including query execution concepts.
• Data processing systems experience: Hands-on experience with data processing systems — query engines, distributed databases, ETL/ELT frameworks, or analytical platforms.
• Engineering experience: 3+ years in backend/systems software engineering.
• CI/CD & DevOps basics: Practical experience with Jenkins pipelines and modern development workflows.
• Containers: Working knowledge of Docker and basic Kubernetes (running workloads, debugging pods, kubectl fluency).
• Cloud: Comfortable operating in at least one major cloud (GCP, AWS, or Azure).
• Version Control: Confident with Git / GitHub workflows.
• English: Upper-Intermediate or higher (B2+) — daily written and verbal communication with a US-based engineering team.
• Availability: Able to work EU hours with a 2–3 hour shift toward US West Coast time to ensure daily overlap with the client team.

Desired Skills

• Experience with Apache Arrow (columnar in-memory format).
• Familiarity with Apache Calcite (SQL parsing, planning, optimization framework).
• Exposure to Gandiva or LLVM-based expression compilation.
• Experience with open table formats — Apache Iceberg, Delta Lake, or Hudi.
• Familiarity with distributed computing frameworks (e.g., Apache Spark, Kafka) and MPP SQL query engines (e.g., Presto, Trino, or similar).
• Understanding of query planning, optimization, and execution internals.
• Experience with data connectivity drivers: JDBC, ODBC, Arrow Flight.
• Kubernetes on managed services (GKE / EKS / AKS) and multi-cloud exposure.
• IaC tools such as Terraform.
• Experience with performance profiling and optimization of latency-sensitive systems.
  Please note: We can consider only candidates currently residing in the EU, EEA, or the UK.
  Please note: We can consider only candidates currently residing in the EU, EEA, or the UK

Level: Senior Engagement: Long-term contract Location: Europe (EU / EEA / UK), remote Working hours: EU business hours, shifted 2–3 hours later to ensure daily overlap with US West Coast (PST/PDT) mornings

About the Client

Our client is a leading enterprise data platform company building an open, high-performance data lakehouse for AI and analytical workloads. The platform combines an intelligent SQL query engine, an AI-ready semantic layer, and an open catalog built on Apache Iceberg — enabling Fortune 500 companies across finance, energy, manufacturing, and logistics to unify, query, and govern data at massive scale across cloud and on-premise sources.

About the Role

We are looking for a Senior Software Engineer to design, build, and own significant components of the core query engine of a large-scale distributed data platform. You will lead work across query planning, optimization, and execution — driving architectural decisions, mentoring middle engineers, and pushing the platform's performance and scalability boundaries across all major clouds.

This is a systems-level, backend engineering role focused on distributed data processing internals — not application development or CRUD services.

Responsibilities

• Architect, design, and implement significant components of the query engine — planner, optimizer, execution operators, memory management, and data access layers.
• Write and review high-quality, performance-critical code in Java and/or C++.
• Own end-to-end delivery of features from technical design through production rollout.
• Drive performance optimization work — profiling, benchmarking, and eliminating bottlenecks in latency- and throughput-sensitive paths.
• Integrate deeply with columnar formats, open table formats, and connectivity drivers.
• Mentor middle engineers, lead code reviews, and set technical standards for the team.
• Contribute to CI/CD architecture and quality processes across Jenkins, containerization, and multi-cloud deployment (GCP, AWS, Azure via Kubernetes / Docker).
• Debug complex, cross-layer issues spanning query planning, distributed execution, memory management, and I/O.
• Partner with US-based engineering leads on design reviews, architectural decisions, and roadmap execution.

Required Qualifications

• Education: B.S. or M.S. in Computer Science, Computer Engineering, or a related technical field.
• Programming: Strong proficiency in Java or C++, with deep understanding of OOP, systems design, memory management, and concurrency. Candidates strong in both are especially valued.
• SQL & Data: Advanced SQL skills and strong understanding of query execution internals — planning, optimization, and operator implementation.
• Data processing systems experience: Demonstrated experience building or extending data processing systems — query engines, distributed databases, ETL/ELT frameworks, or analytical platforms.
• Engineering experience: 5+ years in backend/systems software engineering, with a track record of owning significant components.
• CI/CD & DevOps: Solid experience with Jenkins and modern engineering workflows.
• Containers & Orchestration: Strong working knowledge of Docker and Kubernetes.
• Cloud: Hands-on experience with at least one major cloud (GCP, AWS, or Azure); exposure to more than one is a strong plus.
• Version Control: Confident with Git / GitHub workflows and rigorous code review practices.
• English: Upper-Intermediate or higher (B2+) — daily written and verbal communication with a US-based engineering team.
• Availability: Able to work EU hours with a 2–3 hour shift toward US West Coast time to ensure daily overlap with the client team.
• Leadership: Prior experience mentoring engineers, leading technical designs, or owning components end-to-end.

Desired Skills

• Deep experience with Apache Arrow (columnar in-memory format).
• Hands-on experience with Apache Calcite (SQL parsing, planning, optimization framework).
• Experience with Gandiva or LLVM-based expression compilation and code generation.
• Experience with open table formats — Apache Iceberg, Delta Lake, or Hudi.
• Deep familiarity with distributed computing frameworks (e.g., Apache Spark, Kafka) and MPP SQL query engines (e.g., Presto, Trino, or similar).
• Deep understanding of query planning, optimization (cost-based, rule-based), and execution internals.
• Experience with data connectivity drivers: JDBC, ODBC, Arrow Flight.
• Kubernetes on managed services (GKE / EKS / AKS) and multi-cloud exposure.
• IaC tools such as Terraform.
• Track record of performance optimization at the systems level — profiling, vectorization, cache/memory-conscious design.
• Prior experience contributing to open-source data infrastructure projects.
  Please note: We can consider only candidates currently residing in the EU, EEA, or the UK

Level: Middle Engagement: Long-term contract Location: Europe (EU / EEA / UK), remote Working hours: EU business hours, shifted 2–3 hours later to ensure daily overlap with US West Coast (PST/PDT) mornings

About the Client

Our client is a leading enterprise data platform company building an open, high-performance data lakehouse for AI and analytical workloads. The platform combines an intelligent SQL query engine, an AI-ready semantic layer, and an open catalog built on Apache Iceberg — enabling Fortune 500 companies across finance, energy, manufacturing, and logistics to unify, query, and govern data at massive scale across cloud and on-premise sources.

About the Role

We are looking for a Middle-level SDET to design and maintain automated tests for a large-scale distributed data platform. You will validate the correctness, performance, and reliability of the query engine, connectivity layer, and backend services across all major clouds.

This is a data-heavy, backend-focused role. We are not looking for web/UI QA engineers — the work centers on validating distributed query execution, data correctness at scale, connectivity drivers, and backend microservices.

Responsibilities

• Develop and maintain automated tests in Python / pytest for backend services, REST APIs, and distributed data components.
• Write end-to-end, integration, and regression tests covering SQL query execution, data correctness, and platform APIs.
• Support performance and load testing with JMeter, including workloads over JDBC / ODBC / Arrow Flight drivers.
• Validate data-intensive scenarios — query plans, result correctness across data sources, metadata consistency, and behavior under concurrency.
• Contribute to CI/CD test pipelines in Jenkins — configure, maintain, and troubleshoot.
• Provision and manage test environments in Kubernetes (GKE / EKS / AKS) across GCP, AWS, and Azure using Docker.
• Investigate failures across the stack — query engine, distributed services, drivers, infrastructure — and drive them to resolution with engineering.
• Collaborate with US-based developers on testability and quality gates.

Required Qualifications

• Education: B.S. or M.S. in Computer Science, Computer Engineering, or a related technical field.
• Programming: Strong proficiency in Python, including pytest, with a solid grasp of OOP and software design principles.
• SQL & Data: Strong SQL skills and solid understanding of how relational and analytical data systems work.
• Data-intensive testing experience: Hands-on experience testing data-intensive systems — query engines, ETL/ELT pipelines, streaming platforms, or analytical databases. Candidates with only web/UI QA backgrounds are not a fit.
• Testing experience: 3+ years in backend/system test automation or SDET roles.
• CI/CD & DevOps basics: Practical experience with Jenkins pipelines and deploying/maintaining test environments.
• Containers: Working knowledge of Docker and basic Kubernetes (running workloads, debugging pods, kubectl fluency).
• Cloud: Comfortable operating in at least one major cloud (GCP, AWS, or Azure).
• Version Control: Confident with Git / GitHub workflows.
• English: Upper-Intermediate or higher (B2+) — daily written and verbal communication with a US-based engineering team.
• Availability: Able to work EU hours with a 2–3 hour shift toward US West Coast time to ensure daily overlap with the client team.

Desired Skills

• Experience testing REST APIs and backend microservices at scale.
• Familiarity with distributed computing frameworks (e.g., Apache Spark, Kafka) and MPP SQL query engines (e.g., Presto, Trino, or similar).
• Understanding of modern data lakehouse concepts, open table formats (Apache Iceberg), and data warehousing.
• Experience with data connectivity drivers: JDBC, ODBC, Arrow Flight.
• Performance testing with JMeter or comparable load-testing tools.
• Kubernetes on managed services (GKE / EKS / AKS) and multi-cloud exposure.
• IaC tools such as Terraform.
• Understanding of query plan generation, query acceleration / materializations, and metadata integrity in distributed data systems.
  Please note: We can consider only candidates currently residing in the EU, EEA, or the UK

Level: Senior Engagement: Long-term contract Location: Europe (EU / EEA / UK), remote Working hours: EU business hours, shifted 2–3 hours later to ensure daily overlap with US West Coast (PST/PDT) mornings

About the Client

Our client is a leading enterprise data platform company building an open, high-performance data lakehouse for AI and analytical workloads. The platform combines an intelligent SQL query engine, an AI-ready semantic layer, and an open catalog built on Apache Iceberg — enabling Fortune 500 companies across finance, energy, manufacturing, and logistics to unify, query, and govern data at massive scale across cloud and on-premise sources.

About the Role

We are looking for a Senior SDET to lead the design of automated test frameworks and testing strategy for a large-scale distributed data platform. You will own the quality of the query engine, connectivity layer, and backend services end-to-end — from framework architecture through CI/CD infrastructure across all major clouds — and mentor middle engineers on the team.

This is a data-heavy, backend-focused role. We are not looking for web/UI QA engineers — the work centers on validating distributed query execution, data correctness at scale, connectivity drivers, and backend microservices.

Responsibilities

• Architect, design, and evolve automated test frameworks in Python / pytest for backend services, REST APIs, and distributed data components.
• Define testing strategy for new features and platform components — coverage, risk assessment, and quality gates.
• Own end-to-end, integration, performance, and regression testing covering SQL query execution, data correctness at scale, and platform APIs.
• Lead performance and load testing efforts with JMeter, including workloads over JDBC / ODBC / Arrow Flight drivers.
• Design and validate large-scale data testing scenarios — query plans, result correctness across heterogeneous data sources, metadata consistency, and behavior under high concurrency.
• Own CI/CD test pipelines in Jenkins — architect, maintain, and continuously improve.
• Provision and manage test environments in Kubernetes (GKE / EKS / AKS) across GCP, AWS, and Azure using Docker; drive automation and reproducibility.
• Investigate complex, cross-layer failures and drive root-cause analysis with engineering.
• Mentor middle SDETs, review test designs, and set quality standards across the team.
• Partner with US-based development leads on shift-left practices, testability, and release readiness.

Required Qualifications

• Education: B.S. or M.S. in Computer Science, Computer Engineering, or a related technical field.
• Programming: Strong proficiency in Python, including pytest, with deep understanding of OOP, software design principles, and test framework architecture.
• SQL & Data: Advanced SQL skills and strong understanding of relational and analytical data systems, including query execution internals.
• Data-intensive testing experience: Demonstrated experience testing data-intensive systems — query engines, ETL/ELT pipelines, streaming platforms, or analytical databases. Candidates with only web/UI QA backgrounds are not a fit.
• Testing experience: 5+ years in backend/system test automation, with demonstrated ownership of test strategy and infrastructure.
• CI/CD & DevOps: Solid experience architecting and maintaining Jenkins pipelines and test environments.
• Containers & Orchestration: Strong working knowledge of Docker and Kubernetes (running workloads, debugging pods, deploying complex environments).
• Cloud: Hands-on experience with at least one major cloud (GCP, AWS, or Azure); exposure to more than one is a strong plus.
• Version Control: Confident with Git / GitHub workflows and code review practices.
• English: Upper-Intermediate or higher (B2+) — daily written and verbal communication with a US-based engineering team.
• Availability: Able to work EU hours with a 2–3 hour shift toward US West Coast time to ensure daily overlap with the client team.
• Leadership: Prior experience mentoring engineers, defining test strategy, or leading a QA/SDET function.

Desired Skills

• Deep experience testing REST APIs and backend microservices at scale.
• Hands-on with distributed computing frameworks (e.g., Apache Spark, Kafka) and MPP SQL query engines (e.g., Presto, Trino, or similar).
• Strong understanding of modern data lakehouse concepts, open table formats (Apache Iceberg), and data warehousing.
• Experience with data connectivity drivers: JDBC, ODBC, Arrow Flight.
• Performance testing with JMeter or comparable load-testing tools at production scale.
• Kubernetes on managed services (GKE / EKS / AKS) and multi-cloud exposure.
• IaC tools such as Terraform.
• Deep understanding of query plan generation, query acceleration / materializations, and metadata integrity in distributed data systems.
• Prior experience leading a QA/SDET function in a data-platform or database engineering environment.
  Please note: We can consider only candidates currently residing in the EU, EEA, or the UK.

We are looking for Data Engineer, who will be embedded in the Data Platform team of a global mining organisation, helping design and deliver a modern Azure-native data infrastructure. The team ingests data from dozens of operational sources — including REST and SOAP APIs, IoT sensors, ERP systems, and flat-file feeds — transforming it into curated, analytics-ready datasets that drive decisions across finance, operations, and supply chain.

This is a hands-on engineering role. You will spend most of your time building and maintaining robust pipelines, optimising data flows within Azure Synapse and Databricks, and ensuring the platform remains reliable, scalable, and secure.

Key Responsibilities:

• Gather and analyse business requirements to identify and prioritise integration opportunities.
• Design, build, and maintain scalable data pipelines using Azure Data Factory to orchestrate ingestion from diverse source systems.
• Develop and optimise data transformation logic and analytical workloads in Azure Synapse Analytics (dedicated and serverless SQL pools, Synapse Pipelines).
• Build and maintain Databricks notebooks and jobs (PySpark / Spark SQL) for large-scale data processing and feature engineering.
• Implement robust API extraction patterns — REST and SOAP — handling pagination, authentication (OAuth 2.0, API keys), rate limiting, and error recovery.
• Design and maintain the lakehouse architecture: raw, curated, and serving layers using Azure Data Lake Storage Gen2.
• Ensure data quality through validation frameworks, monitoring pipelines, alerting, and lineage documentation.
• Collaborate with Analytics Engineers and data consumers to understand downstream requirements and model data accordingly.
• Apply best practices for CI/CD, infrastructure-as-code (Azure DevOps, Terraform / Bicep), and environment management.
• Participate in data governance activities including metadata management, access control, and documentation.

Requirements:

• 4+ years of experience in data engineering or a closely related software engineering role.
• Strong analytical and communication skills
• Strong hands-on experience with Azure Data Factory — authoring pipelines, triggers, linked services, and data flows.
• Solid experience with Azure Synapse Analytics — SQL pools, Synapse Pipelines, and integration with ADLS Gen2.
• Proven experience with Databricks — PySpark, Delta Lake, job clusters, and Unity Catalog is a plus.
• Strong API extraction skills: designing reliable ingestion from REST and SOAP endpoints, handling complex authentication and error scenarios.
• Proficiency in SQL (T-SQL or Spark SQL) and Python for data manipulation and pipeline scripting.
• Familiarity with data modelling concepts: star/snowflake schemas, data vault, or medallion architecture.
• Experience with Azure DevOps for source control (Git), CI/CD pipelines, and automated deployments.
• Understanding of data security, role-based access control (RBAC), and encryption in Azure.
• Strong problem-solving mindset and ability to work autonomously in a distributed team environment.

Nice to have:

• Experience with Azure Purview for data cataloguing and governance.
• Knowledge of streaming data patterns (Azure Event Hubs, Kafka, Spark Streaming).
• Familiarity with dbt or similar SQL-based transformation frameworks.
• Background in mining, heavy industry, or operational technology (OT) data environments.
• Power Platform awareness (not required, but beneficial for understanding downstream consumers).

We offer*:

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

*benefits are not applicable for freelancers

N-iX is a global software development service company that helps businesses across the globe create next-generation software products. Founded in 2002, we unite 2,400+ tech-savvy professionals across 40+ countries, working on impactful projects for industry leaders and Fortune 500 companies. Our expertise spans cloud, data, AI/ML, embedded software, IoT, and more, driving digital transformation across finance, manufacturing, telecom, healthcare, and other industries. Join N-iX and become part of a team where your ideas make a real impact.

We are looking for a Lead Data Engineer to join our team and contribute to one of Europe's leading online automotive marketplaces, serving 30+ million monthly users across 18 countries.

As a Lead Data Engineer, you will lead a team of data engineers and analysts, partnering closely with business stakeholders and senior analysts to translate marketplace analytics needs — from web & app tracking to marketing performance — into robust data models and pipelines that power the company's key business decisions.

This role sits closer to the business than a typical data engineering position. The Data Platform Engineering team owns the underlying platform and infrastructure, so you'll focus on understanding analytics use cases, shaping data models, and enabling analysts and stakeholders to answer their most important business questions.

Responsibilities:

• Lead and mentor a team of data engineers, providing technical direction as well as people leadership.
• Partner with business stakeholders and senior analysts to gather requirements and translate business KPIs and OKRs into data models and pipelines.
• Design, build, and maintain scalable data models that support marketplace analytics, including web/app tracking and marketing use cases.
• Write and optimize complex SQL to transform and model data for analytics consumption.
• Build and troubleshoot code-based data pipelines using Python, Spark, and Airflow, jumping in hands-on when needed while guiding the wider engineering team's pipeline work.
• Champion data quality by implementing and maintaining data testing practices across the team's pipelines.
• Evaluate and apply semantic layer concepts to make data more accessible and consistent for business users.
• Explore and adopt AI tooling provided by the company to improve team productivity and data workflows.
• Act as a bridge between the Data Platform Engineering team (who own infrastructure) and the business, ensuring analytics needs are well understood and delivered.
• Deliver on product requirements on time while keeping tech debt and redundancy to a minimum, following best practices and standards.
• Keep yourself and stakeholders aligned with clear, ongoing visibility into project status, surfacing risks early along with a plan and timeline for resolving them.

Requirements:

• Proven experience leading a data engineering team — this role requires genuine people leadership, not just senior-level technical skills.
• Strong ownership mindset, with a track record of delivering reliably on time while minimizing tech debt and redundancy and adhering to best practices and standards.
• 5+ years of hands-on experience in Data Engineering.
• Hands-on experience building data pipelines with Python and Spark — the project's pipelines are code-based (not SQL/dbt-based) — with the ability to jump in and contribute directly when needed, as well as a deep enough understanding to follow and guide what other engineers on the team are building.
• Hands-on experience with Airflow for orchestrating data pipelines.
• Proficiency with Git for version control.
• Strong SQL skills, with the ability to write and optimize complex queries (experience with any SQL dialect is fine — prior exposure to Athena specifically is not required).
• Solid data modeling skills, with experience designing models that serve analytics and business intelligence use cases.
• Excellent communication skills, with the ability to engage business stakeholders and senior analysts to gather requirements and understand KPIs/OKRs.
• Familiarity with data testing practices and tools.
• Familiarity with AI tooling for data engineering workflows.
• English proficiency at B2/C1 level or higher.

Nice to have:

• Experience with marketplace analytics, including web & app tracking and a good understanding of marketing/business metrics.
• Previous experience working with a semantic layer.
• Experience with AWS — the project runs on an AWS data lake, so this is an advantage, though equivalent experience with other cloud providers is also fine given the transferable concepts.

Genesis is a full-service international IT company. More than 1,500 people in five countries create products for more than 200 million unique monthly users. We are one of the largest partners of Facebook, Google, Snapchat, and Apple in Eastern Europe. Our ecosystem consists of more than 15 companies and an investment fund.
 

EverHelp is a company in the Genesis ecosystem. We’re a team of professionals, that’s developing outsourcing support services for plenty of products all over the world at a dynamic tempo. The project launched in 2021, and last year we experienced a yearly growth rate of +82%. Since February 2022, we've managed to preserve all our workplaces and, most importantly, we continue to strengthen our team while maintaining an employee satisfaction rate of over 90%.
 

In 2026, EverHelp received 9 international workplace and employer awards. The company ranked #1 in the Top 30 Inspiring Workplaces in Europe, was named the #1 employer among European companies with 500–4,999 employees, and earned Best-in-Class recognition across 6 categories: Culture & Purpose, Leadership, Inclusion & Belonging, Wellbeing, Employee Voice, and Employee Experience. EverHelp was also named one of the 28 Best Places to Work by Business Intelligence Group — a global award recognizing companies with strong workplace cultures and outstanding employee experience.
 

Our statement:

• We’re against war and unjustified aggression,
• We evacuated all the teammates and their families from the frontline, helped them find a new place to live and provided financial support,
• We provided the team with charging stations,
• We continue to work together for the future of Ukraine.
   

EverHelp is scaling fast, and our data infrastructure needs a dedicated owner to keep it reliable and growing.
 

Your future responsibilities include:

• Building, optimizing, and maintaining ETL pipelines that extract data from ERP
  systems, databases, and APIs, transform it into a usable format, and load it into
  BigQuery
• Automating data ingestion, transformation, and loading processes to reduce manual
  intervention and ensure efficiency
• Monitoring and troubleshooting data pipelines proactively — catching performance
  issues, errors, and data quality problems before they escalate
• Managing and optimizing data storage: partitioning, indexing, and performance tuning
  in BigQuery
• Designing data models that represent the structure and relationships within business
  data
• Implementing data quality checks and validation rules at every stage of the pipeline
• Identifying and resolving data inconsistencies, errors, and missing values
• Conducting data audits and comparing results with business user needs — proposing
  solutions to close existing gaps
• Collaborating with analysts, data scientists, and business stakeholders to understand
  their data needs and translate them into scalable solutions
   

Why this role might be interesting for you:

If you love structure and enjoy optimizing processes — this is your playground. You'll make real-world architectural decisions, not just execute tickets. Every pipeline you build or improve directly powers business decisions at the highest level, so the impact of your work is visible and immediate. And if you want to be the person who shapes a data-driven culture from the inside — that's exactly the role we're offering.
 

Needed experience & skills:

• 2-4 years of hands-on experience as a Data Engineer
• Advanced knowledge of SQL and Python
• Hands-on experience with GCP, in particular BigQuery
• Strong ETL and data warehousing skills: Apache Airflow, dbt
• Clear understanding of both the technical and business sides of data products
• Clear and concise communication; comfortable working cross-functionally with nontechnical stakeholders
• Proactive problem-solving mindset — analytical thinking and attention to detail
• English level — B2+
   

Nice to have skills:

• Experience at a large systematic company (retail, banking, telecom, FMCG, logistics)
• Comfort working autonomously as the only Data Engineer on a team
• Adaptability in a high-paced, fast-changing environment
   

Hiring Process:

CV Screening → Questionnaire → Intro Call → Tech & Soft Interview → Bar Raising
 

Work with EverHelp is about:

• Opportunity to join the Ukrainian company and help the Ukrainian economy,
• 20+ vacation days and unlimited sick leaves, corporate doctor & psychologist,
• Medical insurance and +10 Healthcare leaves for mental & physical recovery,
• Systematical learning & development inside a team and on an individual level: compensation for professional webinars, courses, conferences, etc.,
• Ability to work from Lviv & Kyiv offices with free breakfasts and lunches or fully remotely,
• Team of professionals who’s ready for knowledge sharing, internal professional communities, team buildings,
• Corporate discounts for gym membership and for other different services like medical services, language schools, etc.
   

Submit your resume and join our team!

Requirements

• 4+ years of commercial experience as a DevOps Engineer.
• Strong hands-on experience with AWS / GCP.
• Experience with Terraform (Infrastructure as Code).
• Experience with Docker / Kubernetes.
• Strong Linux administration skills.
• Experience building and maintaining CI/CD pipelines.
• Experience with monitoring and observability tools (Grafana / Prometheus).
• Scripting and automation using Python / Bash.
• Experience with PostgreSQL / MySQL / Redis.
• Strong troubleshooting and problem-solving skills.

Responsibilities

• Design, implement, and maintain scalable, secure, and highly available cloud infrastructure.
• Automate infrastructure provisioning and deployment processes using Infrastructure as Code.
• Build, maintain, and optimize CI/CD pipelines.
• Configure and support containerized environments.
• Monitor production systems, troubleshoot incidents, and ensure infrastructure reliability.
• Collaborate with development teams to improve deployment and operational processes.
• Maintain infrastructure documentation and implement DevOps best practices.