Jobs Data Engineer

• The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.
  
  Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.
  
  Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.

   

• Responsibilities:

  We are looking for Senior Data Engineer to implement a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.

   

• Mandatory Skills Description:

  • Overall years of experience required 8+
  • Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).
  • Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.
  • Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.
  • Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.
  • Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.
  • Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)
  • Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.
  • Experience integrating metadata and governance processes into cloud-based data platforms
  • Certification in Azure, Databricks, or other relevant technologies is an added advantage
  • Experience with cloud-based analytical databases.
  • Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.
  • Experience with Python and Python-based ETL tools.
  • Experience with shell scripting in Bash, Unix or windows shell is preferable.
  • Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels.

   

• Nice-to-Have Skills Description:

  • Experience with Elasticsearch
  • Familiarity with containerization and orchestration technologies (Docker, Kubernetes).
  • Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.
  • Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.
  • Ability to plan, estimate and track progress of implementing features
  • Computer Science and data science academic and education credentials

   

• Languages:
  • English: B2 Upper Intermediate

• Project Description:

  We are building a next generation cross asset data fabric, which will bring together disparate data sources for the global bank. It will enable industry leading analytics, reporting and data science solutions. There are multiple streams within application covering Reporting, Data and Analytics.

• Responsibilities:

  This role is for a Senior Business Intelligence (BI) Developer to create reporting framework and set up the ground work for creation of Tableau reporting via Dashboards and scheduled reporting. The ideal candidate will help to ensure highest level of quality of a product being developed while working very closely with different stakeholders spread across globally
  Candidate will work independently and is highly self-motivated. Applies skills and knowledge of the business to test creative solutions to meet client and business needs.

• Mandatory Skills Description:

  1. Strong SQL and Data Analyst experience.
  2. Experience in Tableau
  3. Proven experience as BI developer
  4. Background in data warehouse design (e.g. dimensional modeling) and data mining
  5. Understanding of database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework
  6. Proven abilities to take initiative and be innovative
  7. Analytical mind with a problem-solving aptitude.
  8. Team player, good on communication with Business Analysts or Traders, Highly Motivated, quick learner, general interest in Equity/Equity Derivatives Trading Business. Experience in Risk Department (Risk area).
  9. Exposure to Equities business
  10. Must have worked in Agile [min 2+ years]
  11. Must have good analytical & logical skills
  12. Strong interpersonal, oral and written communication

• Nice-to-Have Skills Description:

  - Understanding of Big Data concepts and technologies, enabling effective handling and analysis of large datasets.
  - Concepts (HDFS,Spark,Hive,Impala)

• Languages:
  • English: B2 Upper Intermediate

We are building a next generation cross asset data fabric, which will bring together disparate data sources for the global bank. It will enable industry leading analytics, reporting and data science solutions. There are multiple streams within application covering Reporting, Data and Analytics.

• Responsibilities:

  This role is for a Senior Business Intelligence (BI) Developer to create reporting framework and set up the ground work for creation of Tableau reporting via Dashboards and scheduled reporting. The ideal candidate will help to ensure highest level of quality of a product being developed while working very closely with different stakeholders spread across globally
  Candidate will work independently and is highly self-motivated. Applies skills and knowledge of the business to test creative solutions to meet client and business needs.

• Mandatory Skills:
  • Tableau

• Mandatory Skills Description:

  1. Strong SQL and Data Analyst experience.
  2. Experience in Tableau
  3. Proven experience as BI developer
  4. Background in data warehouse design (e.g. dimensional modeling) and data mining
  5. Understanding of database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework
  6. Proven abilities to take initiative and be innovative
  7. Analytical mind with a problem-solving aptitude.
  8. Team player, good on communication with Business Analysts or Traders, Highly Motivated, quick learner, general interest in Equity/Equity Derivatives Trading Business. Experience in Risk Department (Risk area).
  9. Exposure to Equities business
  10. Must have worked in Agile [min 2+ years]
  11. Must have good analytical & logical skills
  12. Strong interpersonal, oral and written communication

Level: Senior 

Engagement: Long-term contract 

Location: Europe (EU / EEA / UK), remote 

Working hours: EU business hours, shifted 2–3 hours later to ensure daily overlap with US West Coast (PST/PDT) mornings

About the Client

Our client is a leading enterprise data platform company building an open, high-performance data lakehouse for AI and analytical workloads. The platform combines an intelligent SQL query engine, an AI-ready semantic layer, and an open catalog built on Apache Iceberg — enabling Fortune 500 companies across finance, energy, manufacturing, and logistics to unify, query, and govern data at massive scale across cloud and on-premise sources.

About the Role

We are looking for a Senior SDET to lead the design of automated test frameworks and testing strategy for a large-scale distributed data platform. You will own the quality of the query engine, connectivity layer, and backend services end-to-end — from framework architecture through CI/CD infrastructure across all major clouds — and mentor middle engineers on the team.

This is a data-heavy, backend-focused role. We are not looking for web/UI QA engineers — the work centers on validating distributed query execution, data correctness at scale, connectivity drivers, and backend microservices.

Responsibilities

• Architect, design, and evolve automated test frameworks in Python / pytest for backend services, REST APIs, and distributed data components.
• Define testing strategy for new features and platform components — coverage, risk assessment, and quality gates.
• Own end-to-end, integration, performance, and regression testing covering SQL query execution, data correctness at scale, and platform APIs.
• Lead performance and load testing efforts with JMeter, including workloads over JDBC / ODBC / Arrow Flight drivers.
• Design and validate large-scale data testing scenarios — query plans, result correctness across heterogeneous data sources, metadata consistency, and behavior under high concurrency.
• Own CI/CD test pipelines in Jenkins — architect, maintain, and continuously improve.
• Provision and manage test environments in Kubernetes (GKE / EKS / AKS) across GCP, AWS, and Azure using Docker; drive automation and reproducibility.
• Investigate complex, cross-layer failures and drive root-cause analysis with engineering.
• Mentor middle SDETs, review test designs, and set quality standards across the team.
• Partner with US-based development leads on shift-left practices, testability, and release readiness.
•  

Required Qualifications

• Education: B.S. or M.S. in Computer Science, Computer Engineering, or a related technical field.
• Programming: Strong proficiency in Python, including pytest, with deep understanding of OOP, software design principles, and test framework architecture.
• SQL & Data: Advanced SQL skills and strong understanding of relational and analytical data systems, including query execution internals.
• Data-intensive testing experience: Demonstrated experience testing data-intensive systems — query engines, ETL/ELT pipelines, streaming platforms, or analytical databases. Candidates with only web/UI QA backgrounds are not a fit.
• Testing experience: 5+ years in backend/system test automation, with demonstrated ownership of test strategy and infrastructure.
• CI/CD & DevOps: Solid experience architecting and maintaining Jenkins pipelines and test environments.
• Containers & Orchestration: Strong working knowledge of Docker and Kubernetes (running workloads, debugging pods, deploying complex environments).
• Cloud: Hands-on experience with at least one major cloud (GCP, AWS, or Azure); exposure to more than one is a strong plus.
• Version Control: Confident with Git / GitHub workflows and code review practices.
• English: Upper-Intermediate or higher (B2+) — daily written and verbal communication with a US-based engineering team.
• Availability: Able to work EU hours with a 2–3 hour shift toward US West Coast time to ensure daily overlap with the client team.
• Leadership: Prior experience mentoring engineers, defining test strategy, or leading a QA/SDET function.
•  

Desired Skills

• Deep experience testing REST APIs and backend microservices at scale.
• Hands-on with distributed computing frameworks (e.g., Apache Spark, Kafka) and MPP SQL query engines (e.g., Presto, Trino, or similar).
• Strong understanding of modern data lakehouse concepts, open table formats (Apache Iceberg), and data warehousing.
• Experience with data connectivity drivers: JDBC, ODBC, Arrow Flight.
• Performance testing with JMeter or comparable load-testing tools at production scale.
• Kubernetes on managed services (GKE / EKS / AKS) and multi-cloud exposure.
• IaC tools such as Terraform.
• Deep understanding of query plan generation, query acceleration / materializations, and metadata integrity in distributed data systems.
• Prior experience leading a QA/SDET function in a data-platform or database engineering environment.

Level: Middle 

Engagement: Long-term contract

Location: Europe (EU / EEA / UK), remote 

Working hours: EU business hours, shifted 2–3 hours later to ensure daily overlap with US West Coast (PST/PDT) mornings

About the Client

Our client is a leading enterprise data platform company building an open, high-performance data lakehouse for AI and analytical workloads. The platform combines an intelligent SQL query engine, an AI-ready semantic layer, and an open catalog built on Apache Iceberg — enabling Fortune 500 companies across finance, energy, manufacturing, and logistics to unify, query, and govern data at massive scale across cloud and on-premise sources.

About the Role

We are looking for a Middle-level SDET to design and maintain automated tests for a large-scale distributed data platform. You will validate the correctness, performance, and reliability of the query engine, connectivity layer, and backend services across all major clouds.

This is a data-heavy, backend-focused role. We are not looking for web/UI QA engineers — the work centers on validating distributed query execution, data correctness at scale, connectivity drivers, and backend microservices.

Responsibilities

• Develop and maintain automated tests in Python / pytest for backend services, REST APIs, and distributed data components.
• Write end-to-end, integration, and regression tests covering SQL query execution, data correctness, and platform APIs.
• Support performance and load testing with JMeter, including workloads over JDBC / ODBC / Arrow Flight drivers.
• Validate data-intensive scenarios — query plans, result correctness across data sources, metadata consistency, and behavior under concurrency.
• Contribute to CI/CD test pipelines in Jenkins — configure, maintain, and troubleshoot.
• Provision and manage test environments in Kubernetes (GKE / EKS / AKS) across GCP, AWS, and Azure using Docker.
• Investigate failures across the stack — query engine, distributed services, drivers, infrastructure — and drive them to resolution with engineering.
• Collaborate with US-based developers on testability and quality gates.
•  

Required Qualifications

• Education: B.S. or M.S. in Computer Science, Computer Engineering, or a related technical field.
• Programming: Strong proficiency in Python, including pytest, with a solid grasp of OOP and software design principles.
• SQL & Data: Strong SQL skills and solid understanding of how relational and analytical data systems work.
• Data-intensive testing experience: Hands-on experience testing data-intensive systems — query engines, ETL/ELT pipelines, streaming platforms, or analytical databases. Candidates with only web/UI QA backgrounds are not a fit.
• Testing experience: 3+ years in backend/system test automation or SDET roles.
• CI/CD & DevOps basics: Practical experience with Jenkins pipelines and deploying/maintaining test environments.
• Containers: Working knowledge of Docker and basic Kubernetes (running workloads, debugging pods, kubectl fluency).
• Cloud: Comfortable operating in at least one major cloud (GCP, AWS, or Azure).
• Version Control: Confident with Git / GitHub workflows.
• English: Upper-Intermediate or higher (B2+) — daily written and verbal communication with a US-based engineering team.
• Availability: Able to work EU hours with a 2–3 hour shift toward US West Coast time to ensure daily overlap with the client team.
•  

Desired Skills

• Experience testing REST APIs and backend microservices at scale.
• Familiarity with distributed computing frameworks (e.g., Apache Spark, Kafka) and MPP SQL query engines (e.g., Presto, Trino, or similar).
• Understanding of modern data lakehouse concepts, open table formats (Apache Iceberg), and data warehousing.
• Experience with data connectivity drivers: JDBC, ODBC, Arrow Flight.
• Performance testing with JMeter or comparable load-testing tools.
• Kubernetes on managed services (GKE / EKS / AKS) and multi-cloud exposure.
• IaC tools such as Terraform.
• Understanding of query plan generation, query acceleration / materializations, and metadata integrity in distributed data systems.

Responsibilities

• Create data models and related data pipelines in Azure DataBricks and Data Factory for analytical dashboards, integrating multiple data assets
• Support the architectural decisions, and participate in the elaboration of new implementation proposals for our customers, e.g. providing high level estimations and helping establish the right assumptions
• Drive, lead and coach other BE engineers to implement data pipelines following the best practices and influencing the customer requirements
• Strive to understand the problems to solve and proactively make suggestions on the best way to addressed them (performance, data volume, data discrepancies or mismatches, operational costs, etc.)
• Understanding, having had the experience of working with sales and consumer good analytics the most important metrics and aggregations to provide and the challenges they often have
• Working with and supporting several analytical teams (frontend developers, product owners, QAs, solution architect)

Requirements

• 3+ years of relevant development experience and practice with data management, data storage, data modeling, data analytics, data migration, and database design
• Expert hands-on experience with Databricks
• Expert-level knowledge of SQL
• Experienced with Azure Data Factory
• Production coding experience with Python
• Delta Lake or other similar technology
• Upper-Intermediate level of English, both spoken and written (B2+)

We offer/Benefits

With us you can:

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Relocation opportunities may be available for eligible candidates, depending on the role and openings at other EPAM locations
• Participate in volunteer, charity programs and communities (both technical and interest-based)

We focus on your professional growth:

• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)

What we offer:

• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children

Kindly be advised that the set of benefits, including learning, certification, and other opportunities, may vary depending on the role you apply for. Our recruiter will be able to share more details about the specific opportunity during your general interview.

ABOUT EPAM

EPAM strives to provide its global team of over 62,350 professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.

We are looking for an experienced data engineer with design and

development experience in automating scalable and high-performance data processing systems (batch and/or streaming) on the cloud (AWS preferably).

What You’ll Do

● Design our data models for optimal storage and retrieval on the cloud and to meet critical product and business requirements

● Build scalable and highly-performant distributed data processing systems as we migrate to the cloud

● Work closely with our business stakeholders to flesh out and deliver on requirements in an agile manner

● Set and evolve data standards and best practices

● Contribute to the data architecture and align it with the business and technology

● Adhere to and enforce software development best practices on the cloud in areas including but not limited to CI/CD, code reviews, automated testing, operational excellence, data quality, etc.

What You Should Have

● 4+ years of programming experience in Java/Scala/Python

● 2+ years experience using an enterprise cloud-based solution

● 2+ years implementing data processing pipelines on the cloud (batch and/or streaming)

● Advanced understanding of SQL, relational, and NoSQL databases required

● Experience with various data access patterns, streaming technology, data quality, data modeling, data performance, and cost optimization

Our customer is a leader in global prestige retail, teaching and inspiring clients to play in a world of beauty. The company has earned its reputation all over the world as a beauty trailblazer with its expertise, innovation, and entrepreneurial spirit. Our project is about developing a full-stack e-Commerce application for the world's biggest cosmetics retailer chain of stores.

PROJECT TECHNOLOGIES AND TOOLS

SQL, HIVE

Hadoop

Kafka

Spark

Spark Streaming

Cloud (Azure)

Scala or Python

RESPONSIBILITIES

Investigation and requirements clarification

Solution architecture design from scratch

PoC development

Full project delivery

Interactions with the customer development team and 3-rd party vendor

REQUIREMENTS

5+ years of experience in Java/Scala or Python

Experience with HIVE

Strong communication skills

Intermediate or higher English level, both spoken and written (B1+)

NICE TO HAVE

Databricks

Avro

Spark

Apache Hadoop

WE OFFER

Competitive compensation depending on experience and skills

Individual career path in engineering

Social package - medical insurance, sports

Compensation for sick lists and regular vacations

English classes with certified English teachers

Flexible work hours

We are looking for a Senior / Lead Data Analytics and Visualization Engineer passionate about data to extend our team of professionals. In this role, you will work with clients from various business domains – Finance, Telecom, Media, Insurance, Oil&Gas, Pharma and others.

The remote option applies only to the Candidates who will be working from any location in Ukraine.

Responsibilities

• Build advanced-level dashboards and reports
• Design and build data models, conduct data preparation and profiling
• Perform detailed analysis of business problems and technical environments
• Manage security and administrate the reporting environment
• Participate in architecture and testing processes to ensure they meet best practice specifications
• Participate in architecture and testing processes to ensure they meet best practice specifications

Requirements

• 5+ years of practical experience with one of the reporting tools – Power BI (preferable)
• Proficiency in Data Analytics and Data Visualization concepts
• Skills in developing reports and dashboards
• Advanced SQL knowledge and background in relational databases such as MS SQL Server, Oracle, MySQL, and PostgreSQL
• Understanding of landing, staging area, data cleansing, data profiling, data security and data architecture concepts (DWH, Data Lake, Delta Lake/Lakehouse, Datamart)
• Familiarity with Cloud technologies (AWS, Azure, GCP, Snowflake)
• Expertise in data products testing
• Ability to work in an agile development environment (SCRUM, Kanban)
• Understanding of CI/CD principles and best practices
• English level – Upper-Intermediate and higher

We offer

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Consider relocation options in over 30 countries worldwide
• Participate in volunteer, charity programs and communities (both technical and interest-based)
• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children

EPAM strives to provide its global team of over 52,800+ professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.

We are seeking a skilled Big Data Engineer to become an essential part of this forward-looking and dynamic team.

In this role, you will leverage advanced cloud technologies to deliver impactful solutions.
 

If you excel at tackling complex challenges, creating robust cloud-based solutions, and driving meaningful business outcomes, this opportunity offers the chance to join a fast-paced, collaborative environment where your work shapes global success.

The remote option applies only to the Candidates who will be working from any location in Ukraine.

Responsibilities

• Build scalable, cloud-based systems in Azure using tools like Azure Data Factory, Azure Data Lake Storage, and Databricks to enhance seamless, high-performance data pipelines
• Migrate on-premises MS SQL databases to Azure Data Lake, utilizing the Delta Lake format to optimize operational performance
• Develop interfaces that connect non-Microsoft proprietary applications, enabling interoperability and unlocking valuable data insights
• Provide expertise in Data Lakes, Data Warehouses (DWH), and Delta Lakehouse architectures to guide transformative business solutions
• Assess new feature proposals, prioritize them based on business value, and collaborate to make impactful product development decisions
   

Requirements

• Expertise in Azure Data Services, including Data Factory, Data Lake Storage, and Databricks
• Strong SQL skills with experience in Python, Scala, or C# (versatility is highly valued)
• Background in working with Agile or XP methodologies, thriving in fast-moving, adaptive environments
• Good English communication skills (Upper-Intermediate/B2+ or higher) to engage effectively with diverse teams and stakeholders
   

Nice to have

• Proficiency in advanced Azure tools such as Synapse Analytics, Cosmos DB, or Apache Synapse
• Flexibility to use Core Python or Scala for automation and advanced data processing
   

We offer

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Consider relocation options in over 30 countries worldwide
• Participate in volunteer, charity programs and communities (both technical and interest-based)
• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children
   

EPAM strives to provide its global team of over 52,800+ professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.

Workload — Full-time
Duration — A couple of months to start with, and it has some extension potential.
Location — EU

Working in a staff augmentation model for a US-based AI-native marketing intelligence platform (connected marketing platform).

The client expects a couple of hours of overlap until 11:30 EST (5:30 PM CET). 

Bachelor's degree in Computer Science or related field 5+ years of professional backend software development experience Strong Python development experience Experience building REST APIs using FastAPI, Flask, or similar frameworks Strong understanding of HTTP, REST, authentication, and API design Experience integrating with relational databases and cloud data platforms Experience building secure, scalable backend applications Familiarity with AWS cloud services Experience using Git and modern CI/CD workflows Strong debugging and problem-solving skills Excellent written and verbal communication skills Preferred Qualifications Experience building AI-enabled applications Experience developing platform services or internal developer platforms Familiarity with MCP (Model Context Protocol) or AI tool integration patterns Experience with Snowflake or Databricks Experience working with event-driven architectures Familiarity with Redis or distributed caching Experience integrating with third-party SaaS platforms Experience working in media, advertising, or marketing technology Familiarity with agentic AI development workflows

Primary

Python 

FastAPI 

REST APIs 

PostgreSQL 

Redis 

AWS 

Docker 

Git 

Nice to Have

Snowflake 

Databricks 

OpenAI APIs 

MCP 

LangGraph / LangChain 

Kubernetes 

Terraform

🌍 Adaptiq, on behalf of AppsFlyer, is looking for a Data Engineer

🧩 About AppsFlyer:

AppsFlyer provides a SaaS marketing analytics platform that measures and optimizes marketing activities across mobile, web, CTV, PC, and console applications. AppsFlyer is known for its massive backend production. At any given moment, thousands of servers are consuming 150+ billion mobile app events, crunching our users’ data, serving requests, and communicating on a massive scale.

To maintain the universe we call AppsFlyer, we practice modern production operations with a complete self-serve CI/CD platform, a highly integrated observability stack for our micro-services, backends, and infrastructure, a culture of ownership and eagerness for quality.

The Analytics group is responsible for showing our clients the stories their data is telling. Through complex aggregation, mission-tailored analytical databases, and carefully crafted APIs we are able to provide slice-and-dice analysis in our beautiful dashboards and through the use of external integrations.

🌟 About the Role:

As a Data Engineer within the Analytics group at AppsFlyer, you will own the end-to-end journey of event data - from ingestion and processing to storage, modeling, and API delivery. 

You will design and implement data pipelines using Apache Airflow and Spark, choose and optimize analytical databases, and integrate new components in our hybrid microservices environment. You will collaborate with product managers and cross-functional teams, troubleshoot production incidents, and influence our migration toward Google Cloud and BigQuery. This role offers autonomy over feature design, real impact on a platform handling billions of events daily, and the chance to contribute to open-source projects or speak at industry forums.

📈 Key Responsibilities:

• Develop and maintain data processing pipelines using Apache Airflow, Scala Spark or PySpark.
• Select, model and optimize analytical databases for high-throughput, low-latency queries.
• Design and implement backend services and APIs for data ingestion, aggregation and client consumption.
• Monitor system performance and stability; diagnose and resolve production issues.
• Collaborate with product managers and engineers to plan and deliver complex features.
• Drive migration efforts to Google Cloud Platform, BigQuery and modern data tooling.
• Participate in on-call rotations, alerting via PagerDuty and incident response procedures.
• Document system architecture and data flows; maintain code quality and tests.

💻 Required Competence and Skills:

• 3+ years of software development experience with a focus on data engineering.
• Practical experience with Apache Spark (Scala or PySpark) and Apache Airflow.
• Experience building and maintaining high-throughput, low-latency distributed data systems.
• Strong SQL skills and experience with data modeling for analytics workloads.
• Familiarity with JVM languages (Scala, Java, Clojure) or Python for backend development.
• Experience with cloud platforms - preferably GCP - and data warehouses such as BigQuery.
• Proven ownership of production systems and on-call incident management.
• Excellent communication skills in English for distributed teamwork.
• B.Sc. in Computer Science or equivalent practical experience.

➕ Nice to Have:

• Production experience with large-scale databases and ETL tooling.
• Hands-on background in Go or Clojure backend services.
• Experience with production-grade BigQuery ETL and data pipelines.
• Contribution to open-source projects or public speaking at meetups/conferences.
• An “AI mindset” - familiarity with tools like GitHub Copilot and emerging AI workflows.

🚀 Benefits Package includes:

• Health Insurance
• Paid Unlimited Vacation Days + all national holidays + additional recharge days
• Meals Reimbursement
• Sport Reimbursement
• Breakfast in the office
• Mental health program
• Team building, happy hours, and other team activities
• Paid sick days
• Snacks, fruits & ice-cold beer
• All new team members are provided with a brand-new Mac laptop with 2 monitors and a Starter package

Our Customer:

Our customer is an international technology company developing a security-focused enterprise platform used by organizations with high requirements for device protection and user authentication. As part of its product ecosystem, the company is building a desktop application for macOS that integrates deeply with operating system capabilities to deliver secure authentication, device management, and identity-related functionality.

Your Tasks:

• Design, develop, and maintain low-level macOS application components that interact with system frameworks and operating system services.
• Build and enhance integrations with macOS security, authentication, and credential management capabilities.
• Ensure compatibility with new macOS releases by evaluating platform changes, API updates, and system behavior across OS versions.
• Research and implement modern Apple platform capabilities related to identity, authentication, and device security.
• Develop reliable background services, inter-process communication mechanisms, and secure application workflows.
• Improve software quality through secure build and release processes, diagnostics, logging, and issue investigation.
• Troubleshoot complex platform-specific issues and collaborate with cross-functional teams to deliver robust solutions.
• Contribute to technical design discussions and continuously improve the architecture of macOS platform components.

Required Experience and Skills:

• 8+ years of commercial software development experience.
• At least 4 years of hands-on experience developing applications for macOS with a strong focus on system-level functionality.
• Strong proficiency with Swift and/or Objective-C.
• Along with practical experience using C/C++.
• Solid experience working with macOS system frameworks, background services, inter-process communication, security mechanisms,
• and application permissions.
• Good understanding of Unix/Linux operating system concepts, including processes, permissions, IPC, and system services.
• Experience building security-sensitive software, including secure data storage, authentication flows, and cryptographic principles.
• Strong debugging and troubleshooting skills, particularly for platform-level issues and complex system interactions.
• Ability to independently drive technical investigations and deliver solutions for complex engineering challenges.
• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related technical field.
• English level Upper-Intermediate or higher.

Would Be a Plus:

• Experience with identity and access management technologies or enterprise authentication solutions.
• Familiarity with modern authentication standards and security protocols.
• Experience integrating applications with enterprise device management solutions.
• Knowledge of macOS endpoint security technologies or other advanced Apple platform capabilities.
• Previous experience working on enterprise desktop software deployed at scale.
• Exposure to low-level operating system development or performance optimization.

Are you passionate about building cutting-edge, AI-ready data platforms from the ground up? We are looking for a Senior Data Engineer to join our Data Engineering Team and lead high-impact, greenfield initiatives.

You will work on building modern cloud-native data platforms, migrating on-premises legacy systems to the cloud, and laying the architectural foundation for AI-ready data infrastructure.

In this role, you will collaborate closely with Machine Learning, Data Science, and Product teams, serving as a key technical contributor and thought leader. You will also drive R&D efforts around agentic AI architectures, event-driven systems, and LLM-ready data pipelines — turning architectural concepts into production-grade solutions.

Responsibilities:

• Design and build scalable, cloud-native data platforms from greenfield to production
• Implement near-real-time ingestion pipelines using event-driven patterns
• Define and enforce platform standards, including Data Lake / Lakehouse principles, medallion architecture, and data contracts
• Refactor and optimise existing Spark and PySpark scripts for performance and maintainability
• Introduce best practices for code quality, testing, and CI/CD across data pipelines
• Drive adoption of AI tooling and agentic workflows within the data engineering team
• Ensure data quality, observability, and reliability across all pipelines and platforms

• Develop self-service tooling and microservices to simplify platform usage for other teams

   

Requirements:

• 5+ years of professional experience in Data Engineering
• Strong Python and SQL development skills for pipeline development and optimisation
• Proficiency in Apache Spark / PySpark, including query optimisation and performance tuning
• Hands-on experience with Databricks 
• Experience with at least one major cloud provider: Azure (preferred), AWS, or GCP
• Experience with stream processing technologies (Kafka, Spark Structured Streaming)
• Solid understanding of ETL/ELT patterns, data modelling (dimensional, Data Vault), and data warehousing
• Experience with orchestration tools (Apache Airflow, Azure Data Factory, or equivalent)
• Knowledge of Infrastructure as Code (Terraform or equivalent)
• Understanding of production-grade system requirements: reliability, scalability, observability, and performance

• Upper-Intermediate English level

   

Will be a plus

• Familiarity with RAG pipeline design and LLM integration patterns
• Knowledge of data governance frameworks and tools (Unity Catalog, Apache Atlas, or similar)
• Experience with dbt for data transformation and modelling

• Familiarity with MLflow, Feature Stores, or ML platform integration

   

Personal profile

• Self-driven and proactive in identifying improvements
• Comfortable working in a fast-paced, innovative environment
• Strong problem-solving mindset with attention to detail
• Open to experimenting with emerging technologies and approaches

_____________________________________________________________

Ти захоплюєшся створенням передових, AI-ready дата-платформ з нуля? Ми шукаємо Senior Data Engineer, щоб ти приєднався(-лася) до нашої команди Data Engineering та очолив(-ла) масштабні, інноваційні ініціативи з нуля.

Ти працюватимеш над побудовою сучасних хмарних дата-платформ, міграцією локальних (on-premises) легасі-систем у хмару та створенням архітектурного фундаменту для AI-ready дата-інфраструктури.

У цій ролі ти тісно співпрацюватимеш з командами Machine Learning, Data Science та Product, виступаючи ключовим технічним експертом та лідером думок. Також ти вестимеш R&D-роботи над agentic AI-архітектурами, подієво-орієнтованими системами та LLM-ready дата-пайплайнами — перетворюючи архітектурні концепції на готові до продакшену рішення.

Обовʼязки:

• Проєктувати та створювати масштабовані, хмарні дата-платформи від концепції до продакшену
• Реалізовувати пайплайни для майже реального часу (near-real-time ingestion) з використанням подієво-орієнтованих патернів
• Визначати та впроваджувати стандарти платформи, включно з принципами Data Lake / Lakehouse, медальйонною архітектурою та дата-контрактами
• Рефакторити та оптимізувати наявні скрипти на Spark та PySpark для підвищення продуктивності та зручності підтримки
• Запроваджувати найкращі практики якості коду, тестування та CI/CD для дата-пайплайнів
• Сприяти впровадженню AI-інструментів та agentic-підходів у команді дата-інженерів
• Забезпечувати якість, спостережуваність (observability) та надійність усіх пайплайнів і платформ

• Розробляти self-service інструменти та мікросервіси, що спрощують використання платформи іншими командами

   

Вимоги:

• 5+ років комерційного досвіду в Data Engineering
• Сильні навички розробки на Python та SQL для створення та оптимізації пайплайнів
• Впевнене володіння Apache Spark / PySpark, включно з оптимізацією запитів та налаштуванням продуктивності
• Практичний досвід роботи з Databricks (бажано) 
• Досвід роботи з принаймні одним великим хмарним провайдером: Azure (бажано), AWS або GCP
• Досвід роботи з технологіями потокової обробки даних (Kafka, Spark Structured Streaming)
• Глибоке розуміння ETL/ELT-патернів, моделювання даних (dimensional, Data Vault) та побудови дата-складів
• Досвід роботи з інструментами оркестрації (Apache Airflow, Azure Data Factory або аналогами)
• Знання Infrastructure as Code (Terraform або аналогів)
• Розуміння вимог до продакшен-рішень: надійність, масштабованість, спостережуваність, продуктивність

• Рівень англійської — Upper-Intermediate

   

Буде плюсом:

• Знайомство з проєктуванням RAG-пайплайнів та патернами інтеграції LLM
• Знання фреймворків і інструментів для data governance (Unity Catalog, Apache Atlas або подібних)
• Досвід роботи з dbt для трансформації та моделювання даних

• Знайомство з MLflow, Feature Stores або інтеграцією з ML-платформами

   

Особистий профіль:

• Самомотивованість та проактивність у пошуку покращень
• Комфортна робота у швидкому та інноваційному середовищі
• Сильне аналітичне мислення та увага до деталей
• Відкритість до експериментів з новими технологіями та підходами

About the role:

The role will involve designing, developing, maintaining, and improving the company's data warehouse, data pipelines, and analytical data models. You will work with high-volume event data from multiple internal and external sources - supporting a growing analytical layer used for operational monitoring and business analytics.

This is not only a maintenance role. We are looking for someone who can take ownership of data solutions end to end, improve data reliability, optimize data flows, support scalable data modeling, and proactively introduce better practices in data engineering, data quality, and data warehousing.

Requirements:
 

• 4+ years of experience as a Data Engineer, Analytics Engineer, BI Engineer, or similar role.
• Advanced SQL skills and strong experience working with large datasets.
• Strong experience with BigQuery or similar cloud data warehouses; experience with Google Cloud 
• Experience designing, building, and maintaining scalable ETL / ELT pipelines.
• Experience with dbt or a similar data transformation framework.
• Experience with orchestration tools such as Apache Airflow, Prefect, Dagster, or similar.
• Experience building data quality checks, validation rules, monitoring, and troubleshooting processes.
• Experience optimizing data processing, query performance, and warehouse costs.
• Ability to identify root causes of data issues and propose practical, scalable improvements.
• Ability to create and maintain documentation for data flows, models, dependencies, and known limitations.
• Strong end-to-end ownership of data solutions.
• Ability to translate analytical and business needs into reliable technical data solutions.
• Detail-oriented mindset and high standards for data reliability.
• English level B1-B2 or higher.

Nice to have

• Experience integrating and maintaining data from third-party platforms such as marketing systems, CRM tools, tracking platforms, or attribution systems.
• Familiarity with BI/reporting environments such as Looker Studio/Tableau/Power BI or similar.
• Experience designing or maintaining pipelines for high-volume event-level data, logs, or time-series datasets.
• Experience with Git and version control for data pipelines, SQL models, or data projects.
• Experience with Python

Responsibilities:

• Design, develop, maintain, and improve scalable data warehouse solutions and ETL / ELT pipelines.
• Work with high-volume data from APIs, third-party platforms, event data, manual imports, and internal sources.
• Ensure key analytical datasets are updated correctly, on time, and with clear ownership.
• Improve pipeline reliability, monitoring, error handling, query performance, and warehouse costs.
• Build and maintain data quality checks, validation rules, and monitoring processes.
• Detect and investigate missing, duplicated, delayed, inconsistent, or incorrect data.
• Identify root causes of data issues and implement controls to prevent recurring problems.
• Ensure data is reliable, consistent, complete, and ready for reporting and analytics.
• Define and apply standards for table structure, naming conventions, joins, keys, metric logic, and documentation.
• Support clear data layers: raw, staging, analytical, and business-ready datasets.
• Standardize similar datasets and reduce duplicated or inconsistent transformation logic.
• Work closely with Business Analytics to understand analytical needs and data blockers.
• Translate analytical and business requirements into technical data structures and pipeline improvements.
• Support BI and reporting needs by ensuring datasets are reliable, consistent, and well-documented.
• Share best practices, provide technical guidance, and proactively introduce improvements in data engineering and warehousing.

What it means to be part of our Team:
 

• Multinational and intercultural experience
• Corporate library
• A world-class team to work with
• Growth opportunities
• Cutting-edge frameworks and technologies
• Competitive salary
• Plenty of engaging team-building and social events
• Bonuses according to the policy
• 21 paid vacation days & 14 paid sick leaves;
• Cozy office in Warsaw, Kyiv available for you whenever you need it
• Coffee, tea, Red Bull, sweets, fruits, and more snacks

💌 Interested?

We’re always on the lookout for passionate, driven, and curious people to join our team.If that sounds like you — we’d love to hear from you!