Jobs Data Engineer

🚀 Lead Data Engineer (EU)

We’re looking for a Lead Data Engineer to join a high-impact data transformation initiative focused on modernizing data pipelines and enabling scalable, future-ready data architecture.

This role is ideal for someone who enjoys working на стику data engineering, architecture, and cross-team collaboration, and хоче впливати на стратегічні рішення у data ecosystem.

🌍 About the Project

You will be part of a large-scale initiative aimed at transforming how data is ingested, processed, and consumed across the organization.

The key focus is on migrating and optimizing data flows, ensuring seamless integration with modern platforms such as Databricks Unity Catalog, and enabling more efficient and scalable data consumption.

🧩 Key Responsibilities

• Analyze existing data pipelines and codebase to identify data entry points
• Design and execute data source migration strategies (source-to-target mapping, adapters development)
• Redesign data consumption processes to support integration with Databricks Unity Catalog
• Collaborate closely with cross-functional teams (data foundation & product teams)
• Ensure smooth transition and alignment across systems, including permissions and dependencies
• Drive best practices in data engineering and contribute to architectural improvements

🛠️ Tech Stack

• Python / Spark / SQL
• Azure Data Factory
• Apache Airflow
• Databricks ecosystem (Unity Catalog)

Project description:
The goal of the project is to onboard the commercial data into EDF and deliver the reporting platform through PowerBI on top of Golden Layer built by GD (Medallion architecture).

Client description:
It is a global food and beverage leader with a product portfolio including 22 brands that generate more than $1 billion each in annual retail sales.

We're looking for a Data Engineer to:
Design and implement scalable data pipelines using Azure Data Factory and Databricks (PySpark).
Develop the Gold layer (semantic layer) for accurate business reporting.
Utilize Azure DevOps for CI/CD and implement observability to ensure data integrity.

Required Technology Stack:
Cloud: Azure
Processing: Databricks, PySpark
Storage: ADLS, Delta Lake
Orchestration: Azure Data Factory (ADF)
DevOps: Azure DevOps
Reporting: Power BI
Concepts: Medallion Architecture, Observability

Duration: 3–5 months
Location: Armenia, Ukraine, Poland, Estonia
 

Responsibilities:

• Shape and contribute to Cargoo’s data engineering strategy, including the design, architecture, and implementation of scalable data solutions
• Build, maintain, and evolve the Data Platform to support advanced analytics, machine learning, and real-time decision-making
• Collaborate closely with AI engineers, BI analysts, and business stakeholders to translate data needs into robust technical solutions
• Identify data opportunities across the organization and enable teams to extract maximum value from data assets
• Design and implement ETL/ELT pipelines, including batch and streaming data workflows
• Develop and maintain data models using dimensional and advanced modeling techniques
• Support deployment, monitoring, and lifecycle management of data applications
• Apply DataOps best practices to ensure reliability, scalability, and quality of data pipelines
• Participate in code reviews and promote high engineering standards
• Take ownership of projects end-to-end, ensuring timely delivery and measurable impact
   

Requirements:

• Solid proficiency in Python (runtime environment, package management) and SQL (DML, DDL)
• Hands-on experience with SQL Server / Azure SQL Server
• Experience working with cloud platforms, preferably Microsoft Azure
• Familiarity with the modern data stack, including tools such as dbt and orchestration frameworks (Airflow, Dagster, or similar)
• Strong understanding of ETL/ELT concepts, data architecture, and data modeling
• Experience with streaming technologies (Kafka or equivalent)
• Experience with Docker and container orchestration technologies
• Experience deploying and monitoring applications on Kubernetes (K8s)
• Knowledge of application lifecycle management
• Understanding and application of DataOps practices
• Strong project management, execution skills, and a clear sense of ownership and accountability

Project Overview

The company helps hotel chains like Hilton and Marriott transform front-desk staff into revenue generators through upselling training and analytics. Their IN-Gauge SaaS platform empowers frontline teams across 2,000+ properties in over 100 countries.

Responsibilities

- Implement scaling of the case detection process (scanner)

- Split API into multiple API services

- Emulate pubsub/cloud run locally

- Implement scaling of the case detection process (scanner)

- Split API into multiple API services

- Emulate pubsub/cloud run locally

- Extract & process data using PySpark + S3 (Kafka/Kinesis — bonus)

- Write & optimize SQL on PostgreSQL/Redshift; use DynamoDB as data source/sink

- Run and debug ETL jobs on Glue or EMR; monitor via console/Spark UI

Requirements (Must-have)

Data engineering - 5 years,

AWS - 3 years (1 year latest project),

Spark/PySpark - 2 years (1 year latest project)

Nice to Have

GCP (pubsub/Cloud Run)

Hiring Process

Intro call

Technical discussion (focused on real experience)

Offer

Start: ASAP

Description

Client is a luxury skincare and beauty brand. The brand is based in San Francisco and sells luxury skincare products worldwide.

Tatcha’s main IT “product” is its e-commerce website, which functions as a digital platform to sell products, educate customers, and personalize experiences.

• Runs on Salesforce Commerce Cloud (formerly Demandware) — an enterprise e-commerce platform that supports online shopping, order processing, customer accounts, and product catalogs.
• Hosted on cloud infrastructure (e.g., AWS, Cloudflare) for reliable performance and security
  Uses HTTPS/SSL encryption to secure data transfers.
• Integrated marketing and analytics technologies such as Klaviyo (email & SMS automation), Google Tag Manager, and personalization tools to track behavior, optimize campaigns, and increase conversions

It’s both a shopping platform and a digital touchpoint for customers worldwide.

Requirements

• 6+ years of experience as a Data Engineer, Analytics Engineer, or in a similar data-focused role.
• Strong SQL skills for complex data transformations and analytics-ready datasets.
• Hands-on experience with Python for data pipelines, automation, and data processing.
• Experience working with cloud-based data platforms (AWS preferred).
• Solid understanding of data warehousing concepts (fact/dimension modeling, star schemas).
• Experience building and maintaining ETL/ELT pipelines from multiple data sources.
• Familiarity with data quality, monitoring, and validation practices.
• Experience handling customer, transactional, and behavioral data in a digital or e-commerce environment.
• Ability to work with cross-functional stakeholders (Marketing, Product, Analytics, Engineering).

Nice to have:

• Experience with Snowflake, Redshift, or BigQuery.
• Experience with dbt or similar data transformation frameworks.
• Familiarity with Airflow or other orchestration tools.
• Experience with marketing and CRM data (e.g. Klaviyo, GA4, attribution tools).
• Exposure to A/B testing and experimentation data.
• Understanding of privacy and compliance (GDPR, CCPA).
• Experience in consumer, retail, or luxury brands.
• Knowledge of event tracking and analytics instrumentation.
• Ability to travel + visa to the USA
•  

Job responsibilities

• Design, build, and maintain scalable data pipelines ingesting data from multiple sources:
  e-commerce platform (e.g. Salesforce Commerce Cloud), CRM/marketing tools (Klaviyo), web analytics, fulfillment and logistics systems.
• Ensure reliable, near-real-time data ingestion for customer behavior, orders, inventory, and marketing performance.
• Develop and optimize ETL/ELT workflows using cloud-native tools.
• Model and maintain customer, order, product, and session-level datasets to support analytics and personalization use cases.
• Enable 360° customer view by unifying data from website interactions, email/SMS campaigns, purchases, and returns.
• Support data needs for personalization tools (e.g. product recommendation quizzes, ritual finders).
• Build datasets that power marketing attribution, funnel analysis, cohort analysis, and LTV calculations.
• Enable data access for growth, marketing, and CRM teams to optimize campaign targeting and personalization
• Ensure accurate tracking and validation of events, conversions, and user journeys across channels.
• Work closely with Product, E-commerce, Marketing, Operations, and Engineering teams to translate business needs into data solutions.
• Support experimentation initiatives (A/B testing, new digital experiences, virtual stores).
• Act as a data partner in decision-making for growth, CX, and operational efficiency.
• Build and manage data solutions on cloud infrastructure (e.g. AWS).
• Optimize storage and compute costs while maintaining performance and scalability.

What we offer

Culture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders. 

Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.

Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.

Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

• We are seeking a skilled, hands-on Data Engineer with demonstrated experience in Databricks, Apache Spark, Python, and real-time data streaming solutions with experience in healthcare domain.

   

• Responsibilities:

  - Implement resource composition logic provided by the Product team into scalable and efficient PySpark code.
  - Develop, optimize, and maintain PySpark applications within the Databricks environment.
  - Utilize and maintain existing CI/CD pipelines in Databricks for automated build, testing, and deployment.
  - Write and maintain unit tests to ensure high code quality and reliability.
  - Perform data validation and quality checks to ensure compliance with defined business rules
  - Support and manage production deployments, ensuring system stability and performance.
  - Troubleshoot and resolve issues across development, testing, and production environments.
  - Collaborate with Product, QA, DevOps, and healthcare domain teams to ensure accurate implementation.
  - Maintain technical documentation for code, workflows, and deployment processes.
  - Pull from and push code to GitHub repositories, following version control and branching best practices.

   

• Mandatory Skills Description:

  - 5+ years of experience in data engineering roles
  - Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
  - 4+ years of experience with Databricks data pipelines
  - Strong hands-on experience with PySpark and/or Apache Spark.
  - Experience working with CI/CD pipelines and DevOps best practices.
  - Proficiency with CI/CD, GitHub (pull requests, branching, code reviews).
  - Experience writing unit tests and performing data validation
  - Experience supporting production systems and deployments
  - Strong analytical and troubleshooting skills.

   

• Nice-to-Have Skills Description:

  - Knowledge of FHIR (Fast Healthcare Interoperability Resources) standards.
  - Experience with healthcare data integration projects.
  - Familiarity with REST APIs and FHIR server integrations.
  - Experience in Agile/Scrum development environments.

   

• Languages:
  • English: C1 Advanced

At TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking a Data Engineer – Web Scraping & ETL to join one of our clients' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.

Location: Remote
Reports To: Senior ETL Specialist
Employment Type: Full-Time Employee
Working Hours: European timezone with some overlap to USA
 

Role Overview
We are looking for an ETL / Data Pipeline Engineer to join our data infrastructure team. This role operates primarily within a European timezone, with some overlap with US Central Time to support collaboration with our Houston-based team. You will help manage and monitor our existing fleet of web scrapers, build new data collection pipelines for regulatory and energy market sources, and contribute to the broader evolution of our ETL architecture.

Key Responsibilities
Overnight Operations & Data Quality
• Monitor and manage overnight scraper and ingestion runs, triaging failures and applying fixes in real time to minimize data gaps before US market open
• Verify data completeness and quality across all automated feeds, flagging anomalies and coordinating with the Houston team on persistent issues
• Maintain run logs, error documentation, and escalation notes for seamless async handoffs
New & Expanded Data Collection
Build and maintain scrapers, parsers, and ingestion pipelines across a growing set of energy market data domains, including but not limited to:
• Pipeline operator portals, electronic bulletin boards, and related filings (notices, maintenance, capacity, gas quality, customer indices)
• Government and regulatory agency databases at the federal, state, and provincial level across North America
• International energy data sources covering European, Canadian, and Mexican supply, demand, and power markets
• Emissions and environmental reporting systems
• Financial and corporate filings, including public company disclosures and production reporting
• Geospatial and mapping data related to production, infrastructure, and market geography
ETL Architecture & Enhancement
• Contribute to the design and build-out of our broader ETL infrastructure, including scheduling, orchestration, and error handling
• Write transformation logic to clean, normalize, and load raw data into PostgreSQL staging and production tables
• Optimize existing pipelines for performance, reliability, and cost efficiency
• Help build monitoring dashboards and alerting for pipeline health and data freshness
• Document data lineage, schema changes, and pipeline dependencies
Technical Environment
• Languages: Python (primary), SQL, Bash scripting
• Database: PostgreSQL, Mongo and Snowflake
• Infrastructure: AWS (EC2, S3, Lambda), Docker
• Scraping: Selenium, Playwright, BeautifulSoup, Scrapy, or similar frameworks
• Orchestration: cron, Airflow, or equivalent scheduling tools
• Version Control: Git / GitHub
• Communication: Slack, with async handoffs to US-based team

Required Qualifications
• 3+ years of experience building and maintaining ETL pipelines or data engineering systems
• Strong Python skills with experience in web scraping, data parsing, and automation
• Proficiency in SQL and experience working with relational databases (PostgreSQL preferred)
• Experience with headless browsers, anti-bot mitigation, and scraping resilience patterns
• Strong debugging instincts and ability to triage pipeline failures quickly
• Clear written communication in English for async collaboration and documentation
Preferred Qualifications
• Experience with energy, commodities, or financial data pipelines
• Familiarity with FERC-regulated pipeline data, EIA reporting, or utility/regulatory filings
• Experience with PostgreSQL-specific features (partitioning, materialized views, JSONB, pg_cron, logical replication)
• Familiarity with infrastructure-as-code (Terraform, CloudFormation) or containerized deployments
• Prior experience working on a distributed team across time zones
What We Offer
• Competitive compensation and benefits with room to grow as the team scales
• Direct impact on the data infrastructure behind a leading natural gas intelligence platform
• A small, senior team where your work is visible and valued from day one
• Flexible remote work with clear async workflows
• Exposure to the North American energy markets and commodity data at scale

N-iX is looking a proactive Data Engineer to join our vibrant team.

As a Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.

Key Responsibilities:

• Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
• Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development.
• Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
• Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency. 
• Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.
• Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.

Tools and skills you will use in this role:

• Palantir Foundry
• Python
• PySpark
• SQL
• TypeScript

Requirements:

• 5+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry;
• Strong proficiency in Python and PySpark;
• Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.);
• Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow);
• Expertise in data modeling, data warehousing, and ETL/ELT concepts;
• Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.);
• Proficiency in containerization technologies (e.g., Docker, Kubernetes);
• Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities;
• Strong communication and teamwork abilities;
• Understanding of data security and privacy best practices;
• Strong mathematical, statistical, and algorithmic skills.

Nice to have:

• Certification in Cloud platforms, or related areas;
• Experience with search engine Apache Lucene, Webservice Rest API;
• Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry;
• Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous;
• Previous experience working with JavaScript and TypeScript.

We offer*:

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

*not applicable for freelancers

Quantum is a global technology partner delivering high-end software products that address real-world problems. 

We advance emerging technologies for outside-the-box solutions. We focus on Machine Learning, Computer Vision, Deep Learning, GIS, MLOps, Blockchain, and more.

Here at Quantum, we are dedicated to creating state-of-the-art solutions that effectively address the pressing issues faced by businesses and the world. To date, our team of exceptional people has already helped many organizations globally attain technological leadership.

We constantly discover new ways to solve never-ending business challenges by adopting new technologies, even when there isn’t yet a best practice. If you share our passion for problem-solving and making an impact, join us and enjoy getting to know our wealth of experience!

About the position

Quantum is expanding the team and has brilliant opportunities for a proactive Senior Data Engineer who can design, implement, and evolve scalable data systems in AWS. We are building a greenfield analytics platform supporting both batch and real-time data processing. This role is a strategic blend of hands-on development, high-level architectural decision-making, and end-to-end platform ownership.

The client is a technological research company that utilizes proprietary AI-based analysis and language models to provide comprehensive insights into global stocks in all languages. Our mission is to bridge the knowledge gap in the investment world and empower investors of all types to become “super-investors.”

Through our generative AI technology implemented into brokerage platforms and other financial institutions’ infrastructures, we offer instant fundamental analyses of global stocks alongside bespoke investment strategies, enabling informed investment decisions for millions of investors worldwide.

Must have skills:

• 5+ years of experience in Data Engineering
• Strong hands-on experience with Apache Spark (including Structured Streaming)
• Experience building both batch and streaming pipelines in production environments
• Proven experience designing AWS-based data lake architectures (S3, EMR, Glue, Athena)
• Experience with event streaming platforms such as Apache Kafka or Amazon Kinesis
• Experience implementing lakehouse formats such as Delta Lake
• Strong understanding of partitioning strategies and schema evolution
• Experience using SparkUI and AWS CloudWatch for profiling and optimization
• Strong understanding of Spark performance tuning (shuffle, skew, memory, partitioning)
• Proven track record of cost optimization in AWS environments
• Experience with Docker and CI/CD pipelines
• Experience with Infrastructure as Code (Terraform, AWS CDK, or similar)
• Familiarity with monitoring and observability practices
• Upper-Intermediate or higher English proficiency (spoken and written)

Would be a plus:

• Experience in the financial domain
• Experience running Spark workloads on Kubernetes
• Exposure to or interest in Large Language Models (LLMs) and AI integration
• Experience implementing data quality frameworks or metadata/lineage systems

Your tasks will include:

• Design and implement batch and streaming data pipelines using Apache Spark
• Build and evolve a scalable AWS-based data lake architecture
• Develop and maintain real-time data processing systems (event-driven pipelines)
• Own performance tuning and cost optimization of Spark workloads
• Define best practices for data modeling, partitioning, and schema evolution
• Implement monitoring, observability, and data quality controls
• Contribute to infrastructure automation and CI/CD for data workflows

• Participate in architectural decisions and mentor other engineers

   

We offer:

• Delivering high-end software projects that address real-world problems
• Surrounding experts who are ready to move forward professionally
• Professional growth plan and team leader support
• Taking ownership of R&D and socially significant projects
• Participation in worldwide tech conferences and competitions
• Taking part in regular educational activities
• Being a part of a multicultural company with a fun and lighthearted atmosphere
• Working from anywhere with flexible working hours

• Paid vacation and sick leave days

   

Join Quantum and take a step toward your data-driven future.

We are seeking a skilled, hands-on Data Engineer with demonstrated experience in Databricks, Apache Spark, Python, and real-time data streaming solutions.

Responsibilities

Implement resource composition logic provided by the Product team into scalable and efficient PySpark code.

Develop, optimize, and maintain PySpark applications within the Databricks environment.

Utilize and maintain existing CI/CD pipelines in Databricks for automated build, testing, and deployment.

Write and maintain unit tests to ensure high code quality and reliability.

Perform data validation and quality checks to ensure compliance with defined business rules

Support and manage production deployments, ensuring system stability and performance.

Troubleshoot and resolve issues across development, testing, and production environments.

Collaborate with Product, QA, DevOps, and healthcare domain teams to ensure accurate implementation.

Maintain technical documentation for code, workflows, and deployment processes.

Pull from and push code to GitHub repositories, following version control and branching best practices.

Skills

Must have

5+ years of experience in data engineering roles

Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).

4+ years of experience with Databricks data pipelines

Strong hands-on experience with PySpark and/or Apache Spark.

Experience working with CI/CD pipelines and DevOps best practices.

Proficiency with CI/CD, GitHub (pull requests, branching, code reviews).

Experience writing unit tests and performing data validation

Experience supporting production systems and deployments

Strong analytical and troubleshooting skills.

Nice to have

Knowledge of FHIR (Fast Healthcare Interoperability Resources) standards.

Experience with healthcare data integration projects.

Familiarity with REST APIs and FHIR server integrations.

Experience in Agile/Scrum development environments.

Digis is looking for a Senior Data Engineer to join our long-term partnership with a US-based global leader in hospitality analytics.

About the Project

Our client is a premier SaaS provider that transforms front-desk staff into revenue generators for the world’s most iconic hotel brands, including Hilton and Marriott. Their platform operates in over 2,000 properties across 124 countries, managing billions in revenue.

The project is in an active development stage, focusing on processing massive data volumes to deliver real-time business value.
You will join a large, distributed team (approx. 50 people) and collaborate directly with the US-based CTO.

Your Responsibilities
 

• Manage data pipelines from ingestion to ready-to-use analytical models.
• Help scale case detection processes and improve existing services by splitting them into smaller microservices.
• Build, debug, and optimize ETL jobs using AWS Glue, EMR, and Spark.
• Write and improve SQL queries for PostgreSQL/Redshift, and work with DynamoDB where needed.
• Support workflows in AWS ECS Fargate and set up local environments for testing and deployment.
   

Requirements
 

• 5+ years of experience as a Data Engineer.
• 2+ years of hands-on production experience with Spark or PySpark.
• 3+ years of experience with the AWS ecosystem (specifically Glue, EMR, S3, and Redshift).
• English: High level (Upper-Intermediate/Advanced) for frequent technical meetings and direct collaboration with the US CTO.

We Offer
 

• 20 paid vacation days per year
• 5 paid sick leaves per year (no medical documents required)
• Personalized development plan with training compensation
• English courses compensation
• Work equipment if needed (PC / laptop / monitor)
• Opportunity to switch between projects and technologies within Digis
• Full accounting and legal support

Looking for Backend with #Python #Machine learning #AWS stack

We are looking for a Senior Data Engineer to build and scale a modern, AWS-based data platform powered by serverless pipelines, DuckDB, and Delta Lake architecture. You will work on integrating multiple SaaS and operational data sources into a robust data warehouse used for analytics and Tableau reporting. This role requires a hands-on engineer comfortable with Python-based data processing, AWS services, and non-traditional data stack components (DuckDB, Polars, etc.).

Seniority: Senior
English: Upper
Start date: April 4, 2026
Duration: 1-3 month

We are looking for a Data Engineer to design and implement scalable data pipelines that support Generative AI applications. You will work with large-scale datasets, optimize performance, and ensure seamless data integration across AI workflows.

Responsibilities:

• Design and develop scalable data pipelines to support AI/ML models.
• Work with structured and unstructured data for training and inference.
• Optimize ETL workflows for real-time and batch processing.
• Ensure data quality, governance, and security in cloud environments.
• Collaborate with AI/ML engineers to streamline data workflows.

• Deploy and manage data infrastructure on AWS, GCP, or Azure.

   

Requirements:

• 3+ years of experience in Data Engineering and Big Data technologies.
• Expertise in ETL pipelines, data warehousing, and distributed computing.
• Strong knowledge of SQL, NoSQL, and data lakes.
• Experience with cloud-based data services (AWS Glue, BigQuery, Azure Data Factory).
• Proficiency in Python, Spark, Kafka, Airflow.

• Experience with CI/CD, DevOps, and Agile methodologies.

   

  What We Offer: 

  🚀 A role with real ownership and influence on delivery

  🌍 International eCommerce projects with global clients

  📈 Transparent growth path toward Middle+ → Senior PM

  🎓 Company-supported learning & certification programs

  🏠 Fully remote work with a flexible schedule

  🏝 Paid vacation & sick leave

  💰 Competitive compensation

  🔎 Mature processes and open team culture

We are looking for an experienced Data Engineer to design and implement scalable data pipelines, own core storage layers, and help build the foundations of a modern DataOps lifecycle.
 

Job requirements

• 3+ years of professional experience in Data Engineering / DWH development.
• Strong SQL expertise and solid Python skills (pandas, pyarrow).
• Production experience with Apache Airflow (production DAGs, scheduling, operators).
• Hands‑on work with PostgreSQL (schema design, migrations, partitioning) and ClickHouse (MergeTree engines, materialized views, performance tuning). 
• Experience with Data warehouse design — layered architecture, data modelling, denormalisation.
• Experience integrating REST APIs and third-party data sources
• Experience with Docker / Docker Compose — containerised services and multi-service environments
• Fluency in English.

Nice to Have:

• Experience with Apache Superset (RLS, dashboard layer).
• Familiarity with AI/LLM tooling for data (NL-to-SQL, vector databases). 
• Experience in the Fintech field: FX, brokerage, CRM/BO systems.
• Experience with multi-tenant data architectures.

Job responsibilities

• Design, build, and maintain ETL/ELT pipelines rom multiple product datasources.
• Model and optimise data structures in ClickHouse (views, engines, schema evolution).
• Orchestrate workflows using Apache AirflowCollaborate with BI teams (Superset) and backend teams (FastAPI/Python) to build reliable data products.
• Contribute to architectural decisions.
• Collaborate closely with product managers, BI developers, and DevOps to deliver data products end‑to‑end.

Job benefits

● Competitive and Attractive Pay.
● Flexible hours for a better work-life balance.
● Work your way: Hybrid flexibility to fit your life.
● 21 vacation + 7 no-questions-asked sick days per year.
● Career growth: Continuous Development & Performance Reviews.
 

Our customer is one of the world's largest food and beverage companies, operating in 189 countries with over 2000 brands. The company's diverse portfolio includes products such as bottled water, dairy products, breakfast cereals, coffee, confectionery, frozen food, pet foods, snacks, and baby food.

We are looking for a Middle Data Engineer to design, build, and maintain scalable data systems that support analytics, reporting, and machine learning use cases. This role requires strong ownership, solid SQL skills, and experience working with large datasets in production environments.

Responsibilities

• Build and maintain data pipelines (batch and near real-time).
• Develop and optimize data models for analytics and BI tools.
• Write efficient SQL queries for large-scale datasets.
• Support development and maintenance of ETL/ELT processes.
• Ensure data quality, integrity, and consistency across systems.
• Collaborate with data analysts, data scientists, and product teams to understand data requirements.
• Monitor and troubleshoot data pipelines and workflows.
• Contribute to improving the performance of the existing data infrastructure.
• Work with cloud-based data platforms and modern data stack tools.

Requirements

• 2–4 years of experience in Data Engineering or a related role.
• Main technical skills are: Snowflake, dbt, ADF.
• Solid SQL skills (joins, aggregations, window functions).
• Understanding of data governance and data quality concepts.
• Proficiency in Python.
• Experience with ETL/ELT tools.
• Hands-on experience with the Azure cloud platform.
• Azure Ops experience: provisioning and configuring.
• Experience working with data warehouses (e.g., Snowflake, BigQuery, Redshift).
• Understanding of data modeling concepts (e.g., star schema).

Nice to have

• Basic knowledge of Docker or containerization.
• Experience with data processing frameworks (e.g., Spark).

Soft skills

• Strong analytical thinking and problem-solving skills.
• Ability to work independently with some guidance.
• Good communication skills with technical and non-technical stakeholders.
• Willingness to learn and grow in a collaborative environment.

We offer*:

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

*not applicable for freelancers