Senior Data Engineer 02

Senior Data Engineer

Workload: Full-time
Duration: TBD (long-term)
Location: Europe (No RF / No RB)
Rate: up to 23 USD/hour

Project

Our client is a large dropshipping company that receives product catalogs from 50+ suppliers in various formats. The goal is to build a scalable data platform that automatically ingests, validates, transforms, and distributes product data to downstream systems.

A major challenge is inconsistent data quality across suppliers. The engineer will help establish a Single Source of Truth, implement automated data quality checks, and migrate existing ETL processes from Talend to a modern cloud-native stack.

Responsibilities

• Design and build scalable data pipelines for product data ingestion and transformation.
• Develop a centralized data platform serving as the Single Source of Truth.
• Automate ingestion of supplier feeds from multiple file formats and sources.
• Build data quality validation and monitoring processes.
• Create reporting on data quality issues for external suppliers.
• Design reusable and maintainable ETL/ELT frameworks.
• Migrate existing Talend ETL jobs to the new platform.
• Optimize pipeline performance and reliability.
• Collaborate with business and engineering teams on data integration requirements.
• Build infrastructure using Infrastructure as Code.

Tech Stack

• Python
• Google BigQuery
• Dataform
• Cloud Composer (Apache Airflow)
• Terraform

Requirements

• 5+ years of experience as a Data Engineer.
• Strong Python development skills.
• Hands-on experience with BigQuery.
• Experience building modern ETL/ELT pipelines.
• Experience with Cloud Composer (or strong Apache Airflow background).
• Experience with Infrastructure as Code using Terraform.
• Strong SQL skills.
• Experience designing data models and scalable data architectures.
• Experience working with messy, inconsistent, or high-volume datasets.
• Knowledge of data quality validation, reconciliation, and monitoring.
• Experience migrating legacy ETL solutions is a strong advantage.
• Ability to work independently and design technical solutions.

Nice to Have

• Dataform experience.
• Talend migration experience.
• Experience with product catalogs or e-commerce data.
• Experience with dropshipping, retail, or supply chain data.
• Experience working with multiple third-party data providers.