Senior Data Engineer

We are looking for a Senior Data Engineer to design and build scalable data platforms that process large volumes of data for analytics, reporting, and business-critical applications.

You will work with distributed data processing systems, cloud infrastructure, streaming platforms, and modern data pipelines. We are looking for an engineer who can independently own production solutions and solve complex performance and architecture challenges.

Mandatory Skills

Programming & Data Processing

• Strong Python development skills
• Advanced SQL (complex queries, optimization, execution plans)
• Strong commercial experience with Apache Spark / PySpark
• Experience optimizing Spark jobs (partitioning, shuffle, joins, skew handling)

Data Engineering

• Experience building production-grade ETL / ELT pipelines
• Strong experience with Apache Airflow
• Strong hands-on experience with Apache Kafka
• Understanding of batch and streaming data processing architectures

Infrastructure & Storage

• Experience with relational databases (PostgreSQL, MySQL or similar)
• Data modeling and query optimization
• Hands-on experience with at least one cloud platform (AWS, Azure or GCP)
• Experience working with Docker, Linux, Git, and basic CI/CD pipelines

Desired Skills

• Databricks, Snowflake or similar cloud data platforms
• Kubernetes
• CDC pipelines (Debezium or similar)
• Modern analytical/storage systems (ClickHouse, Trino, Iceberg, Delta Lake)
• Monitoring tools (Grafana, Prometheus)

Responsibilities

• Build scalable batch and streaming data pipelines
• Develop and optimize Spark/PySpark data processing jobs
• Build Kafka-based ingestion and event-driven pipelines
• Design and maintain Airflow orchestration workflows
• Optimize SQL queries and improve pipeline performance
• Investigate production issues and improve system reliability
• Participate in architecture and technical design discussions

Senior-Level Expectations

• Independently design scalable data pipelines
• Debug and optimize distributed production systems
• Solve performance bottlenecks in Spark and SQL workloads
• Make technical decisions with minimal supervision
• Take ownership of production solutions end-to-end

Soft Skills

• Strong problem-solving skills
• Ownership and accountability
• Ability to work independently
• Good communication and collaboration skills
• Proactive engineering mindset