Senior Data Engineer

On behalf of our client, we are looking for a Senior Data Engineer.

About the Project

A global platform managing over 700,000 hotel rooms across 124 countries, helping clients generate billions in revenue.

Responsibilities:

- Implement scaling of the case detection process (scanner)

- Split API into multiple API services

- Emulate pubsub/cloud run locally

- Extract and process data using PySpark + S3

- Work with Kafka/Kinesis data streams

- Write and optimize SQL queries on PostgreSQL/Redshift

- Use DynamoDB as a data source/sink

- Run and debug ETL jobs on Glue or EMR

- Monitor jobs via AWS console and Spark UI

Requirements:

- 5+ years of experience in Data Engineering

- 3+ years of experience with AWS (1+ year in the latest project)

- 2+ years of experience with Spark / PySpark (1+ year in the latest project)

- Strong experience with AWS S3

- Experience with Kafka or Kinesis

- Experience with DynamoDB

- Experience with PostgreSQL or MySQL

- Experience with AWS ECS Fargate

Nice to Have:

- AWS Glue

- EMR

- AWS Batch

- Flink

- Beam

- Cassandra / ScyllaDB

- AWS Step Functions

Company offers:

- Long-term employment with possibilities for professional growth

- Fully remote work

- Reasonably flexible schedule

- 15 days of paid vacation

- Regular performance reviews