Senior Data Engineer
The company helps hotel chains like Hilton and Marriott transform front-desk staff into revenue generators through upselling training and analytics. Their IN-Gauge SaaS platform empowers frontline teams across 2,000+ properties in over 100 countries.
- Implement scaling of the case detection process (scanner)
- Split API into multiple API services
- Emulate pubsub/cloud run locally
- Implement scaling of the case detection process (scanner)
- Split API into multiple API services
- Emulate pubsub/cloud run locally
- Extract & process data using PySpark + S3 (Kafka/Kinesis โ bonus)
- Write & optimize SQL on PostgreSQL/Redshift; use DynamoDB as data source/sink
- Run and debug ETL jobs on Glue or EMR; monitor via console/Spark UI
Must-have skills:
- Data engineering - 5 years,
- AWS - 3 years (1 year latest project),
- Spark/PySpark - 2 years (1 year latest project)
- English B2+
Required languages
| English | B2 - Upper Intermediate |