Senior Data Engineer

Project Overview

The company helps hotel chains like Hilton and Marriott transform front-desk staff into revenue generators through upselling training and analytics. Their IN-Gauge SaaS platform empowers frontline teams across 2,000+ properties in over 100 countries.

Responsibilities

- Implement scaling of the case detection process (scanner)

- Split API into multiple API services

- Emulate pubsub/cloud run locally

- Implement scaling of the case detection process (scanner)

- Split API into multiple API services

- Emulate pubsub/cloud run locally

- Extract & process data using PySpark + S3 (Kafka/Kinesis — bonus)

- Write & optimize SQL on PostgreSQL/Redshift; use DynamoDB as data source/sink

- Run and debug ETL jobs on Glue or EMR; monitor via console/Spark UI

Requirements (Must-have)

Data engineering - 5 years,

AWS - 3 years (1 year latest project),

Spark/PySpark - 2 years (1 year latest project)

Nice to Have

GCP (pubsub/Cloud Run)

Hiring Process

Intro call

Technical discussion (focused on real experience)

Offer

Start: ASAP