Senior Data Engineer

You'll own the company's data lake, managing millions of financial events daily (bets, wallet movements, and live odds) across 12M+ active users. You'll define how data is ingested, stored, retained, and governed across S3 and Snowflake/Databricks, ensuring accurate, reconciled, and reliable data for analytics, finance, and regulatory needs.

Key Responsibilities

• Own lakehouse architecture, including Bronze/Silver/Gold layers, Iceberg/Delta tables, and schema evolution.
• Build CDC streaming pipelines using Kafka, Debezium, or similar technologies, handling late and duplicate events.
• Optimize data storage and query performance through partitioning, compaction, and file sizing.
• Manage data retention, archival, regulatory requirements, and GDPR deletion.
• Ensure data accuracy through freshness SLAs, drift detection, and reconciliation with wallet and ledger systems.
• Own data governance, including cataloging, lineage, access control, PII masking, encryption, and audit trails.
• Monitor ingestion health, data quality, and cloud storage/compute costs.

Requirements

• 5+ years of experience in Data Engineering, with proven ownership of large-scale data lake or lakehouse architectures.
• Production experience with cloud storage (S3/GCS) and Snowflake, Databricks, or BigQuery.
• Hands-on experience with open table formats (Iceberg, Delta, or Hudi).
• Strong understanding of partitioning, file layout, and query optimization at terabyte scale.
• Experience with CDC and streaming ingestion (Kafka, Debezium, or equivalent).
• Strong SQL and data modeling skills, with a solid understanding of relational databases and financial ledger systems.
• Experience with data governance, including catalogs, lineage, access control, PII, and retention.
• Python and workflow orchestration experience (Airflow, Dagster, or similar).
• Hands-on experience building and deploying AI agents and LLM-powered workflows to automate complex processes at scale.
• Nice to have: Experience in fintech, iGaming, or other regulated, audit-heavy industries.