Data Engineer
We are looking for a Mid Data Engineer in Kraków, Poland who will own the company data lake — the system of record for millions of financial events a day (bets, wallet movements, live odds) across 12M+ active users. You decide how that data lands, is stored, retained, and governed on S3 + Snowflake/Databricks, so analytics, finance, and regulators all see accurate, reconciled data with zero drift from source.
Domain: Regulated iGaming / wallet & ledger data. Audit-heavy: regulators, finance and analytics all consume the same tables. Millions of financial events per day, terabyte-plus scale.
Key Responsibilities
- Own lakehouse architecture, including Bronze/Silver/Gold layers, Iceberg/Delta tables, and schema evolution.
- Build CDC streaming pipelines using Kafka, Debezium, or similar technologies, handling late and duplicate events.
- Optimize data storage and query performance through partitioning, compaction, and file sizing.
- Manage data retention, archival, regulatory requirements, and GDPR deletion.
- Ensure data accuracy through freshness SLAs, drift detection, and reconciliation with wallet and ledger systems.
- Own data governance, including cataloging, lineage, access control, PII masking, encryption, and audit trails.
- Monitor ingestion health, data quality, and cloud storage/compute costs.
Requirements
- 5+ years of experience in Data Engineering, with proven ownership of large-scale data lake or lakehouse architectures.
- Production experience with cloud storage (S3/GCS) and Snowflake, Databricks, or BigQuery.
- Hands-on experience with open table formats (Iceberg, Delta, or Hudi).
- Strong understanding of partitioning, file layout, and query optimization at terabyte scale.
- Experience with CDC and streaming ingestion (Kafka, Debezium, or equivalent).
- Strong SQL and data modeling skills, with a solid understanding of relational databases and financial ledger systems.
- Experience with data governance, including catalogs, lineage, access control, PII, and retention.
- Python and workflow orchestration experience (Airflow, Dagster, or similar).
Hands-on experience building and deploying AI agents and LLM-powered workflows to automate complex processes at scale.
Nice to have: Experience in fintech, iGaming, or other regulated, audit-heavy industries.