Data Platform Engineer
CrunchCode is looking for a hands-on AI & Data Platform Engineer to join the development of an e-commerce and social marketplace designed for the Middle East.
The platform combines livestream shopping, real-time auctions, social engagement, and e-commerce within a single automated and data-driven ecosystem.
Your primary mission will be to build the data, automation, and personalization engine that transforms marketplace behavioral data into automated growth initiatives, relevant product recommendations, and personalized customer experiences.
Responsibilities:
- Data Platform & Warehouse: Architect and manage our central data warehouse (using ClickHouse or similar OLAP databases) and clean data pipelines.
- Event Tracking & Behavioral Data: Design robust event tracking across mobile and web apps to map user journeys (watch time, bids, follows, purchases).
- Growth Data Activation (MarTech): Build automated audience pipelines from the warehouse into marketing platforms (Meta CAPI, Google Ads, Braze, Customer.io, WhatsApp API).
- Lifecycle Automation & Personalization: Design behavior-based triggers (e.g., cart abandonment, livestream reminders) and ranking/recommendation logic for products and live shows.
- Practical AI Integration: Deploy production-ready LLM workflows and AI agents for operational needs (seller onboarding, content moderation, automated customer support) with proper cost and evaluation guardrails.
Requirements:
- 7+ years of experience in Data Engineering, Software Engineering, or Data Architecture.
- Strong, production-grade Python and SQL.
- Proven experience building Data Warehouses (OLAP): ClickHouse, BigQuery, Snowflake, or Redshift.
- Experience with Event Tracking & Identity Resolution (e.g., Segment, RudderStack, PostHog).
- Experience with Marketing Automation / Reverse ETL: Connecting data warehouses to CRM/Marketing tools (Braze, Customer.io, Hightouch, Census).
- Practical experience integrating LLMs/RAG into real production systems (not just prompts or demos).
- Excellent communication skills to translate technical trade-offs into business outcomes for non-technical stakeholders.
Nice to Have:
- Experience in E-commerce, Marketplaces, or Consumer Apps.
- Experience with recommendation systems, personalization algorithms, or vector databases.
- Experience with real-time media/streaming metadata (LiveKit, WebRTC).