Senior Data Engineer

Equals 5 is a Healthcare Marketing SaaS for Pharma and Life Sciences. Our platform leverages exclusive NPI-level targeting technology to help brands reach healthcare professionals across 20+ channels with precise, user-level reporting.

We are looking for a Senior Data Engineer to join the Identity team. This is not a standard ETL role. We are building a dynamic data ecosystem where AI is deeply integrated - both as a productivity multiplier and as a core component of our data processing logic for identity data enrichment and data scoring.

You will own the infrastructure that handles over 10,000 executions per minute, ensuring stability, scalability, and data integrity. You will work with a modern stack on Google Cloud Platform, utilizing Cloud Functions, Kubernetes, and a highly advanced N8N implementation (up to 20M executions per 24 hours).

Responsibilities

• Design and implement pipelines that utilize LLMs to analyze and score identity data in real-time. Integrate AI models directly into the decision-making loop, balancing accuracy with latency and cost.
• Architect scalable data solutions using GCP, Python, and N8N. Decide how to route, process, and store massive volumes of identity data. Manage storage with BigQuery and Apache Iceberg for TBs of data.
• Maintain and optimize N8N instances - complex dataflows, custom Python nodes, and performance tuning for 10k+ execs/minute.
• Manage PostgreSQL performance under heavy load, optimizing complex queries and indexing strategies.
• Utilize Apache Spark for data transformations and batch processing when lightweight cloud functions are not enough.
• Proactively monitor the system.

Requirements

• 4-5+ years of experience in Data Engineering or Backend Engineering with a strong data focus
• Production AI Integration: Experience integrating LLMs (OpenAI, Anthropic, Gemini) into production applications via API
• Expertise in GCP: Cloud Functions, IAM, Networking, Cloud Run
• Strong Python: Clean, efficient, and testable code; comfortable building custom logic
• Kubernetes (K8s): Experience deploying and scaling services in containerized environments
• PostgreSQL Mastery: Proven ability to handle heavy write/read loads and optimize schemas
• English: B2+ (Upper-Intermediate) or higher

Nice-to-have: 

• N8N / Workflow Automation experience at a deep technical level

What We Offer
- Fully remote with flexible hours (aligned with EU timezones for syncs).
- Influence on quality strategy across the entire engineering organization.
- A cross-team role with visibility into every part of the product.
- AI-first tooling.
- Claude Code licenses and cutting-edge AI development workflows. 
- A team with no bureaucracy, decisions are made fast.