Jobs Data Engineer

Client: USA
Format: Outstaff
Workload: Full-time
Duration: 3+ months

We are looking for a Senior Data Engineer to join our client's team.

Requirements:

• 5+ years of Data Engineering experience
• Strong ETL/ELT experience in cloud environments
• Hands-on experience with both AWS and Azure
• Advanced SQL and relational database design
• Experience with Data Warehousing, Data Lakes, and Lakehouse architecture
• Strong knowledge of Data Modeling, Data Quality, and Performance Optimization
• Upper-Intermediate (B2+) English

If you're interested, feel free to send your CV.

We're Gypsy Collective. The digital world is evolving faster than ever. New opportunities, new challenges, new ambitious goals. That’s why strong businesses need strong people. 

Gypsy Collective is an exclusive talent partner for selected brands. We help our partners attract exceptional talent by building long-term relationships and becoming deeply integrated into their business, culture, and growth ambitions.

Now we're looking for a DWH Engineer to join our team and help build scalable, reliable, and high-performance data warehouse solutions that support analytics and business decision-making. We are looking for an experienced and proactive engineer who can work across the full data lifecycle - from ingestion and modeling to optimization, monitoring, and automation - while collaborating closely with analysts, developers, and business stakeholders.

    📅 Your daily adventures include:

• Designing, building, and maintaining scalable Data Warehouse architectures aligned with business needs;
• Developing and optimizing ETL/ELT pipelines using Python, Airflow, and custom solutions;
• Working with DWH/Data Lake technologies including PostgreSQL, Trino, and BigQuery;
• Implementing incremental loads, CDC, backfills, and reprocessing strategies;
• Optimizing query performance, data models, and pipeline execution;
• Ensuring data quality through validation, automated testing, monitoring, and alerting;
• Integrating new data sources (APIs, third-party systems, raw data) without disrupting existing pipelines;
• Collaborating with analysts, engineers, BI teams, and business stakeholders to translate requirements into scalable data solutions;

• Reviewing code, mentoring engineers, and contributing to data engineering standards and best practices.

  
  🧭 What makes you a great match:

• Strong SQL skills: complex queries, CTEs, window functions, analytical queries (5+ years experience);
• Knowledge of Python or other scripting languages for data transformations (4+ years experience);
• Deep understanding of DWH concepts: ETL/ELT, Data Vault, Kimball, Star/Snowflake schemas (5+ years experience);
• Experience with Airflow or other data pipeline orchestrators (5+ years experience);
• Hands-on experience with modern DWH and query engines: BigQuery, Snowflake, Redshift, ClickHouse, Vertica, AWS Athena, Trino (5+ years experience);
• Confident use of Git; experience with team workflows (pull requests, rebasing, merge conflict resolution (5+ years experience);

• Understanding of server and cloud infrastructure: basic skills in configuration, maintenance, monitoring, and load control (3+ years experience).
   

  ⭐ Nice to have:

• Experience with CDC tools and streaming data sources;
• Knowledge of Docker, Kubernetes, and Infrastructure as Code (Terraform);
• Experience with cloud platforms such as AWS, GCP, or Azure;

• Familiarity with data governance, data cataloging, and lineage tools.
   

  Benefits:

• 💸 Flexible payment options: choose the method that works best for you.
• 🎁 Financial perks: Bonuses for holidays, B-day, work milestones and more - just to show we care.
• 📈 Learn & grow: We cover courses and certifications — and offer real opportunities to grow your career with us.
• 🥐 Benefit Сafeteria: Choose what suits you — sports, language courses, therapy sessions, and more.
• 🎉 Stay connected: From team-building events to industry conferences — we bring people together online, offline, and on stage.
• 💻 Modern Equipment: We provide new laptops along with essential peripherals like monitors and headphones for a comfortable workflow.
• 🕘 Your schedule, your rules: Start your day at 9, 10, or even 11 — we care about results, not clock-ins.
  
  If this role sounds like a good fit for you, we’d love to hear from you — apply and tell us a bit about yourself.

About Platform DareBay

DareBay is a UGC marketplace platform (Web & Telegram) connecting brands with content creators via automated, metric-based challenges and contests. We are in the pre-release stage - the product is live, scaling fast, and you will see the direct impact of your work immediately.

The Role

We are looking for a Data Engineer (2–4 years of exp.) to own, audit, and scale our data infrastructure. You will maintain data platforms under growing client loads, working closely with the CTO, Backend team, and Data Analysts.

Key Responsibilities:

• Audit, optimize, and maintain the existing data infrastructure.
• Build and scale reliable batch/streaming ETL/ELT pipelines.

• Collaborate with the CTO and analytics team to ensure data availability and quality.

   

Technical Stack:

• Core: Python & Advanced SQL (optimization, window functions).
• Processing & Orchestration: Apache Spark / Flink, dbt, Apache Airflow.
• DWH & Lakes: Snowflake / BigQuery / Redshift, ClickHouse (OLAP), Apache Iceberg.
• Streaming & Infra: Apache Kafka, Docker, Kubernetes, CI/CD.
• Data Quality: Great Expectations / Soda / Monte Carlo.

• Pluses: Java, Grafana/Prometheus, Telegram Bot API.

   

Requirements:

• 2–4 years of commercial Data Engineering experience.
• English: Upper-Intermediate (for documentation and tech communication).

• Ability to work closely with cross-functional teams (CTO, Backend, Analytics).

   

What We Offer:

• Remote-first format & flexible hours.
• Direct impact on architecture at an early scaling stage.
• Direct collaboration with the core team (CTO).

Join Zutobi - a fast-growing global edtech company revolutionizing driver education!
At Zutobi, we're on a mission to empower people through digital learning. Our flagship product, Zutobi Drivers Ed, helps millions of learners prepare for their driver's license exams through engaging and innovative learning experiences.
 

Our team is growing, and we're looking for a DevOps Engineer to join our existing DevOps team and help us scale our infrastructure, improve automation, and keep our services reliable as we grow. 

We use Kubernetes (GKE) as our primary platform, so hands-on experience is a plus - but if you're strong on the fundamentals and eager to learn, we'll get you up to speed.
 

What you'll do:

• Build, optimize, and maintain CI/CD pipelines to streamline development and deployment.
• Monitor and improve system reliability, scalability, and security.
• Automate cloud infrastructure management and configuration.
• Collaborate with developers to design and implement infrastructure best practices.
• Troubleshoot and resolve infrastructure-related issues, owning problems end to end.
• Ensure high availability and performance of our production environments.

What we're looking for:

• 2+ years of experience in DevOps (or 3+ years in SysAdmin) - comfortable owning tasks independently, not just executing tickets.
• Strong Linux skills: scripting (bash), monitoring (Prometheus, Grafana, Zabbix), log analysis, database management, backup and restore.
• Solid hands-on experience with Docker.
• Understanding of security best practices and infrastructure automation.
• English level: B2+ (we work in an international environment).

Nice-to-have: 

• Experience with Google Cloud / GKE (our primary platform), or AWS.
• Kubernetes, Terraform, Helm.
• CI tooling: GitLab CI, GitHub Actions.

💙 What we offer

• Culture: Empowering, ’Bottom Up’ culture valuing initiative, collaboration, and continuous learning, aligned with values of Safety, Simplicity, Modernity, Encouragement, Helpfulness, and Accountability.
• Impact & Growth: Work with an industry-leading product (250,000+ monthly users, 10M+ downloads).
• Innovation: Freedom to innovate and utilize expertise in a company that encourages ideas and initiative.
• Work Flexibility: Remote work with flexible 40-hour/week schedule, accommodating team meetings and collaboration.
• Vacation: 20 business days (4 weeks) annual leave.
• Sick Leave: 20 business days (4 weeks) annual sick leave.
• Holidays: Ukrainian public holidays are default days off.
• Learning & Development: Reimbursement for development courses/training, fostering a continuous professional development culture where employees seek opportunities and managers coach teams.

Шукаємо Senior Data Engineer з досвідом BigQuery, Python, DBT та Data Modeling в дуже велику і стабільну продуктову компанію. Компанія розробляє софт для найбільших страхових компаній світу.

Проект – побудова нової Data Platform на базі BigQuery з використанням DBT, Python, GCP. Сінйорна команда, адекватний і професійний менеджмент.

Шукаємо виключно українських девелоперів закордоном. Нажаль, в Україні цього разу не розглядаємо, через обмеження по доступу до критичних даних. Пропонуємо дуже гнучкі умови: віддалена робота, цікаві задачі і хороше/спокійне керівництво.

Опис вакансії:

What You’ll Do: 

• Design & run pipelines – create, deploy, and monitor robust data flows on GCP. 
• Model data – design star/snowflake schemas for analytics and reporting. 
• Write BigQuery SQL – build procedures, views, and functions. ● Build ML pipelines – automate training, validation, deployment, and model monitoring. 
• Optimize ETL – speed up workflows and cut costs. 
• Use the GCP stack – BigQuery, DBT + Dataflow, Dataproc, Airflow/Composer, Celigo.
• Guard quality & uptime – add tests, validation, and alerting; fix issues fast. 
• Document everything – pipelines, models, and processes. 

• Keep learning – track new tools and best practices. 

   

What You’ll Need: 

• 6+ yrs building data/ETL solutions; 2+ yrs heavy GCP work. 
• Proven BigQuery warehouse design and scaling. 
• Deep SQL, Python, DBT, Git; Talend, Fivetran, or similar ETL tools. 
• Strong data‑modeling skills (star, snowflake, normalization).
• Solid grasp of Data Lake vs. Data Warehouse concepts. 
• Problem‑solver who works well solo or with a team. 
• Clear communicator with non‑technical partners. 
• Bachelor’s in CS, MIS, CIS, or equivalent experience. 

The company is building the control layer for an energy-constrained world — deploying AI, machine learning, and reinforcement learning to optimize HVAC systems, industrial equipment, and large-scale energy loads across commercial buildings, factories, hospitals, and data centers. The focus is on real, measurable impact: autonomous control systems that drive 20–30%+ energy savings in production environments.

We're looking for a BMS Control Engineer / Forward Deployment Engineer (TPM) who will join the team. This is a hands-on role for someone who doesn't just design building automation systems, but has deployed, commissioned, and optimized them in real-world infrastructure.

This role is for someone who takes full ownership of field deployments — from site discovery to production rollout. You'll work at the intersection of BMS/BAS systems, HVAC controls, and AI-driven optimization, deploying autonomous control systems across commercial buildings, factories, hospitals, and data centers.

Your responsibilities will include:

• Own deployments end-to-end: site discovery, integration, commissioning, validation, and rollout;
• Install, configure, and commission BAS/BMS and PLC-integrated systems;
• Deploy gateways, sensors, submeters, and communications infrastructure;
• Perform startup, point-to-point testing, and controls validation;
• Interface with AHUs, RTUs, chillers, boilers, pumps, cooling towers, and VFDs;
• Integrate through BACnet (IP & MS/TP), Modbus, LON, and IP networks;
• Work with Niagara, Siemens, Honeywell, Johnson Controls Metasys, Delta, and other BAS platforms;
• Configure addressing, routing, communications, and device connectivity;
• Diagnose controls hardware, wiring, networking, protocol, and sensor issues;
• Support deployment of AI-driven and RL-driven control strategies;
• Own deployment schedules, communications, milestones, and execution;
• Coordinate customers, contractors, vendors, and internal engineering teams;
• Maintain deployment plans, commissioning reports, diagrams, and as-built documentation.
   

What we expect from you:

• Degree in Electrical Engineering, Mechanical Engineering, HVAC, or related discipline — or equivalent BAS/PLC/SCADA/DCIM experience;
• 2+ years of hands-on BACnet experience (IP & MS/TP);
• 2+ years of Modbus experience;
• 2+ years of HVAC Controls / DDC / BMS experience;
• Strong understanding of BMS/DDC systems, PLCs, PID loops, hydronics, and refrigeration;
• Experience with BAS platforms: Niagara (Tridium), Siemens, Honeywell, Johnson Controls Metasys, Delta;
• Hands-on commissioning and troubleshooting experience in the field;
• Ability to work independently and take ownership in customer-facing environments.
   

Nice to have:

• Niagara (Tridium), EPA 608, NATE, or OSHA certifications;
• Experience in industrial facilities, healthcare, mission-critical environments, or data centers;
• Exposure to IoT, edge computing, SCADA, or DCIM platforms;
• Experience with LON protocol and IP networking in BAS contexts.
   

We offer:

• Full-time engagement on a high-impact infrastructure project;
• Remote-friendly with on-site deployment work at client facilities;
• Direct work with cutting-edge AI and reinforcement learning applied to real-world systems;
• Measurable impact — 20–30%+ energy savings across live deployments;
• Opportunity to help define the future of autonomous building and industrial control systems.

We are looking for a Senior Machine Learning Engineer to work on LLM-based systems with a strong emphasis on integration, end-to-end workflows, and production readiness. This role combines performance optimization (prefill/decode, throughput, latency) with hands-on work integrating components across the AI platform.

A significant part of the role involves building end-to-end integration flows and tests, particularly around token generation pipelines and system orchestration, as well as contributing to intelligent system behavior such as hardware selection and execution strategies. The role also includes developing system-level logic in Python for multi-tenant management, caching strategies, and service lifecycle management across the platform.

Responsibilities:

• Build and maintain end-to-end integration flows across the AI inference pipeline (serving, orchestration, APIs, and infrastructure);
• Design, implement, and optimize LLM inference workflows, including prefill and decode stages;
• Improve system performance with focus on throughput, latency, and interactivity;
• Write production-grade components in Python and integrate them into the broader system;
• Contribute to system-level logic such as smart hardware selection and execution strategies;

• Integrate models (open source and custom), services, and APIs into cohesive, reliable end-to-end application pipelines.

  Requirements:

• 5+ years of experience in software engineering or machine learning engineering;
• Strong proficiency in Python;
• Strong experience with LLM inference systems and performance optimization;
• Hands-on experience with system integration and end-to-end workflows;
• Experience with inference frameworks such as vLLM, TensorRT, SGLang etc;

• Experience working with GPU/accelerator-based systems.

  Would be a plus:

• Hands-on experience with Dynamo and LLM-D for LLM inference and serving;
• Familiarity with Kubernetes and cloud environments.

We are a product company building AI-powered mobile applications used by over 10 million people in 150 countries. We own the entire product lifecycle — from the initial idea to large-scale global implementation. We thrive in a fast-paced environment, making data-driven decisions without unnecessary bureaucracy. If you value autonomy, rapid releases, and seeing the direct impact of your work, you will fit right in.
 

The Role

We are looking for a Senior DevOps Engineer to take full ownership of the infrastructure for our ambitious new project in the Cloud Gaming & Streaming space. Your primary mission is to build a high-performance, fault-tolerant system capable of handling massive loads and streaming content to thousands of concurrent users.
 

Work Format & Relocation

• Location: Dubai, UAE (Office).
• Trial Period: First 2–3 months are fully remote for a smooth onboarding.
• Relocation Support: Full corporate visa sponsorship and relocation support provided after the trial period.

Key Responsibilities

• Ensure high availability and seamless scalability of infrastructure supporting thousands of servers.
• Automate server setup, provisioning, and deployment using Terraform and modern configuration management tools.
• Architect and optimize systems for high-load, distributed streaming environments.
• Drive incident response, monitoring, and troubleshooting to maintain product stability.
   

Requirements

• Experience: 4+ years in a DevOps role with hands-on experience in supporting high-load systems.
• OS Expertise: Deep understanding and practical experience in both Linux and Windows administration.
• Architecture: Experience with microservices, containerization, and distributed systems.
• IaC & Automation: Proficiency in Terraform and strong scripting skills for server auto-setup.
• Language: English (Upper-Intermediate or higher, sufficient for technical collaboration).
   

Nice-to-have

• Understanding of data streaming principles and previous experience in the streaming or gaming field.
• Basic knowledge of C++ development to collaborate effectively with the core infrastructure team.
   

What We Offer

• Relocation Package: Full financial and organizational support for your move to Dubai (visa, tickets, initial housing) after the trial period.
• Modern Office: Work from a vibrant, tech-driven workspace in Dubai.
• Real Impact: Direct influence on the tech stack of a Cloud Gaming platform with a potential million-user audience.
• Ownership: Maximum autonomy in choosing tools and approaches to solve complex challenges.
• Fast-Paced Culture: A product-driven environment where decisions are made quickly, without micromanagement.
• Compensation: Competitive salary pegged to USD (to be discussed individually based on technical interview results).

Full-time · Remote · Start: ASAP (3–4 weeks)

About the role

We're building a social commerce platform for the Middle East — live shopping, real-time auctions, and community-driven discovery in one place. Think TikTok Shop meets eBay Live, built for a market that moves fast.

We need a hands-on engineer to own our entire data and automation engine: from raw behavioral events to personalized recommendations, automated lifecycle messaging, and production AI. This is not a research role. You will ship things that directly drive revenue and retention.

What you'll own

Data platform & warehouse Design and maintain our central OLAP warehouse (ClickHouse or equivalent). Build reliable ingestion pipelines. Be the person who ensures clean, trusted data across the organization.

Behavioral event tracking Instrument mobile and web apps to capture the full user journey — watch time, bid activity, follows, purchases. Own identity resolution across sessions and devices.

Growth data activation Build reverse ETL pipelines from the warehouse into ad platforms and marketing tools: Meta CAPI, Google Ads, Braze, Customer.io, WhatsApp API. Automate audience sync and campaign triggers.

Lifecycle automation & personalization Design behavior-based trigger logic (cart abandonment, livestream reminders, re-engagement flows). Build ranking and recommendation models for products and live shows.

Production AI integration Deploy LLM-powered workflows for seller onboarding, content moderation, and customer support automation. Own cost controls, evaluation pipelines, and reliability of these systems in production.

Requirements

• 7+ years in data engineering, software engineering, or data architecture
• Production-grade Python and SQL — you write code that runs in prod, not notebooks
• Proven experience building OLAP warehouses: ClickHouse, BigQuery, Snowflake, or Redshift
• Experience with event tracking and identity resolution: Segment, RudderStack, PostHog, or similar
• Experience connecting warehouses to marketing/CRM tools via Reverse ETL: Hightouch, Census, or direct integrations
• Shipped LLMs or RAG systems in production — demos and side projects don't count
• Strong communication: you can explain data trade-offs to non-technical stakeholders clearly

Nice to have

• Background in e-commerce, marketplaces, or consumer apps
• Experience with recommendation systems, personalization algorithms, or vector databases
• Familiarity with real-time streaming metadata (LiveKit, WebRTC)

Stack you'll work with

ClickHouse · Python · dbt · Segment / RudderStack · Meta CAPI · Braze · Customer.io · Hightouch · OpenAI / Anthropic APIs · vector databases

Why this role

• You'll be the first dedicated data/AI engineer — high ownership, high impact
• Fast-growing market with real behavioral data from day one
• Direct line to product and business decisions
• Competitive compensation, remote-friendly

About the Project

Client is undergoing a large-scale Identity & Access Management transformation program as part of its alignment with Allianz Group standards.The initiative aims to establish a centralized Identity Governance and Administration (IGA) platform across multiple portfolio companies, replacing fragmented identity management approaches with a unified governance model.The selected candidate will play a key role in defining the business role model, capturing authorization requirements, supporting role design activities, and working closely with business stakeholders throughout the IAM transformation journey.

We are looking for an experienced IAM Business Engineer to act as the bridge between business stakeholders and the IAM program team.The primary focus of this role is to understand how access and authorization are currently managed across portfolio companies, define the future business role model, contribute to Segregation of Duties (SoD) controls, and support the rollout of the centralized IAM solution. This is a highly stakeholder-facing role with a strong emphasis on analysis, workshops, documentation, role modelling, and governance rather than technical implementation.

Responsibilities:

Business Role Modelling

• Design and maintain the enterprise business role model
• Define authorization concepts and role structures
• Create and maintain entitlement catalogues
• Support business role lifecycle management

Requirements Gathering

• Conduct workshops with business stakeholders and application owners
• Capture current access management practices and authorization requirements
• Analyze existing role structures across portfolio companies
• Identify common patterns and opportunities for standardization

IAM Governance & SoD

• Contribute to Segregation of Duties (SoD) matrix development
• Support access governance activities
• Identify conflicting access rights and governance risks
• Assist with access review and certification concepts

Stakeholder Management

• Collaborate with business owners across multiple portfolio companies
• Facilitate discussions regarding role design and access requirements
• Align stakeholders on future-state IAM processes and role concepts
• Support communication and change management activities

Migration & Adoption Support

• Support portfolio companies during migration to the centralized IAM platform
• Help stakeholders understand new role concepts and governance requirements
• Participate in role-mapping and transition activities
• Assist with adoption and rollout activities

Required Experience:

• 5+ years of experience in Identity & Access Management, Access Governance, or Role Management
• Proven experience designing RBAC models and business roles
• Experience gathering requirements from business stakeholders
• Experience conducting workshops and stakeholder interviews
• Understanding of access governance principles and role engineering
• Experience with Segregation of Duties (SoD) concepts
• Strong documentation and analytical skills

Preferred Experience

• Experience with Identity Governance & Administration (IGA) programs
• Experience with One Identity, SailPoint, Entra ID, or similar IAM platforms
• Experience with role mining activities
• Experience in enterprise IAM transformation initiatives
• Experience working in multi-company or multinational environments

Our client is a Canadian financial services company undergoing significant growth and modernization of its data ecosystem. The team is building a scalable cloud-based data platform that will serve as a foundation for analytics, reporting, and data-driven decision-making across the organization.
 

You will join the Core Data Platform team and take ownership of designing and developing enterprise-grade data solutions.

Responsibilities

• Design and implement scalable data models in Snowflake.
• Build, optimize, and maintain ELT/ETL pipelines using dbt.
• Develop and support workflow orchestration using Airflow or Dagster.
• Write clean, reusable, and maintainable Python code for data processing and monitoring.
• Collaborate with Tech Leads, analysts, and business stakeholders to define requirements and deliver solutions.
• Participate in architecture discussions and drive technical decisions.
• Ensure high code quality through reviews, testing, documentation, and CI/CD practices.
• Work with cloud-native services across AWS and Azure environments.
• Contribute to metadata management, logging, monitoring, and production support.

Must Have

• 7+ years of experience in Data Engineering.
• Strong hands-on experience with Python and advanced SQL.
• Experience with Apache Spark or similar large-scale data processing frameworks.
• Solid experience with workflow orchestration tools (Apache Airflow or Dagster).
• Strong expertise in Snowflake and enterprise data warehouse architectures.
• Experience designing secure data platforms, including:
  • data security implementation;
  • access control;
  • data masking policies;
  • handling sensitive and PII data.
• 3+ years of experience with cloud platforms (AWS, Azure, or GCP).
• Experience building and maintaining CI/CD pipelines.
• Strong understanding of software engineering best practices, testing, and documentation.
• Ability to work independently and take ownership of end-to-end delivery.
• Excellent communication skills and experience working directly with stakeholders.
• Upper-Intermediate/Advanced English level (C1).

Nice to Have

• Experience with Data Mesh architecture.
• Experience with Snowflake UniStore and Hybrid Tables.
• Infrastructure as Code experience (Terraform, Ansible).
• Experience working in the financial domain.
• AWS certifications.

Tech Stack

• Snowflake
• dbt Core / dbt Cloud
• Apache Airflow / Dagster
• Python
• SQL
• Apache Spark
• AWS, Azure
• Terraform
• GitHub Actions

Interview Process

• HR Interview
• Technical Interview
• Short video introduction (2–3 minutes)
• Client Interview

About the role

We are looking for a Senior Backend Engineer o join the AgInsights Platform team.

The platform enables data-driven decision-making in agriculture by integrating agronomic and machine learning models into scalable cloud-native services.

You will play a key role in building and scaling the AgInsights Platform, developing backend services, integrating agronomic models, and improving the tooling and infrastructure that enable data-driven decision-making in agriculture. This is a hands-on engineering role with real ownership, where you will work across platform and model boundaries to deliver reliable, production-ready systems in a largely greenfield environment.

Responsibilities

• Build and maintain backend services and APIs (e.g., using FastAPI)
• Integrate and operationalise agronomic and data-driven models
• Design and implement data workflows (e.g., with Apache Airflow)
• Develop and improve internal tooling, SDKs, and developer experience
• Deploy and operate services in cloud-native environments (Kubernetes on Amazon Web Services)
• Contribute to CI/CD and GitOps practices (e.g., CircleCI, Argo CD)
• Improve observability, monitoring, and system reliability

• Collaborate closely with data scientists, model developers, and platform engineers

   

Requirements

• 4+ years of commercial experience with Python
• 3+ years of experience with FastAPI
• Experience with Redis and Celery
• 3+ years of experience with Pandas
• Experience with Apache Airflow and data orchestration
• Solid experience with AWS cloud services

• Upper-Intermediate English or higher

   

Nice to Have

• Experience with machine learning platforms or MLOps practices
• Experience with data engineering and large-scale data processing
• Experience with GitOps tools such as Argo CD
• Experience in AgTech, agriculture, geospatial, or environmental data domains

We're looking for a remote Software Engineer to help build one of the largest data platforms.

Our platform processes million events every day that power analytics and products used by very large amount of users.

If you enjoy solving large-scale engineering problems, building distributed systems, and working with modern cloud technologies, we'd love to hear from you.

What you'll work on

• Build and improve large-scale data pipelines.
• Develop high-performance batch and streaming applications.
• Design reliable distributed systems.
• Improve platform performance, scalability, and reliability.
• Collaborate with product and engineering teams to deliver production-ready solutions.

Requirements

• 3+ years of software engineering experience.
• Strong Java or Scala skills.
• Experience building distributed systems in the cloud.
• Familiarity with AWS or another major cloud platform.
• Strong problem-solving skills.
• Good English communication.

Nice to Have (not must)

• Python
• Terraform
• CI/CD
• DevOps experience
• SaaS experience

What You'll Get

• Competitive salary
• Paid vacation
• Paid sick leave
• Brand-new MacBook after probation

IT Craft is looking for a Senior Data Engineer to join our team.

As a Senior Data Engineer, you will design, build, and optimize enterprise data pipelines and lakehouse solutions aligned with the given data architecture, governance standards, and cloud-first strategy. You will partner with cross-functional teams to deliver secure, scalable, and high-quality data solutions that enable analytics, reporting, and AI-driven capabilities.

Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines across enterprise systems, including ERP, CRM, and operational platforms;
• Build and support cloud-based data lakehouse architecture aligned with medallion layers and governance standards;
• Develop and maintain data models, semantic layers, and curated datasets for analytics and business intelligence;
• Translate business requirements into technical data solutions in collaboration with product, engineering, and business stakeholders;
• Ensure data quality, integrity, and security in alignment with given data governance and compliance standards;
• Optimize SQL queries, data pipelines, and storage performance across AWS and Azure platforms;
• Support data integration initiatives, including Data Lake, D365 ERP, and CRM/AMS platforms;
• Monitor pipeline health, troubleshoot issues, and ensure high availability and reliability of data systems;
• Contribute to the continuous improvement of data architecture, standards, and best practices;
• Support AI and analytics initiatives by enabling high-quality, accessible data for downstream consumption.

Requirements:

Technical Skills and Experience:

• 5+ years of experience in data engineering or data platform development;
• Strong experience designing and building ETL/ELT pipelines in cloud environments;
• Hands-on experience with AWS (S3, Redshift, Glue, DMS) and Azure (Data Factory, SSIS);
• Strong proficiency in SQL and relational database design;
• Solid understanding of data warehousing, data lakes, and lakehouse architecture;
• Experience with structured, semi-structured, and unstructured data processing;
• Experience with data modeling, data quality, and performance optimization;
• Experience with Git, Azure DevOps, and CI/CD practices;
• Strong analytical, problem-solving, and communication skills;
• At least an Upper-Intermediate level of spoken and written English.

Non-Technical Skills:

• Build positive working relationships across multiple IT disciplines and staff levels;
• Collaborate effectively and welcome feedback on ongoing projects;
• Respond to business issues with an appropriate sense of urgency;
• Know when to escalate a problem or seek assistance;
• Be organized, proactive, and self-motivated;
• Communicate clearly, both verbally and in writing;
• Demonstrate strong problem-solving skills and attention to detail;
• Identify and document business and system requirements;
• Thrive in a high-energy, team-focused environment;
• Deliver high-quality results while meeting project schedules.

Nice to Have:

• Experience with Databricks, Spark, or Azure Fabric;
• Experience with Power BI or enterprise reporting platforms;
• Familiarity with AI/ML data enablement and tools (e.g., AWS Bedrock, RAG concepts).

Role Characteristics:

• Technical individual contributor role with ownership of data engineering deliverables;
• Works on complex initiatives aligned with a given enterprise data strategy;
• Collaborates with cross-functional teams across IT, analytics, and business units;
• Contributes to architecture decisions and continuous improvement efforts.

What We Offer:

• Competitive compensation according to the qualifications;
• Flexible working hours, remote work;
• Opportunity for career growth;
• Reward for sports activities;
• In-house English training;
• A friendly team of open-minded people.

Please send your CV.

By submitting your application, you consent to the processing of your personal data in accordance with IT Craft's Privacy Policy, available at https://itechcraft.com/datenschutz/.

About AppsFlyer:

AppsFlyer provides a SaaS marketing analytics platform that measures and optimizes marketing activities across mobile, web, CTV, PC, and console applications. AppsFlyer is known for its massive backend production. At any given moment, thousands of servers are consuming 150+ billion mobile app events, crunching our users’ data, serving requests, and communicating on a massive scale.

To maintain the universe we call AppsFlyer, we practice modern production operations with a complete self-serve CI/CD platform, a highly integrated observability stack for our micro-services, backends, and infrastructure, a culture of ownership and eagerness for quality.

The Analytics group is responsible for showing our clients the stories their data is telling. Through complex aggregation, mission-tailored analytical databases, and carefully crafted APIs we are able to provide slice-and-dice analysis in our beautiful dashboards and through the use of external integrations.

About the Role:

As a Data Engineer within the Analytics group at AppsFlyer, you will own the end-to-end journey of event data - from ingestion and processing to storage, modeling, and API delivery. 

You will design and implement data pipelines using Apache Airflow and Spark, choose and optimize analytical databases, and integrate new components in our hybrid microservices environment. You will collaborate with product managers and cross-functional teams, troubleshoot production incidents, and influence our migration toward Google Cloud and BigQuery. This role offers autonomy over feature design, real impact on a platform handling billions of events daily, and the chance to contribute to open-source projects or speak at industry forums.

Key Responsibilities:

• Develop and maintain data processing pipelines using Apache Airflow, Scala Spark or PySpark.
• Select, model and optimize analytical databases for high-throughput, low-latency queries.
• Design and implement backend services and APIs for data ingestion, aggregation and client consumption.
• Monitor system performance and stability; diagnose and resolve production issues.
• Collaborate with product managers and engineers to plan and deliver complex features.
• Drive migration efforts to Google Cloud Platform, BigQuery and modern data tooling.
• Participate in on-call rotations, alerting via PagerDuty and incident response procedures.
• Document system architecture and data flows; maintain code quality and tests.

Required Competence and Skills:

• 3+ years of software development experience with a focus on data engineering.
• Practical experience with Apache Spark (Scala or PySpark) and Apache Airflow.
• Experience building and maintaining high-throughput, low-latency distributed data systems.
• Strong SQL skills and experience with data modeling for analytics workloads.
• Familiarity with JVM languages (Scala, Java, Clojure) or Python for backend development.
• Experience with cloud platforms - preferably GCP - and data warehouses such as BigQuery.
• Proven ownership of production systems and on-call incident management.
• Excellent communication skills in English for distributed teamwork.
• B.Sc. in Computer Science or equivalent practical experience.

Nice to Have:

• Production experience with large-scale databases and ETL tooling.
• Hands-on background in Go or Clojure backend services.
• Experience with production-grade BigQuery ETL and data pipelines.
• Contribution to open-source projects or public speaking at meetups/conferences.
• An “AI mindset” - familiarity with tools like GitHub Copilot and emerging AI workflows.

Benefits Package includes:

• Health Insurance
• Paid Unlimited Vacation Days + all national holidays + additional recharge days
• Meals Reimbursement
• Sport Reimbursement
• Breakfast in the office
• Mental health program
• Team building, happy hours, and other team activities
• Paid sick days
• Snacks, fruits & ice-cold beer
• All new team members are provided with a brand-new Mac laptop with 2 monitors and a Starter package