Team Lead Python Data Engineer (Python)

Team Lead Python Data Engineer (Python)

Our client is an Israeli startup specializing in geodata.

We are looking for a Team Lead Python Data Engineer to lead the design and operation of large-scale data pipelines that generate property attributes from imagery using our internal AI models.

This role focuses on leading the development of distributed processing systems running on Kubernetes clusters and on-prem GPU infrastructure, capable of processing massive geospatial datasets at national scale.

You will work closely with AI engineers and SaaS platform teams to guide the development of robust pipelines that transform imagery into structured property intelligence used by the insurance and financial industries.

Responsibilities

• Design and build large-scale Python processing pipelines for satellite and street-level imagery

• Develop distributed workloads running on Kubernetes clusters

• Build and maintain orchestration workflows using Airflow

• Design and manage data storage and processing workflows using PostgreSQL

• Integrate large-scale AI inference pipelines running on GPU infrastructure

• Optimize processing performance for massive imagery datasets

• Improve observability, monitoring, and reliability of production pipelines

• Collaborate with AI engineers to support large-scale computer vision inference workflows

• Integrate pipelines with AWS-based services

Requirements

• 7+ years of Python engineering experience

• Strong experience designing distributed data pipelines or large-scale data processing systems

• Experience running workloads on Kubernetes

• Hands-on experience with Airflow or similar orchestration frameworks

• Experience processing large datasets (imagery, geospatial, or other high-volume data)

• Strong understanding of ETL architectures and distributed data systems

Nice to Have

• Experience working with satellite imagery, aerial imagery, or remote sensing datasets

• Experience with GPU-based inference pipelines

• Experience working with on-prem compute clusters

• Experience with C#

Our client is an Israeli startup specializing in geodata.