StartupSoft

ABOUT CLIENT

This independent research group focuses on tracking and forecasting infectious diseases. Initially studying illnesses like influenza and dengue, they later expanded to global outbreaks such as COVID-19. The team gathers unique data sources, extracts key indicators of disease activity, and shares them publicly to support real-time monitoring and short-term forecasts. Their mission is to strengthen global readiness for future epidemics through data-driven insights and predictive modeling.
 

PROJECT TECH STACK

Apache Airflow 3.0, PostgreSQL
 

PROJECT STAGE

Live product
 

QUALIFICATIONS AND SKILLS

• 5+ years of experience with Airflow, with a focus on quality and depth of understanding, not just duration on the platform.
• Proven experience designing, deploying, and maintaining production-grade ETL workflows using Apache Airflow, with a strong understanding of DAG orchestration, performance optimization, and operation in managed environments such as Astronomer.
• Senior-level expertise in scaling, best practices, maintainability, and cost management — not just someone who can build pipelines.
• Strong DBT skills would be a plus (the team has not yet adopted DBT, but is considering it).
• Solid knowledge of Postgres optimization and the ability to clearly explain not only how to implement optimizations but also why they are needed.
• Excellent communication skills are needed as the team needs guidance to enhance their capabilities more than immediate technical fixes.
   

RESPONSIBILITIES

• Ensure and help define best practices that promote maintainability and high code quality across the team.
• Assist in resolving performance issues as they arise and proactively identify potential performance concerns.
• Help the team detect bugs and problem areas early in the development process.
• Guide the building of scalable solutions and the effective management of hosting costs.