Senior Data Engineer Offline
Responsibilities:
- Develop an understanding of business processes, tools, and customer expectations.
- Design, implement, test, optimize, and troubleshoot analytics and reporting solutions to solve business performance management challenges.
- Collaborate with and influence business/engineering stakeholders to ensure our data infrastructure and products meets evolving requirements.
- Help to estimate and scope the project, and will carry on after project approval to implement the project with team.
- Write and review technical documents, including design, requirements, and process documentation.
Qualifications:
- Apache Airflow - including troubleshooting, working with dynamic DAGs
dynamic cloud monitoring, data pipelines (Big Query, Dataproc)
- Data engineering experience to troubleshoot and support DAG (Airflow/Composer DAG, pipepelines, jobs execution, setup etc.)
- CI/CD (CI/CD for Google Cloud - Terraform, Cloud Build).
- GCP, GKE, Composer/Airflow, BigQuery, Dataproc
- Python
- Technical writing - technical guides, readme, TDD, requirements
- Experience defining technical scope from business requirements, including investigating technical and product documentation
- Experience creating WBS and estimating tasks for fixed budget proposal
- Experience leading cross-functional team - Data Engineering, DevOps, collaborating and contributing with product marketing
- Experience tracking project progress with great accuracy and attention to details
- Timely and proactive tracking of team action items and status of tasks team is working on
- Verbal and written communication skills
- Accurate and attentive to details
We offer:
- Professional and personal growth.
- Competitive compensation depending on experience and skills.
- Compensation for sick leaves and regular vacations.
- Flexible work hours, remote.
The job ad is no longer active
Job unpublished on
29 May 2023
Look at the current jobs Data Engineer →