Lead Data Engineer (ETL)
Description:
Our Client is the Enterprise Worldwide Company. The product you will be working with, provides management and data processing/handling capabilities for networks of the clients scientific lab equipment such as microscopes, etc. The main goals are:
Collection and centralized management of data outputs (measurement results, etc.) provided by clients devices
Outdated data utilization
Managing large volumes of data acquired from measurement devices in the cloud securely and reliably
Seamless sharing of measurement data with collaborators
The ability to share measurement results and accelerate customer service.
Requirements:
We are looking for a Lead Data Engineer with at least 6 years of commercial experience in development of data platforms for enterprise applications. With the experience to Lead a team of engineers and take responsibility for the technical solution.
โ Proficiency in Airflow for workflow orchestration, dbt for data transformation, and SQL for data querying and manipulation.
โ Experience in data modeling, ETL (Extract, Transform, Load) processes, and data warehousing concepts.
โ Familiarity with cloud platforms (AWS) and their data services.
โ Excellent analytical and problem-solving skills with meticulous attention to detail.
โ Strong communication and collaboration skills with the ability to lead and motivate cross-functional teams.Good to have ability to participate onsite meeting.
Job responsibilities:
โข Implement new solutions into the current system with the refactoring and from scratch methods;
โข Preparing the technical documentation;
โข Participating in client meetings to understand business and user requirements and estimate tasks;
โข Collaborating closely with other engineers, product owners and testers to identify and solve challenging problems;
โข Taking part in defect investigation, bug fixing, troubleshooting.