Requirements:
• 4+ years SQL professional experience
• Structured programming language experience: python, Java, .Net, etc….
• Azure experience / familiarity, specifically Azure Data Factory
• Data pipeline/ETL experience
• Azure experience / familiarity, specifically Azure Data Factory
• Familiar working within an Agile and Scrum project environment
Duties:
Our stack is an ELT process inside of Azure Synapse. Day to day we work on SQL queries in spark
notebooks and manage the metadata controlling the data pipeline flow.
• This is a hands-on role that will also require assisting junior team members and interfacing with the client to understand work items, prioritize work items, and resolve problems. So communication is a key!
• Responsible for creating dimension and fact tables in sql using definitions provided by the business
• Ingest new data source objects into the ETL framework using metadata. Requires the ability to understand different schemas, adapt existing data processing steps to handle the new data object using SQL in a spark notebook environment
• Troubleshooting data discrepancies in existing dimension and fact tables by tracing the data flow through various SQL transformations
• Maintaining metadata that defines the ETL processing steps and troubleshooting metadata inconsistencies
• Daily interface with client data engineers to review work progress, identify and resolve blockers
About the project:
Large software and hardware product in Silicon Valley.
About Langate
Langate is an award-winning provider of web development services in 3 main categories: business, healthcare, and education. We closely work with both big enterprises and high-tech startups to grow their business worldwide. Our portfolio includes the largest projects in the field of healthcare with more than 2 million users that we set up in collaboration with Microsoft Corp.
Plus, we successfully launched a brand-new product for healthcare facilities supervised by the U.S. Department of Health.
Our team is located in 2 modern R&D centers — New York, USA and Ivano-Frankivsk, UA, with our headquarters being in New York. Since the very beginning in 2002, Langate has brought together great minds and talents who are passionate about the latest technology trends. Our professional engineers are experts in the .NET stack, which helps them create high-quality applications. Don't miss the chance to work with a well-established company using up-to-date tools!
Company website:
http://www.langate.com/
DOU company page:
https://jobs.dou.ua/companies/langate/
The job ad is no longer active
Job unpublished on
24 January 2022
Look at the current
jobs
Data Engineer
Remote→