Senior Data Engineer Offline

Project Description

GlobalLogic is searching for a motivated, results-driven, and innovative software engineer to join our project team at a dynamic startup specializing in pet insurance.

Job Description

- Strong experience in design, building, and maintaining data pipelines using Azure Data Factory (ADF) for data ingestion and processing, and leveraging Databricks for data transformation and analytical workloads
- Strong experience with Databricks auto loader from cosmos/blobs
- Design, create and maintain data pipelines that leverage Delta tables for efficient data storage and processing within a Databricks environment
- Experience in provisioning Databricks/Synapse/ADF workspaces
- Experience with RDBMS, such as PostgreSQL or MySQL, as well as NoSQL
- Strong Experience with Azure Data Factory (ADF)
- Preferred experience in analytical tools (Splunk, Kibana) and ability to pick up, work with and explore new analytical tools
- Data modeling and schema design
- Proven understanding and demonstrable implementation experience in Azure
- Excellent interpersonal and teamwork skills
- Strong problem solving, troubleshooting and analysis skills
- Good knowledge of Agile Scrum

Job Responsibilities

- Responsible for the design and implementation of key components in the system.
- Takes ownership of features, leads design decisions
- Peer-review the code and provide constructive feedback
- Takes part in defining technical strategies and best practices for the team
- Assists with backlog refinement and estimation at story level
- Identifies and resolves bottlenecks in the development process (such as performance bottlenecks)
- Solves complex tasks without supervision.