The Client is UK company, providing to market business intelligence for mainly pharma industry. The core of the product is data platfrom containing 10+ years of client experience on the market and giving the decision making support over it using ML and other intelligent approaches.
The client is in the era of technical transformation and wants to migrate the Data platform to Amazon cloud and build redesigned and refreshed product apps over it.
We are welcoming high professionals for this interesting journey, for making great solutions together!
3+ years of experience as a Data Engineer
2+ years expertise with Python
Hands-on experience with AWS and good knowledge of its sub-components and services as a plus
SQL, Redshift, Athena, Data modeling
ETL tools (e.g. Matillion, Glue) is a must
Lambdas, Containers, Fargate
Cloudformation and/or Terraform
Experience with data warehouses
Experience with Agile projects
Good understanding of Software Development Lifecycle
Perfect communication and cooperation skills
Ability to multi-task, prioritize and execute tasks in a fast-paced environment
You will be a part of a distributed Data Science Agile team (Ukraine, UK) and will communicate directly with colleagues working for the Client (UK). Job responsibilities include:
Establish ETL Platform
Capture existing data flows, develop clear pipelines
Transition flows to ETL jobs
Package up complex tasks in containers
Establish data platform (Redshift)
Replicate master data
Transform into new schema
Index into Elasticsearch
The first tasks, for example, would include: to modify and take ownership of several ETL pipelines in AWS Glue. Data modelling, database schema design in AWS Redshift, and python scripting within AWS Glue. Also event-based data handling with S3 buckets.
GlobalLogic is a full-lifecycle product development services leader that combines chip-to-cloud software engineering expertise and vertical industry experience to help our customers design, build, and deliver their next-generation products and digital experiences. By leveraging Agile / Lean MVP methods, cutting-edge technologies, and an integrated approach to experience design and complex engineering, we empower global brands such as Microsoft, BMC, Coca Cola, Samsung, Physio Control, and Roku to develop the “next big thing” in their markets. GlobalLogic is headquartered in Silicon Valley and operates design and engineering centers around the world, where we are continuously recognized as a top innovator and employer by organizations like Zinnov and Glassdoor.
DOU company page:
Job posted on
29 April 2021