Data Engineer (offline)
Description:
GlobalLogic is partnering with a US-based digital health company, whose mission is to connect people in social interactions for the health conversations, build online health communities to support each other and share knowledge about how to deal with the disease.
The core of the project is working with the data; the target is to re-design, transition to cloud and enhance data-driven solutions.
You will work in a small team responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will partner with our software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. If you are excited by the prospect of optimizing or even re-designing our data architecture to support our next generation of products and data initiatives, we would be thrilled to have you apply!
Requirements:
β Good working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
β A successful history of manipulating, processing and extracting value from large disconnected datasets
β Experience building and optimizing data pipelines, architectures and data sets
β Experience performing root cause analysis on internal and external data and processes to answer specific
business questions and identify opportunities for improvement
β Strong analytic skills related to working with unstructured datasets
β Experience supporting and working with cross-functional teams
Nice to have experience:
β Advertising technology experience including data integrations with ad exchange(s) and identity partners
β for example Crossix, ComScore, Liveramp, Google Ad Manager or others
Technologies:
β AWS: SES, RDS (MySQL), EC2, Elasticsearch Service, Route 53, VPC, etc
β Snowflake
β Fivetran
β DBT
β Airflow
β Snowplow
β Graph database (Amazon Neptune)
β CDP platforms (cencus, hightouch)
Preferences:
Vue.js
Responsibilities:
β Manage and optimize core data infrastructure
o Develop custom data infrastructure not available off-the-shelf
o Build monitoring infrastructure to give visibility into the pipelineβs status
o Monitor all jobs for impact on cluster performance
o Run maintenance routines regularly
o Tune table schemas to minimize costs and maximize performance
β Build and maintaining custom ingestion pipelines
β Support data team resources with design and performance optimization
o Work with data and analytics experts to strive for greater functionality in our data systems
β Build non-SQL transformation pipelines
β Build processes supporting data transformation, data structures, metadata, dependency and workload management
What We Offer
Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.
Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment β or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.
Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.
Excellent Benefits: We provide our consultants with competitive compensation and benefits
Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!
GlobalLogic is partnering with a US-based digital health company, whose mission is to connect people in social interactions for the health conversations, build online health communities to support each other and share knowledge about how to deal with the disease.
The core of the project is working with the data; the target is to re-design, transition to cloud and enhance data-driven solutions.
You will work in a small team responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will partner with our software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. If you are excited by the prospect of optimizing or even re-designing our data architecture to support our next generation of products and data initiatives, we would be thrilled to have you apply!
Requirements:
β Good working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
β A successful history of manipulating, processing and extracting value from large disconnected datasets
β Experience building and optimizing data pipelines, architectures and data sets
β Experience performing root cause analysis on internal and external data and processes to answer specific
business questions and identify opportunities for improvement
β Strong analytic skills related to working with unstructured datasets
β Experience supporting and working with cross-functional teams
Nice to have experience:
β Advertising technology experience including data integrations with ad exchange(s) and identity partners
β for example Crossix, ComScore, Liveramp, Google Ad Manager or others
Technologies:
β AWS: SES, RDS (MySQL), EC2, Elasticsearch Service, Route 53, VPC, etc
β Snowflake
β Fivetran
β DBT
β Airflow
β Snowplow
β Graph database (Amazon Neptune)
β CDP platforms (cencus, hightouch)
Preferences:
Vue.js
Responsibilities:
β Manage and optimize core data infrastructure
o Develop custom data infrastructure not available off-the-shelf
o Build monitoring infrastructure to give visibility into the pipelineβs status
o Monitor all jobs for impact on cluster performance
o Run maintenance routines regularly
o Tune table schemas to minimize costs and maximize performance
β Build and maintaining custom ingestion pipelines
β Support data team resources with design and performance optimization
o Work with data and analytics experts to strive for greater functionality in our data systems
β Build non-SQL transformation pipelines
β Build processes supporting data transformation, data structures, metadata, dependency and workload management
What We Offer
Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.
Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment β or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.
Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.
Excellent Benefits: We provide our consultants with competitive compensation and benefits
Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!
The job ad is no longer active
Job unpublished on
12 December 2021
Look at the current jobs Data Science Kyiv→
Average salary range of similar jobs in
analytics β
Similar jobs
ML Engineer at Outstaff your team
Ukraine
Machine learning engineer / Data Scientist at Cropwise
Switzerland, Spain, Ukraine
All jobs Data Science Kyiv All jobs GlobalLogic