Data Engineer for USA Telecom Project (offline)
Responsibilities
This Senior Data Engineer will play a vital role in collaborating as part of this cross-functional Agile team to create and enhance data ingestion pipelines and address big data challenges. The Senior Data Engineer will work closely with the Chief Architect, systems engineers, software engineers, and data scientists on the following key tasks:
β’ Provide Extraction, Transformation, and Load (ETL) experience coupled with enterprise search capabilities to solve Big Data challenges
β’ Design and implement high-volume data ingestion and streaming pipelines using Open Source frameworks like Apache Spark, Flink, and Kafka on AWS Cloud
β’ Leverage strategic and analytical skills to understand and solve customer and business centric questions
β’ Create prototypes and proofs of concept for iterative development
β’ Learn new technologies and apply the knowledge in production systems
β’ Monitor and troubleshoot performance issues on the enterprise data pipelines and the data lake
β’ Partner with various teams to define and execute data acquisition, transformation, processing and make data actionable for operational and analytics initiatives
Requirements:
β’ 2 years of experience with big data tools: Hadoop, Spark, Kafka
β’ 1 years of experience with object-oriented programming with Java
β’ 3 years of experience with and managing data across relational SQL and NoSQL databases like MySQL, Postgres, Cassandra, HDFS, Redis, and Elasticsearch
β’ 2 years of experience working in a Linux environment
β’ 2 years of experience working with and designing REST APIs
β’ Experience in designing/developing platform components like caching, messaging, event processing, automation, transformation and tooling frameworks
β’ Experience developing data ingest workflows with Kafka Streams
β’ Experience transforming data in various formats, including JSON, XML, CSV, and zipped files
β’ Experience with performance tuning of ETL jobs
β’ Strong interpersonal and communication skills necessary to work effectively with customers and other team members
β’ Experience with software configuration management tools such as Git/Gitlab
Preferred Qualifications:
β’ Experience with AWS cloud services: EC2, S3, EMR, RDS, Redshift, Athena and/or Glue
β’ Experience with Microservices architecture components, including Docker and ECS
β’ Experience developing microservices to fit data cleansing, transformation, and enrichment needs
β’ Experience developing flexible data ingest and enrichment pipelines, to easily accommodate new and existing data sources
β’ Experience with continuous integration and deployment (CI/CD) pipelines
β’ Experience with Jira, Confluence and extensive experience with Agile methodologies
β’ Detailed oriented/self-motivated with the ability to learn and deploy new technology quickly
β’ A technical degree from a reputable University or equivalent years of experience
About Intellias
Intellias is a global IT company with more than 2600 specialists that operates in Ukraine, Poland, Croatia, Bulgaria, Spain, Portugal, Colombia, India, Germany, the United States, and the United Arab Emirates. With more than 20 years of market experience, Intellias creates and supports a human-to-human culture to unite engineers, creators, and innovators.The company develops complex software solutions and provides professional services, specializing in automotive, navigation, financial, and telecommunications technologies. More than two billion people around the world use technology products developed by Intellias engineers. For many years in a row, Intellias has been recognized as one of the best IT employers according to DOU.ua, the largest IT community in Ukraine. In 2020 and 2021, the company was ranked as a top IT employer by Forbes and EY.
Company website:
https://career.intellias.com/
DOU company page:
https://jobs.dou.ua/companies/intellias/
The job ad is no longer active
Job unpublished on
9 August 2020
Look at the current jobs SQL / DBA Kyiv→
Similar jobs
Business Analytic with a possibility to move worldwide at TalentsToday
United Kingdom, Ukraine to $3000
DB Administrator at Quickstarter
Relocate, Greece
Database developer at Lemtrans SRL
Ukraine $1-2
All jobs SQL Kyiv All jobs Intellias