Data Engineer (Python) (offline)

Responsibilities:

Building a scalable infrastructure for streaming, storing and processing billions of data points
Solving problems in a scalable and efficient way
Taking full ownership on building data products from design to implementation and deployment
Uptime and maintenance of a high-scale live data pipeline
Cost reduction and optimization of compute resources
In terms of immediate data science needs we have the following:

Operations Data Flows into Operations Vision Tool (Elastic Search)
we alert on simple rules now like ‘no license plate reads in 1 hour == alert’ we would like to move to a more advanced system that could identify anomalies only (aka it’s ok to read no plates at 2 am, but not at 2 pm) (Elastic Search & PostgreSQL)
Production Data Flows into Rekor One
Need to 100x scalability without impacting response time (postreSQL)
Data science projects to understand congestion detection & abnormal congestion detection
Production Data Flows into Scout
Need to 100x scalability without impacting response time (MySQL, Redis)

Requirements:
3+ years experience writing and maintaining ETL processes or with server-side development at scale
English Upper-Intermediate
Experience with AWS or other cloud providers, including experience in handling development operations and deployments on high-scale live systems
Excellent Python programming skills
Excellent SQL and data mining skills
Focus on quality and simplicity.

About Intellias

Intellias is a global IT company with more than 2600 specialists that operates in Ukraine, Poland, Croatia, Bulgaria, Spain, Portugal, Colombia, India, Germany, the United States, and the United Arab Emirates. With more than 20 years of market experience, Intellias creates and supports a human-to-human culture to unite engineers, creators, and innovators.

The company develops complex software solutions and provides professional services, specializing in automotive, navigation, financial, and telecommunications technologies. More than two billion people around the world use technology products developed by Intellias engineers. For many years in a row, Intellias has been recognized as one of the best IT employers according to DOU.ua, the largest IT community in Ukraine. In 2020 and 2021, the company was ranked as a top IT employer by Forbes and EY.

Company website:
https://career.intellias.com/

DOU company page:
https://jobs.dou.ua/companies/intellias/