Looking for a Big Data Engineer for an international engineering services company. (Remote).
Competitive salary; Flexible schedule; Medical insurance; Benefits program; Corporate social events.
Our client produces the most popular meal kit in the world. Everything required for delicious meals is carefully planned, carefully sourced and delivered to the front door of each customer at the time most convenient for them. The goal of the project is to determine the optimal setup to manage and surface the streaming data being produced within the DCs alongside historical data. The project will include gathering of metrics from scanners and iOT devices located in the Warehouses to avoid and detect bad quality products and also keep track in real time of all parcels.
- Development of the pipelines and DWH to store;
- Process supply data, automated data collection;
- Determine the best data architecture, tools, and next steps to support the storage and application of streaming data in US DCs and the downstream supply chain;
- Contribute to and promote good software engineering practices across the team;
- Communicate clearly and effectively to technical and non-technical audiences.
- 2+ years of solid experience working with Python;
- Working experience with AWS Cloud (S3, EMR);
- Working experience with Apache Spark and Apache Kafka.
Nice to have:
- Working experience with Scala;
- Working experience with Airflow;
- Ability to work to work with not clear requirements;
- Ability to work independently and prioritize work across multiple projects;
- English level: Upper-Intermediate and higher.
- Opportunity to work on bleeding-edge projects;
- Work with a highly motivated and dedicated team;
- Competitive salary;
- Flexible schedule;
- Medical insurance;
- Benefits program;
- Corporate social events.
Главный офис находится в Киеве, БЦ Gulliver, Башня Б, 11 этаж.
На рынке мы с 2007 года, компания начинала свою работу с проектов по поиску топ-менеджмента, с 2011 года активный участник IT сектора.
Наш фокус сейчас: работа на глобальном рынке рекрутмента, 80% вакансий это рынок ЕС.
DOU company page:
Job posted on
20 November 2020