Middle / Senior Data Engineer (offline)

The Client’s company provides a portal with multiple marketplaces and a way for their clients to build a new marketplace targeted for selling some specific products/equipment.
Data Engineer’s main goal is to handle new development work (i.e. data lake expansion), along with supporting a number of existing implementations (i.e. data lake maintenance).
Data Engineer will be supporting our efforts to rebuild our data lake and enterprise data warehouse within Snowflake. We have a lot of existing Python code that is transforming our data.

Required skills:
We are looking for Data Engineer that is proficient in the following tech stack:
1) Languages: Python, SQL, Javascript, Shell
2) Databases: Snowflake, Redshift, MariaDB, MongoDB
3) Integration: REST API Consumption
4) Cloud: AWS Services including (S3, AWS Secrets Manager, SNS, SQS, etc.)
5) OS: Linux
6) Task Management/Orchestration: Cronus, Airflow
7) Data Visualization: PowerBI (preparing data to be consumed by our Data Visualization team), Grafana
8) Metrics Collection: Prometheus

Responsibilities:
Data Engineer will be assigned tasks that include data ingestion, data processing, and ETL/ETL processes that include processing incoming files and making external-facing API calls.
The Data Engineers will be responsible for building out the data pipelines end to end:
1) Calling APIs or MariaDB/MongoDB data sources to pull data and store in S3
2) Ingest data from S3 into Snowflake data staging database
3) Perform ETL from the Snowflake staging database into a Snowflake data warehouse

About Akvelon Ukraine

Are you interested in work with world-famous Customers, relocation to the United States?

Akvelon Ukraine is looking for talented, highly motivated and passionate software engineers to join our Development Team in Kharkiv or remotely. We offer further assistance in relocation to the USA (Seattle or San Francisco).

Please feel free to contact me! ;)

Company website:
http://akvelon.com.ua/