Lead Data Engineer (offline)

Looking for a Lead Data Engineer to join the Dataforest team. If you are looking for a friendly team, a healthy working environment, and a flexible schedule ‒ you have found the right place to send your CV.

As a Team Lead, you will be an expert and a leader, playing a crucial role in guiding the development team, making technical decisions, and ensuring the successful delivery of high-quality software products.

Skills requirements:
• Previous experience in a Team Lead role;
• 5+ years of experience with Python;
• 4+ years of experience as a Data Engineer;
• Knowledge of data algorithms and data structures is a MUST;
• Excellent experience with Pandas;
• Excellent experience with SQL DB / NoSQL (Redis, Mongo, Elasticsearch) / BigQuery;
• Experience Apache Kafka, Apache Spark (pyspark);
• Experience with Hadoop;
• Familiarity with Amazon Web Services;
• Understanding of cluster computing fundamentals;
• Working with high volume tables 100m+.

Optional skills (as a plus):
• Experience with scheduling and monitoring (Databricks, Prometheus, Grafana);
• Experience with Airflow;
• Experience with Snowflake, Terraform;
• Experience in statistics;
• Knowledge of DS and Machine learning algorithms.

Key responsibilities:
• Manage the development process and support team members;
• Conduct R&D work with new technology;
• Maintain high-quality coding standards within the team;
• Create ETL pipelines and data management solutions (API, Integration logic);
• Elaborate different data processing algorithms;
• Involvement in creation of forecasting, recommendation, and classification models;
• Develop and implement workflows for receiving and transforming new data sources to be used in the company;
• Develop existing Data Engineering infrastructure to make it scalable and prepare it for anticipated projected future volumes;
• Identify, design and implement process improvements (i.e. automation of manual processes, infrastructure redesign, etc.).

We offer:
• Great networking opportunities with international clients, challenging tasks;
• Building interesting projects from scratch using new technologies;
• Personal and professional development opportunities;
• Competitive salary fixed in USD;
• Paid vacation and sick leaves, medical insurance;
• Flexible work schedule;
• Friendly working environment with minimal hierarchy;
• Team building activities, corporate events.

About Dataforest

Dataforest - helps companies use data to drive decisions. We apply Data Science techniques combined with expertise in business automation, large-scale data analysis and advanced software engineering to improve performance outcomes for organizations and create added value to their clients and shareholders.

Company website:
http://dataforest.ai

DOU company page:
https://jobs.dou.ua/companies/dataforest/