Team Lead Data Engineering

Looking for a Team Lead Data Engineer to join the Dataforest team. If you are looking for a friendly team, a healthy working environment, and a flexible schedule ‒ you have found the right place to send your CV.

As a Team Lead, you will be an expert and a leader, playing a crucial role in guiding the development team, making technical decisions, and ensuring the successful delivery of high-quality software products.

Skills requirements:

• 5+ years of experience with Python;

• 4+ years of experience as a Data Engineer;

• Knowledge of data algorithms and data structures is a MUST;

• Excellent experience with Pandas;

• Excellent experience with SQL DB / NoSQL (Redis, Mongo, Elasticsearch) / BigQuery;

• Experience Apache Kafka, Apache Spark (pyspark);

• Experience with Hadoop;

• Familiarity with Amazon Web Services;

• Understanding of cluster computing fundamentals;

• Working with high volume tables 100m+.

Optional skills (as a plus):

• Experience with scheduling and monitoring (Databricks, Prometheus, Grafana);

• Experience with Airflow;

• Experience with Snowflake, Terraform;

• Experience in statistics;

• Knowledge of DS and Machine learning algorithms.

Key responsibilities:

• Manage the development process and support team members;

• Conduct R&D work with new technology;

• Maintain high-quality coding standards within the team;

• Create ETL pipelines and data management solutions (API, Integration logic);

• Elaborate different data processing algorithms;

• Involvement in creation of forecasting, recommendation, and classification models;

• Develop and implement workflows for receiving and transforming new data sources to be used in the company;

• Develop existing Data Engineering infrastructure to make it scalable and prepare it for anticipated projected future volumes;

• Identify, design and implement process improvements (i.e. automation of manual processes, infrastructure redesign, etc.).

We offer:

• Great networking opportunities with international clients, challenging tasks;

• Building interesting projects from scratch using new technologies;

• Personal and professional development opportunities;

• Competitive salary fixed in USD;

• Paid vacation and sick leaves, medical insurance;

• Flexible work schedule;

• Friendly working environment with minimal hierarchy;

• Team building activities, corporate events.