Dataforest. Empover the data.

Team/ Tech Lead Data Engineer Offline

Looking for a Team Lead Data Engineer to join the Dataforest team. If you are looking for a friendly team, a healthy working environment, and a flexible schedule ‒ you have found the right place to send your CV.

 

As a Team Lead, you will be an expert and a leader, playing a crucial role in guiding the development team, making technical decisions, and ensuring the successful delivery of high-quality software products.

 

Skills requirements:

• 5+ years of experience with Python;

• 4+ years of experience as a Data Engineer;

• Knowledge of data algorithms and data structures is a MUST;

• Excellent experience with Pandas;

• Excellent experience with SQL DB / NoSQL (Redis, Mongo, Elasticsearch) / BigQuery;

• Experience Apache Kafka, Apache Spark (pyspark);

• Experience with Hadoop;

• Familiarity with Amazon Web Services;

• Understanding of cluster computing fundamentals;

• Working with high volume tables 100m+.

 

Optional skills (as a plus):

• Experience with scheduling and monitoring (Databricks, Prometheus, Grafana);

• Experience with Airflow;

• Experience with Snowflake, Terraform;

• Experience in statistics;

• Knowledge of DS and Machine learning algorithms.

 

Key responsibilities:

• Manage the development process and support team members;

• Conduct R&D work with new technology;

• Maintain high-quality coding standards within the team;

• Create ETL pipelines and data management solutions (API, Integration logic);

• Elaborate different data processing algorithms;

• Involvement in creation of forecasting, recommendation, and classification models;

• Develop and implement workflows for receiving and transforming new data sources to be used in the company;

• Develop existing Data Engineering infrastructure to make it scalable and prepare it for anticipated projected future volumes;

• Identify, design and implement process improvements (i.e. automation of manual processes, infrastructure redesign, etc.).

 

We offer:

• Great networking opportunities with international clients, challenging tasks;

• Building interesting projects from scratch using new technologies;

• Personal and professional development opportunities;

• Competitive salary fixed in USD;

• Paid vacation and sick leaves;

• Flexible work schedule;

• Friendly working environment with minimal hierarchy;

• Team building activities, corporate events.

Required skills experience

Python
Big Data
Python Pandas
ETL
PySpark
Databricks
Python, Big Data, Pandas, ETL, PySpark, Databricks

The job ad is no longer active

Look at the current jobs Data Engineer →

Loading...