Middle Data Engineer
Dataforest is looking for a Middle Data Engineer to join our team and work on the Dropship project — a cutting-edge data intelligence platform for e-commerce analytics. You will be responsible for developing and maintaining a scalable data architecture that powers large-scale data collection, analysis, and integrations. We are waiting for your CV!
Requirements:
- 2+ years of commercial experience with Python.
- Experience working with PostgreSQL databases.
- Profound understanding of algorithms and their complexities, with the ability to analyze and optimize them effectively.
- Solid understanding of ETL principles and best practices.
- Excellent collaborative and communication skills, with demonstrated ability to mentor and support team members.
- Experience working with Linux environments, cloud services (AWS), and Docker.
- Strong decision-making capabilities with the ability to work independently and proactively.
Will be a plus:
- Experience in web scraping, data extraction, cleaning, and visualization.
- Understanding of multiprocessing and multithreading, including process and thread management.
- Familiarity with Redis.
- Excellent programming skills in Python with a strong emphasis on optimization and code structuring.
- Experience with Flask / Flask-RESTful for API development.
- Knowledge and experience with Kafka.
Key Responsibilities:
- Develop and maintain a robust data processing architecture using Python.
- Design and manage data pipelines using Kafka and SQS.
- Optimize code for better performance and maintainability.
- Design and implement efficient ETL processes.
- Work with AWS technologies to ensure flexible and reliable data processing systems.
- Collaborate with colleagues, actively participate in code reviews, and improve technical knowledge.
- Take responsibility for your tasks and suggest improvements to processes and systems.
We offer:
- Working in a fast growing company;
- Great networking opportunities with international clients, challenging tasks;
- Personal and professional development opportunities;
- Competitive salary fixed in USD;
- Paid vacation and sick leaves;
- Flexible work schedule;
- Friendly working environment with minimal hierarchy;
- Team building activities, corporate events.