Middle Data Engineer

Our client is a private investment company based in the United States, specializing in agriculture and food-related investments. The main idea behind the product that we are developing is to boost the agricultural industry by providing farming companies with a comprehensive Business Intelligence tool. This solution will empower them to acquire, analyze, and visualize data related to Agricultural areas, driving informed decision-making and maximizing revenue potential.

Requirements:

• 3+ years of development experience with Python using FastAPI or similar web frameworks.
• Passion for continuous learning and sharing knowledge with others, great communication skills.
• Strong debugging skills.
• Good understanding of all parts of the web application stack.
• Experience with Pandas/Pyarrow.
• Experience with RDBMS (preferably Postgres).
• Experience working with microservices architecture.
• Strong experience with data processing techniques and tools.
• Experience with ETL pipelines.

• Experience with Apache Spark/Delta Lake or similar tools Airflow orchestrator experience.

   

Nice to have:

• AWS EMR/SNS/SQS, Docker.
• Experience with Apache Airflow building out workflow DAGs and scheduling jobs.
• Experience with OAuth.
• Some UI development skills might be useful later on in a project (Dash).

• Experience with NoSQL databases (DynamoDB, Redis).

   

Responsibilities:

Build the Back-End part of the web application and build automated ETL pipelines.

We offer:

• Annual paid vacation of 18 working days.
• Extra vacation days for long-lasting cooperation.
• Annual paid sick leave of 10 days.
• Maternity/Paternity leave.
• The opportunity for sabbatical leave.
• Marriage and Parenthood Package.
• Compensation for sports activities (up to 250$ per year) or health insurance covering (70%) — after the trial period.
• Internal education(corporate library, Udemy courses).
• Career development plan.
• English and Spanish classes.
• Paying taxes and managing PE (Private Entrepreneur).
• Technical equipment.
• Internal Referral program.
• Opportunity to take part in company volunteering activities.
• Sombra is a “Friendly to Veterans” award-holder.`
  
  If you believe you are a suitable candidate for this position, please attach your updated resume using the provided link.
  Our recruitment team will review your profile, and if it aligns with our current job openings, we will contact you shortly. If you don’t receive a reply from us within 5 business days, it means we have decided to move forward with other candidates.
  Thank you for understanding.