Commit Offshore

Python Data Engineer

Core Responsibilities

 • Data Pipeline Management: Develop, optimize, and maintain scalable data pipelines to ensure high-quality data flow. 

• API Development: Build and maintain high-performance backend APIs using FastAPI. 

• System Reliability: Proactively identify bottlenecks and improve system stability within existing infrastructures.

 • Collaboration: Work closely with cross-functional teams to integrate AWS services and workflow orchestration tools into the production environment.

 

Required Qualifications 

• Experience: 3+ years of professional Python development experience. 

• Databases: Strong proficiency in both SQL and NoSQL database design and management. 

• DevOps Tools: Hands-on experience with Docker, CI/CD pipelines, and Git version control. 

• Frameworks: Proven experience building applications with FastAPI.

• Cloud & Orchestration: Practical experience with AWS services and familiarity with Airflow (or similar workflow orchestration tools). 

• Communication: Upper-Intermediate level of English (written and spoken) for effective team collaboration. 

 

 Preferred Skills (Nice to Have) 

• Experience within the Financial Domain. 

• Hands-on experience with Apache Spark and complex ETL pipelines.

• Knowledge of container orchestration using Kubernetes. 

• Exposure to or interest in Large Language Models (LLMs) and AI integration.

Required languages

English B2 - Upper Intermediate
Python, SQL and NoSQL, Docker, CI/CD, FastAPI, Airflow, AWS
Published 3 February
50 views
·
23 applications
34% read
To apply for this and other jobs on Djinni login or signup.
Loading...