Data Engineer (Python Databricks)
We are seeking a talented and experienced Data Engineer to work on innovative projects in the field of Generative AI (GEN AI) aimed at optimizing internal business processes and increasing efficiency for clients.
Our team implements solutions that deliver significant business value and help scale the company's capabilities.
The product we develop is an application designed to facilitate and automate internal cooperation processes, enhancing clients' productivity, efficiency, and data security.
Our teams consist of: Technical Delivery Manager, Business Systems Analyst, Application Architect, Developers (dedicated FE and BE), QA Engineers and Designers.
Requirements:
- 1+ years of proven experience with Databricks;
- 2+ years of experience with Python;
- Experience with Spark, SQL, Delta Lake;
- Cloud: Knowledge of Azure, AWS, or GCP;
- Excellent problem-solving skills and attention to detail;
- Knowledge of frameworks and libraries such as Pandas, NumPy etc.;
- Familiarity with agile development methodologies, such as Scrum or Kanban;
- Familiarity with Vector databases;
- Understanding of machine learning concepts, NLP, and AI/LLM;
- Experience working with other AI and NLP technologies, such as OpenAI's GPT family, Azure OpenAI or related;
- Experience in building and deploying solutions using AI/LLM, including RAG;
- Experience in building, training, and deploying machine learning models;
- Familiarity with NoSQL databases;
- Strong verbal and written communication skills.
Nice to have:
- Experience with Databricks ML Flow models;
- Data Warehousing: Experience with platforms like Snowflake or Redshift;
- Big Data: Familiarity with tools like Hadoop, Kafka;
- Optimization: Ability to optimize performance in big data systems;
- ETL: Expertise in building and optimizing data pipelines;
- Data Pipeline Development: Proven experience in designing and managing ETL processes.
Responsibilities:
- Develop and maintain Web applications using Python, with a focus on integrating AI/LLM;
- Collaborate with cross-functional teams to define, design, and ship new features and enhancements;
- Optimize applications for maximum performance, scalability, and maintainability;
- Troubleshoot, debug, and resolve software defects and issues;
- Keep up to date with the latest industry trends and technologies to ensure the software is current and competitive;
- Provide technical guidance and support to other team members;
- Write clean, maintainable, and well-documented code;
Participate in code reviews and contribute to improving code quality.
What we offer:
- Paid training programs and English/Spanish language courses;
- Medical insurance, sports program compensation and other benefits compensation program, which can be selected by each employee according to their personal preferences;
- Comfortable working hours;
- Awesome team events and a wide variety of knowledge sharing opportunities.
To learn more about how we collect, process, and store your personal data, please review our Privacy Notice.[https://www.trinetix.com/corporate-policies/privacy-notice]