Data Engineer

Responsibilities: 

• Design, develop, and maintain end-to-end data pipelines using Azure Data Factory, Azure  Databricks, Azure Event Hub, Al Foundry and related services. 
• Build and optimize PySpark  jobs to process large-scale data, including video, image, and text (JSON, HTML) datasets. 
• Implement event-driven data architectures to support real-time and near-real- time data processing use cases. 
• Develop solutions for parsing and extracting meaningful insights from unstructured data sources such as media files and web content leveraging Azure Al Foundry. 
• Manage and optimize data storage solutions (e.g., Azure Data Lake, Blob Storage). 
• Collaborate with data scientists, analysts, and product teams to enable downstream analytics and machine learning workflows. 

• Ensure data quality, security, and compliance across all stages of data processing. Monitor, troubleshoot, and improve the performance of data systems in production environments. 

   

Must-Have: 

• +5 years of experience as a Data Engineer. 
• Strong proficiency in Azure Data Services, including: 
• Azure Data Factory (ADF) 
• Azure Databricks 
• Azure Event Hub / Service Bus 
• Azure Functions 
• Al Foundry 
• Advanced experience with PySpark for large-scale data processing. 
• Proven experience handling multimedia data types (videos, images) and unstructured text (HTML, JSON, XML). 
• Solid understanding of event-driven architecture and streaming data pipelines. 
• Strong skills in  Python and SQL. 
• Familiarity with CI/CD pipelines and version control tools (e.g., Git, Azure DevOps) 

Nice to Have: 

• Exposure to machine learning workflows with media data. Knowledge of data governance and security best practices. 
• Basic knowledge of dashboarding and reporting tools (e.g., Streamlit, Power BI)

We offer:

• IT Club membership
• 18 days of vacation + 8 days of paid state holidays
• Health insurance
• Compensation for language trainings 
• Compensation for educational courses, training, and certificates
• Compensation for sport activities
• Mentorship program
• Employee recognition program with awards
• Running club
• Reading club
• Cozy and pet-friendly office
• Weekly sweets & fruits office days
• Corporate bookshelf
• Office relax zone with PS4, VR, table games, table tennis, aero hockey, mini football table.

Are you interested? We would be glad to receive your CV.