Lead Azure Data Engineer Offline

OLSYS Ltd provides full-service solutions for mid-market and enterprise organizations.

As an enterprise software development company, we are building long term partnerships helping our clients accelerate their digital experiences with reasonable IT investments.

Our tailored approach, e-commerce focus, and flexible solutions allow us to design, develop, and deliver scalable, integrated commerce platforms that drive profits and boost the business.

15+ years of experience, 100+ projects, 50+ specialists

Position summary: The overall objective of this position is to provide data engineering support and expertise to various projects. This position will coordinate with various internal and external stakeholders to ensure deliverables are consistent with company standards and security practices.

Primary Responsibilities

Design, build and maintain data pipelines using company standard technologies

Understand and be able to manage cloud-based data technologies and applications

Assist with renovating the data management infrastructure to drive automation in data integration and management

Work with data architects and data services team members to refine data requirements for various data and analytics initiatives

Develop data ingestion, preparation and integration code

Create algorithms to convert data into actionable, useful information

Prepare refined data to be used by data scientists

Create clear and maintainable ETL code

Investigate ways to increase data reliability, efficiency, and quality

Enable advanced analytics, AI/machine learning and statistical methods

Collaborate well with business process experts, software engineers, QAs, delivery leads, product owners, and other relevant stakeholders 

Work with the Data Services team to follow and maintain company practices and security requirements in the data space

Job Requirements

Education

A bachelor’s degree in computer science, data science, information science or related field, or equivalent work experience.

Experience/Skills

Experience in data engineering or a related field

Advanced analytical skills and attention to detail

Able and willing to collaborate in a team environment and exercise independent judgment

Excellent verbal and written communication skills

Knowledge of analytic technologies including machine learning, AI and integration technologies

Good knowledge of Azure capabilities (Data Factory, Databricks, Data Lake, Azure Functions, etc.), SQL, Python, relational and non-relational Data Stores

Familiarity with data virtualization technologies

SAP experience helpful

Knowledge and experience using Azure DevOps or comparable tools for code and release management

Strong problem-solving skills and using innovation to find solutions

Experience in integrating complex processes and information strategies, and/or designing strategic metrics and scorecards.

Agricultural industry experience is desirable, but not required.