Data Engineer/Data Architect

As a Senior Data Engineer/Data Architect, you will play a pivotal role in designing, implementing, and optimizing data platforms for our clients. Your primary responsibilities will revolve around data modeling, ETL development, and platform optimization, leveraging technologies such as DataBricks, Spark, using Python and various cloud-based solutions.

Key Responsibilities:

β€’ Design, develop, and maintain ETL pipelines for ingesting and transforming data from diverse sources.
β€’ Collaborate with cross-functional teams to ensure seamless deployment and integration of data solutions.
β€’ Lead efforts in performance tuning and query optimization to enhance data processing efficiency.
β€’ Provide expertise in data modeling and database design to ensure scalability and reliability of data platforms.
β€’ Contribute to the development of best practices and standards for data engineering processes.
β€’ Stay updated on emerging technologies and trends in the data engineering landscape.
Required Skills and Qualifications:
β€’ Bachelor's Degree in Computer Science or related field.
β€’ Minimum of 5 years of experience in data engineering and architecture roles.
β€’ Proficiency in Python and PySpark for ETL development and data processing.
β€’ AWS CLOUD at least 2 years
β€’ Extensive experience with cloud-based data platforms, particularly Databricks.
β€’ Familiarity with Big Data technologies including Hadoop, Hive
β€’ Must have knowledge with Spark.
β€’ Excellent problem-solving skills and ability to work effectively in a collaborative team environment.
β€’ Leadership experience, with a proven track record of leading data engineering teams.

About ITSoft.co.il

ITSOFT is a leading IT staff augmentation, outstaffing company created to help the businesses scale up the teams fast and get the reliable remote developers within a short period. We perform a rigorous screening and recruitment process to augment your team with only experienced, reliable and talented engineers. Commit Offshore by ITSOFT is a part of COMMIT which is a largest IT powerhouse based in Israel and US.

Company website:
https://www.itsoft.co.il/

DOU company page:
https://jobs.dou.ua/companies/itsoft/
Job posted on 9 April 2024
99 views    26 applications

To apply for this and other jobs on Djinni login or signup.