Senior Data Engineer (offline)

We are looking for a Senior Data Engineer/Architect to initiate, manage and automate our routines to gather (un)structured data from several different data sources and load it into our cloud-based Data Warehouse.

You will work within our Business Intelligence team, which consists of Data Engineers, Data Scientist and Data Analysts. Furthermore, you will work closely with other IT departments to ensure the operation of our data warehouse. Our Data Engineers work with the latest technologies to build our Data Warehouse as the single point of truth for the company.

THESE EXPERIENCES ARE COMING TOWARDS YOU

- Develop big data ETL pipelines with Python and Spark (Pyspark) in an agile environment
- Connect a variety of data sources (SAP-HANA, Google, (non)relational databases, Kafka Stream etc.) and integrate it into our cloud based DataLake (Microsoft Azure)
- Work closely with the product owner and design the data model to match their needs for sourced tables and structured Datamart's)
- Make sure the Data Warehouse keeps its data integrity and availability

YOU BRING THESE QUALITIES WITH YOU

- University degree in economics with a technical focus, business informatics or any other related area of study
- 3 years of working experience in the data and business intelligence field
- Very good Python knowledge
- Solid experience with Apache Spark and big data
- Experience in agile software development (Git, Jira, Jenkins CI)
- Know-how of the latest toolsets on Data integration, storage and modelling in the context of Data Warehouse and Data Lake (preferably Databricks, Kafka Streaming, Airflow)
- Sound understanding of distributed systems

Required skills

Data Engineering - 4 years
Python - 3 years
Experience in Apache Spark
Experience in Big Data
Experience in Git
Experience in Jira
Experience in Jenkins
Experience in Data modelling
Experience in Data integration
Experience in Dat storage
Experience in Data Warehouse
Experience in Data Lake
Experience in Databricks
Experience in Kafka Streaming
Experience in Airflow

Why join the K&C team and this project?

- German IT Company with HQ in Munich
- 20+ years in Europe
- Competitive compensation;
- Talented team without hierarchies
- 20 workdays of vacation per year, 15 days of paid sick leave;
- Fulltime remote work possible; as is being based in one of our offices in Kyiv, Krakow, Baku, and Sofia, if you prefer an office environment or hybrid
flexible working schedule.

About Krusche&Company

K&C is an international software development company with 90+ experts on board in Munich (HQ) Kiev, Krakow, Prague and Sofia offices, that provides consulting and direct services for the complex IT-Projects of major European clients such as Commerzbank, Nestle, Bosch, Raiffeisen, METRO, DER Touristik, Lufthansa and others.

At K&C we work with different projects — websites, portals, platforms, mobile (iOS, Android), intranet-systems. The combination of our expertise in cutting-edge technologies, 15 years’ collaborative experience with leading European clients and a friendly and productive work environment has enabled us to turn traditional IT outsourcing into a reliable and competitive product.

Company website:
https://kruschecompany.com/

DOU company page:
https://jobs.dou.ua/companies/kruschecompany/