Middle Data Engineer from Poland Offline

The CHI Software team is not standing still. We love our job and give it one hundred percent of us! Every new project is a challenge that we face successfully. The only thing that can stop us is… Wait, it’s nothing! The number of projects is growing, and with them, our team too. And now we need Middle Data Engineer.

Banking and Finance.

Technical Requirements:

Must have: Fluent English. 3 years of experience as a Data Engineer, Knowledge of basic Big Data and Data Management concepts. Programming experience with Python, including data manipulation libraries: Pandas, and NumPy. Experience in GCP data projects, with emphasis on BigQuery and Cloud Composer/Airflow. Experience in data serialization formats: JSON, PARQUET, ORC, AVRO. Knowledge of SQL. Practical knowledge of DBT.

Knowledge of build tools:

pip/conda/wheel. Practical knowledge of version control and CI tools.

Nice to have:

Practical knowledge of Agile processes & tooling: Jira, Confluence, Kanban, Scrum, etc. Experience with Spark. Knowledge of Dataproc & Dataflow. Experience with streaming technologies e.g. Kafka.Knowledge of BigQuery SQL translation. Required Technical Skills PythonGCP (Google Cloud Platform) JSONGCP Cloud SQL pandas Numpy Preferred Technical Skills Spark Kafka Agile Scrum Main Responsibilities Migration of Teradata to Big Query. Migration of MCIF and PCR scripts. Implementation of CDEP mechanisms and OnDemand reports.Working closely with Business Analysts.

About the project:

The project is divided into 6 work streams. The main goal of this project is the migration of Teradata to BigQuery. It also includes migration of MCIF and PCR scripts, implementation of CDEP mechanisms, and OnDemand reports, while working closely with Business Analysts.