Data Engineer (offline)

Responsibilities

- Take part in building new Data Platform
- Design and develop Data Pipeline processes for the Data Architecture lifecycle
- Collaborate and work alongside with Data Architects, Data Engineer, Data Analysts and other teammates
- Troubleshoot data issues and performance tuning of Spark jobs
- Maintain and support existing report and data products
- Be up to date on various data processing, storage, analysis and reporting tools, their possibilities and limitations

Requirements

- Good knowledge of Python or\and Scala
- Good knowledge of SQL
- Good understanding and experience with Apache Spark (or Databricks/AWS Glue/AWS EMR)
- Strong Experience with ETL and Data Pipelines
- Experience and knowledge of Data Lakes and DWH concepts
- Good working knowledge of AWS (S3, Glue, Athena)