Python Data Engineer

➤ Tech stack: Python, Java, PostgreSQL, C#, Scala, SQL, Data

➤ Expected rate: TBD

➤ Domain expertise:

➤ Location: remote

➤ Expected date: ASAP

➤ Duration: Long-term

➤ Expiration: ASAP

➤ Description:

Requirements:

- University degree in Computer Science or equivalent experience

- Strong analytical and problem-solving skills

- Data Engineering working experience, ideally with Python

- Willingness to learn new technologies

- Experience with big data technology stack, for example, (Py-)Spark, Delta Tables, etc.

- 5+ years of experience with general-purpose languages such as C#, Python, Java, Scala etc

- Fluency in SQL and relational DB systems (PostgreSQL, SQL Server)

Nice:

- Experience with data warehousing, infrastructure, ETL/ ELT and analytic tools such as Azure Synapse or Databricks

- Experience with multiple Big Data file formats (Parquet, Avro, Delta Lake)

- Experience with time-series databases and streaming data processing

- Proficiency with PySpark

- Proficiency with .Net

- Experience setting up MLOps processes and a machine learning model registry

- Experience with CI/CD pipelines on Gitlab

- Some experience with Terraform and k8s