We’re looking for a Big Data engineer who will work on building new parts of scalable Data Lake and expand the existing ones based on cutting edge technologies (Spark, Hadoop, Databricks).

About the vacancy

Our client is a New York City-based FinTech startup that is building a trading and risk software platform for the investment banking industry to sell as a service.

We’re looking for a Big Data engineer who will work on building new parts of scalable Data Lake and expand the existing ones based on cutting edge technologies (Spark, Hadoop, Databricks). The Data Lake is used by quantum analysts for ad hoc queries and by data scientists to build models for predicting investment opportunities. Data enters the Data Lake using ETL ingestion pipelines implemented with Apache Airflow. The specialist will join a distributed team on DataArt’s side that consists of 30 people from Ukraine, Russia, Poland, and the US.

Must have
- Excellent knowledge of the general principles of Big Data
- Experience with distributed systems
- Excellent knowledge of Spark (Core, SQL, Streaming)
- Excellent knowledge of Java, Scala, or Python
- Experience with AWS or other cloud providers
- Experience with Big Data solutions
- Good spoken English

Would be a plus
- Knowledge of Kafka
- Knowledge of Apache Airflow
- Infrastructure management (DevOps)
- Knowledge of PySpark
- Knowledge of Databricks
- Experience with Kubernetes

Learn more about our policy of equal opportunities in employment

About DataArt

DataArt с 1997 года проектирует, разрабатывает, модернизирует и поддерживает IT-решения в области финансов, здравоохранения, телекома, туризма, медиа и интернета вещей.

Клиенты DataArt — компании с уникальными бизнес-моделями — находятся в США и Великобритании, а распределенные команды специалистов — в центрах разработки в России, Украине, Польше, Аргентине и Болгарии.

Company website:
https://dataart.ua

DOU company page:
https://jobs.dou.ua/companies/dataart/

Job posted on 7 April 2021
1 view    0 responses


Для отклика на эту и другие вакансии на Джинне войдите или зарегистрируйтесь.