Senior Big Data Engineer, Financial Software Solutions (offline)

About the vacancy

Our client is a New York City-based FinTech startup that is building a trading and risk software platform for the investment banking industry to sell as a service.

We’re looking for a Big Data engineer who will work on building new parts of scalable Data Lake and expand the existing ones based on cutting edge technologies (Spark, Hadoop, Databricks). The Data Lake is used by quantum analysts for ad hoc queries and by data scientists to build models for predicting investment opportunities. Data enters the Data Lake using ETL ingestion pipelines implemented with Apache Airflow. The specialist will join a distributed team on DataArt’s side that consists of 30 people from Ukraine, Russia, Poland, and the US.

Must have
- Excellent knowledge of the general principles of Big Data
- Experience with distributed systems
- Excellent knowledge of Spark (Core, SQL, Streaming)
- Excellent knowledge of Java, Scala, or Python
- Experience with AWS or other cloud providers
- Experience with Big Data solutions
- Good spoken English

Would be a plus
- Knowledge of Kafka
- Knowledge of Apache Airflow
- Infrastructure management (DevOps)
- Knowledge of PySpark
- Knowledge of Databricks
- Experience with Kubernetes

Learn more about our policy of equal opportunities in employment

About DataArt

DataArt is a global software engineering firm. With over 20 years of experience, teams of highly-trained engineers around the world, deep industry sector knowledge, and ongoing technology research, we help clients create custom software that improves their operations and opens new markets. DataArt started out as a company of friends and has a special culture that distinguishes it from other IT outsourcers, such as:
- Flat structure. There are no “bosses” and “subordinates”.
- We hire people not to a project, but to the company. If the project (or your work in it) is over, you go to another project or to a paid “Idle”.
- Flexible schedule, ability to change projects, to work from home, to try yourself in different roles.
- Minimal bureaucracy and micromanagement, convenient corporate services

Company website:
https://dataart.ua

DOU company page:
https://jobs.dou.ua/companies/dataart/