We are looking for Senior Java on Spark Developer

Project Description:
Our client, top tier global investment bank, is building a new high-performance analytics platform with big data processing engines and storage to aid in achieving its strategic goals.

The primary purpose of this platform is to calculate various trading analytics metrics in both real-time and batch modes to feed this data to trading systems and reporting dashboards for quantitative traders.
The candidate will develop high-performance calculation engine platform which processes huge volumes of data in streaming and batch modes as a part of a co-located team in Warsaw with close interaction with other teams over the globe.

- Analysis of existing systems to be replaced with new solution
- Design and architecture of the new platform
- Development of components to support existing functionality
- Creating components to implement new business demands
- Scalability and performance optimization
- Integration with various external data sources (Storm, JDBC, KDB+, websockets, REST services, flat files)
- Creating high-performance in-memory intermediate layer (Spark streaming, Redis)
- Organizing data logistics and processing (Kafka, Spark)
- Organizing efficient persistent data storage for reporting (HDFS, AVRO, parquet)
- Creating high-performance data processing engines both near real-time and batch (Spark, Spark Streaming)

Mandatory Skills:
- Java 8 (+Spring) 3+ years
- Spark, Spark Streaming 2+ years
- Kafka 1+ years
- Parquet, AVRO
- HDFS, Hive, HBase, Impala

Nice-to-Have Skills:
- Scala, Python
- Apache Storm
- JDBC, KDB+, websockets, REST
- Redis, in-memory storage

About Luxoft

Luxoft provides high-end business solutions to clients across the globe. With deep domain expertise in the finance, telecom, energy, automotive, travel and aviation industries, the company consistently goes beyond its clients’ expectations by bringing together technology, talent, innovation, and the highest quality standards.
Luxoft builds long-lasting partnerships with Boeing, IBM, Deutsche Bank, Harman, Avaya, Alstom, Sabre, Ford, Hotwire and many others by providing seasoned business and technology professionals who deliver high-quality solutions that fit the client’s needs.
We offer international delivery capabilities through our network of state-of-the-art delivery centers around the world. Luxoft`s customers benefit from the right mix of technology skills, industry knowledge, proprietary processes, methodologies, and a choice of engagement models.
Today, Luxoft is +10000 collaborators strong and present on 5 Continents, 16 Countries with 30 Offices and 27 Delivery Centers.
The Luxoft Kiev office opened in spring of 2005 and since then has expanded to become one of the key hubs for European clients.

Company website:

DOU company page:

This job is no longer active.
Смотреть актуальные вакансии Java Kyiv→.

Similar jobs

Senior Java Developer at Argument

Kyiv, remote, 3 years or more

Senior Java Developer (OMC) at Luxoft

Kyiv, 3 years or more

Senior Java Developer [IE] at Luxoft

Kyiv, 3 years or more

Senior Java Developer +Python 1831/29 at Argument

Kyiv, 3 years or more

Java Team Lead at Luxoft

Kyiv, 3 years or more