Senior Java on Spark Developer (offline)

Project Description:
Our client, top tier global investment bank, is building a new high-performance analytics platform with big data calculation engines and storage to aid in achieving its strategic goals.

The primary purpose of this platform is to calculate various trading analytics metrics in both real-time and batch modes to feed this data to trading systems and reporting dashboards for quantitative traders.
Responsibilities:
The candidate will develop high-performance calculation engine platform which processes huge volumes of data in streaming and batch modes as a part of a co-located team in Warsaw with close interaction with other teams over the globe.

- Analysis of existing systems to be replaced with new solution
- Design and architecture of the new platform
- Development of components to support existing functionality
- Creating components to implement new business demands
- Scalability and performance optimization
- Integration with various external data sources (Storm, JDBC, KDB+, websockets, REST services, flat files)
- Creating high-performance in-memory intermediate layer (Spark streaming, Redis)
- Organizing data logistics and processing (Kafka, Spark)
- Organizing efficient persistent data storage for reporting (HDFS, AVRO, parquet)
- Creating high-performance data processing engines both near real-time and batch (Spark, Spark Streaming)
Mandatory Skills:
Skills required:
- Java 8 (+Spring) 3+ years
- Spark, Spark Streaming 2+ years
- Kafka 1+ years
- Parquet, AVRO
- HDFS, Hive, Hbase, Impala
Nice-to-Have Skills:
Nice to have:
- Scala, Python
- Apache Storm
- JDBC, KDB+, websockets, REST
- Redis, in-memory storage

About Luxoft

Luxoft (NYSE:LXFT) is a global consulting partner that offers end-to-end digital solutions to solve clients’ complex business challenges.

We are a new class of digital service provider that combines consulting, strategy, and engineering at scale. We use this to drive business change by applying engineering excellence, deep domain expertise, and our senior software engineering talent to improve your client’s customer experience, boost your operational efficiency, and strengthen your competitive advantage.

We have expertise in automotive, financial services, healthcare, life sciences, telecommunications, and other industries. As a highly committed partner, we take customer challenges as our own. Our dedication stems from a passion for technology and a bespoke attention to your needs.

With over two decades of consistent, timely delivery and management of complex projects, we now serve over 280 active clients. With our headquarters in Zug, Switzerland and 42 global locations, we operate in 21 countries across five continents, providing you with robust global delivery platform. With about 12,700 employees, we have the best technology talent to support your business needs.

Company website:
http://luxoft.com