Senior Java on Spark Developer (offline)
The primary purpose of this platform is to calculate various trading analytics metrics in both real-time and batch modes to feed this data to trading systems and reporting dashboards for quantitative traders.
Responsibilities:
The candidate will develop high-performance calculation engine platform which processes huge volumes of data in streaming and batch modes as a part of a co-located team in Warsaw with close interaction with other teams over the globe.
- Analysis of existing systems to be replaced with new solution
- Design and architecture of the new platform
- Development of components to support existing functionality
- Creating components to implement new business demands
- Scalability and performance optimization
- Integration with various external data sources (Storm, JDBC, KDB+, websockets, REST services, flat files)
- Creating high-performance in-memory intermediate layer (Spark streaming, Redis)
- Organizing data logistics and processing (Kafka, Spark)
- Organizing efficient persistent data storage for reporting (HDFS, AVRO, parquet)
- Creating high-performance data processing engines both near real-time and batch (Spark, Spark Streaming)
Mandatory Skills:
Skills required:
- Java 8 (+Spring) 3+ years
- Spark, Spark Streaming 2+ years
- Kafka 1+ years
- Parquet, AVRO
- HDFS, Hive, HBase, Impala
Nice-to-Have Skills:
Nice to have:
- Scala, Python
- Apache Storm
- JDBC, KDB+, websockets, REST
- Redis, in-memory storage
About Luxoft
Luxoft is a high-end application outsourcing provider of choice and a trusted technology advisor to Global 2000 and medium-sized growth companies that apply compelling technologies to obtain leadership positions in their respective markets.Luxoft today finds the Best talents, proposes career growth & employment benefits. Our teams are involved in high complicity & innovative projects for the Top leaders companies around the Globe.
Company website:
https://career.luxoft.com/locations/ukraine/
DOU company page:
https://jobs.dou.ua/companies/luxoft/
The job ad is no longer active
Look at the current jobs Java Kyiv→
Similar jobs
Full stack Java Developer at Telesens
Ukraine
Java Developer (Support) at Beetroot
Ukraine
Java Developer (Middle) на UAV проект, що потрібний ЗСУ at MPS Development
Ukraine $2100-3000
All jobs Java Kyiv All jobs Luxoft