Big Data Engineer (offline)
Requirements
• Scala, Java, Python or functional language for batch, streaming real-time processing
• Advanced knowledge of Kafka
• Flink, Spark or similar framework
• Reliability Support experience for on-premise solutions
• Understanding how to scale and balance streaming engines
• Experience building post-processing engines
• Azure Cloud is a plus
Scope of Work
Advanced knowledge of Kafka is a must. Making sure that buffered data is resilient and is being consumed properly under limited connectivity conditions. Good knowledge on how to run the stream, batch processing with functional languages and frameworks like Spark, Flink or similar. Developing scripts to post-process and accumulate data in Kafka for future use.
Other
* Product
* Ongoing 6+ months contract
* Full-time Remote
* Possibility to relocate to Singapore
* Top-Notch team
• Scala, Java, Python or functional language for batch, streaming real-time processing
• Advanced knowledge of Kafka
• Flink, Spark or similar framework
• Reliability Support experience for on-premise solutions
• Understanding how to scale and balance streaming engines
• Experience building post-processing engines
• Azure Cloud is a plus
Scope of Work
Advanced knowledge of Kafka is a must. Making sure that buffered data is resilient and is being consumed properly under limited connectivity conditions. Good knowledge on how to run the stream, batch processing with functional languages and frameworks like Spark, Flink or similar. Developing scripts to post-process and accumulate data in Kafka for future use.
Other
* Product
* Ongoing 6+ months contract
* Full-time Remote
* Possibility to relocate to Singapore
* Top-Notch team
The job ad is no longer active
Job unpublished on
10 June 2020
Look at the current jobs Scala Remote→
Average salary range of similar jobs in
analytics →