Middle/Senior BigData Engineer (offline)

Client and Project Overview:
Our client is a US company that is specializing in delivering reliable Internet connectivity and entertainment multimedia to aircrafts worldwide, enhancing the experience for both passengers and crew. We are cooperating with the Business Intelligence, Data Analysis and BigData directions and looking for talents who can contribute to the complex data management and analysis projects. We are looking for engineer to join our BigData team and improve his/her AWS BigData skills.


Responsibilities:
- Develop and support existing end-to-end data AWS based Big Data solutions for structured and unstructured data including, but not limited to, ingestion, parsing, integration, auditing, logging, aggregation, normalization, and error handling
- Create jobs and queries to perform auditing and error handling
- Develop PySpark and Scala Spark pipelines


Requirements:
- Experience in Python or Scala
- Experience in SQL
- Experience in Linux
- Good understanding of software development methodologies
- Being result-oriented, ability to make things done in a highly dynamic and stressful environment
- Good communication skills and good English

Nice to have:
- Apache Spark including an understanding of optimization techniques
- Knowledge of Hadoop architecture
- Experience in working with AWS (S3, EMR cluster, Lambda, Kinesis, DynamoDB, etc.)

We offer:
- Flexible working hours​
​- A competitive salary and good compensation package
​- The Best hardware
- ​A masseur and a corporate doctor
​- Healthcare & sport benefits
​- An inspiring and comfy office

Professional growth:
- ​Challenging tasks and innovative projects
​- Meetups and events for professional development
​- An individual development plan
​- Mentorship program

Fun:
​- Corporate events and outstanding parties
- ​Exciting team buildings
​- Memorable anniversary presents
​- A fun zone where you can play video games, foosball, ping pong, and more

The job ad is no longer active
Job unpublished on 21 February 2022

Look at the current jobs Python Kyiv→