Hadoop senior developer (offline)

Обязанности:
• Work closely with system architects and distributed computing engineers and reporting/data warehouse developers to create and optimize the architecture of the streaming data pipeline
• Design and build the streaming data pipeline to transform, aggregate and store the data
• Always angle for greater efficiency and robustness of the pipeline to support a big volume of the data stream

Требования:

• Graduate degree in Computer Science, Information Systems or equivalent quantitative field and 5+ years of experience in a similar Data Engineer role.
• Demonstrated ability to build processes that support data stream consumption, data transformation, data structures, metadata, dependency and workload management
• Strong interpersonal skills and ability to project manage and work with cross-functional teams
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience with the following tools and technologies:
• Major Hadoop ecosystem distributions such as HDP, Cloudera, etc. HDP is preferred
• Public cloud such as Azure, AWS, etc. Azure is preferred
• JSON document processing
• Apache Hive and HBase
• Apache Kafka
• Stream-processing systems such as Storm and Spark-Streaming
• Object-oriented/object function scripting languages such as Python, Java, etc.

We offer:

Competitive salary and bonus system benefits package;
20 working days paid vacation, 100% paid sick leave and other social benefits;
Excellent opportunities for professional growth and development;
Dynamic work in a friendly and professional team;
Interesting and unusual tasks within projects;
Comfortable working conditions, flexible working hours, convenient office location;
Regular business — trips.

About Emergn

We are Emergn. Our mission is to improve the way people and companies work. Forever.

We're a leading expert in digital transformation. We are privileged to work with some of the world’s most iconic companies. We help them to be disruptive in their markets, create new growth channels, and build better ways to work. We inspire change in Enterprise teams to continuously deliver better products, services, and customer experiences.

We’re passionate about improving the way people work and motivated by an ambition to help businesses innovate. We lean on deep, proven and practical expertise in consulting, delivery, and education to empower transformation from the inside out. Agile is in our DNA. At our core, we’ve created work-based learning and consulting products that focus on outcomes, enabling our clients to accelerate their objectives and makes it easier to implement lasting change from the ground up.

Company website:
https://www.emergn.com/

DOU company page:
https://jobs.dou.ua/companies/emergn/