Senior Big Data engineer (Java AND Hadoop AND Spark AND Python) Offline

The team supports Product data for the Company Analytical Platform. The main goal is to organize all data related tasks across the domain: allocation, transferring, processing and storage.

Also, a candidate must be ready for periodical 12 hours of on-call support.

Responsibilities:

-implement new features

-bugfix existing features

-refactor existing code

-improve test coverage

-build and ship product artifacts to dev/prod cluster

Mandatory Skills:

MUST

Java

Hadoop

Spark

SHOULD

HDFS

Hive

Kafka or any other messaging system

Docker

AWS

Shell script

Python

Yarn

Apache Ranger

EMR

Dynamo DB

Kubernetes

DevOps skills

Terraform

Nice-to-Have Skills:

Golang

Apache Atlas

Apache Knox

Okta

GitLab CI/CD

Disaster Recovery

New Relic

Splunk

Pagerduty