Big Data Senior/Lead Offline

DESCRIPTION

The client is a global healthcare ISV and one of the top Electronic Medical Record (EMR) vendors. They have a multi-year program to reimagine and re-platform their legacy application suite as a SaaS-based solution using modern technologies and frameworks deployed on AWS cloud.

Search system built with multiple modules and technologies during many years. Its SolR based deployment account for very high maintenance and operation costs. A redesign, merging the fragmented modules into a unified platform with low management costs, is planned.

RESPONSIBILITIES

Consulting on migrating the existing HARC MapReduce jobs to AWS EMR

Revisiting source and sinks, data enhancement opportunities (HBase load)

Assistance with migration

Architects understanding dev and prod environments, mapping out how to access production workflows for later operation

Implementation and support of new EMR-based jobs

REQUIREMENTS

Strong hands-on experience as a Big Data Software Engineer with a solid design/development background with Java, Scala, or Python

Experience of delivering data analytics projects and architecture guidelines

Experience in Big Data solutions on-premises and in the cloud (Amazon Web Services, Microsoft Azure, Google Cloud)

Production project experience with Big Data technologies: distributed file systems, Spark, Kafka, Hive, NoSQL (HBase, Cassandra, MongoDB), StreamSet/NiFi, Airflow/Oozie

Knowledge of Agile development methodology, Scrum in particular

Experience in direct customer communications and pre-selling of business-consulting engagements to clients within large enterprise environments

Strong communication skills

Intermediate or higher English level, both spoken and written (B1)