Big Data Engineer (Hadoop) (IRC73431) Offline

Customer owns the evolving purchase history of more than three-quarters (280 million) of American shoppers. With the world’s largest shopper purchase history database driving personalized media across our networks, they drives lift and loyalty for the world’s leading retailers and CPG brands.

Requirements

- 4+ years in working with Enterprise Data Warehouse technologies including:

- Multi-Dimensional Data Modeling, Data Architectures or other work related to the construction of enterprise data assets

- Strong Experience implementing ETL processes and building data pipelines

- Experience with Big Data frameworks such as Hadoop

- Knowledge of Apache Nifi, SOLR

Preferences

- Experience building stream-processing systems, using solutions such as Apache Spark, Kafka etc...

- Experience tuning Hadoop/Spark parameters to improve performance

- Experience with Big Data querying tools

- Data modeling

Responsibilities

- Develop, and manage large scale data systems and ingestion capabilities and infrastructure

- Support Design and development of solutions for the deployment of dashboards and reports to various stakeholders

- Work directly with the business teams to rapidly prototype analytics solutions based upon business requirements

- Design and maintain enterprise data warehouse models

- Tune and improve the performance of reporting solutions

- Manage cloud based data & analytics platform