Looking for Data engineer intern
As a part of data migration into Azure Cloud - extract data from Oracle Hive cluster, convert into Parquet format and load to the Azure Blob Storage.
Utilize Spark for further data manipulations and analysis in a distributed manner.
• Take part in designing data and analytics architectures in Microsoft Azure cloud;
Use Big Data technologies like Spark, Hadoop, Hive, HBase, Kafka etc.;
•data warehousing, data ingestion, and data profiling;•
Preferable knowledge of programming languages such as Python, Scala, Java,
•teamwork, strong communication skills, and collaborative in complex engineering projects.
Mandatory Skills Description:
Python, Scala, Apache HBase, Apache Kafka, Hadoop, Hive QL, Java, Kafka streams
Nice-to-Have Skills: Big Data
Luxoft is a high-end application outsourcing provider of choice and a trusted technology advisor to Global 2000 and medium-sized growth companies that apply compelling technologies to obtain leadership positions in their respective markets.
Luxoft today finds the Best talents, proposes career growth & employment benefits. Our teams are involved in high complicity & innovative projects for the Top leaders companies around the Globe.
DOU company page:
Job posted on
5 June 2021