Python Developer (BIG DATA) (offline)

About Exadel:
Since 1998 Exadel has been engineering its own software products and custom software for clients of all sizes. Headquartered in Walnut Creek, California, Exadel currently has 1000+ employees in development centers across America, Europe and Asia.

About the Customer:
The сustomer is a leading provider of vehicle lifecycle solutions, enabling the companies that build, insure, repair, and replace vehicles to power the next generation of transportation. The company delivers advanced mobile, artificial intelligence, and connected car technologies through its platform, connecting a vibrant network of 350+ insurance companies, 24,000+ repair facilities, OEMs, hundreds of parts suppliers, and dozens of third-party data and service providers. The customer’s collective set of solutions inform decision-making, enhance productivity, and help clients deliver faster and better experiences for end consumers.

The сustomer’s company was ranked #17 in the Top 100 Digital Companies in Chicago in 2020 by Built in Chicago, an online community for digital technology entrepreneurs in Chicago, and was named one of Forbes best mid-sized companies to work for in 2019 – an important accolade and retention tool for the 2,600+ full-time company employees (alongside 350 dedicated contractors).

The сompany’s corporate headquarters is in downtown Chicago in the historic Merchandise Mart — a certified LEED (Leadership in Energy and Environmental Design) building that is also known to be a technology hub within the broader metro.

About the Project:
The customer has been working on an analytics platform since 2018. The platform is on Hadoop and the Hortonworks Data Platform, and the customer is planning on moving it to Amazon EMR in 2021. The customer has a variety of products, the data for all of which comes into one data lake on this analytics platform, which also allows the customer to do next generation analytics on the amassed data.

Must Have Qualifications:
- Proficiency in Python
- 1.5+ years experience building, maintaining, and supporting complex data flows with structural and unstructural data
- Experience working with distributed applications
- Ability to use SQL for data profiling and data validation
- Master’s or Bachelor’s degree

Nice to have (If no such experience we expect the candidate to be willing to learn or having experience with similar tools, because these tools are a part of the project ecosystem):
- PySpark
- Hands-on experience working with HDFS / or HIVE / or SQOOP
- Understanding of AWS ecosystem and services such as EMR and S3
- Familiarity with Apache Kafka and Apache Airflow
- Experience in Unix commands and scripting
- Experience and understanding of Continuous Integration and Continuous Delivery (CI/CD)
- Understanding in performance tuning in distributed computing environment (such as Hadoop cluster or EMR)

Responsibilities:
- Build end-to-end data flows from sources to fully curated and enhanced data sets. This can include the effort to locate and analyze source data, create data flows to extract, profile, and store ingested data, define and build data cleansing and imputation, map to a common data model, transform to satisfy business rules and statistical computations, and validate data content
- Modify, maintain, and support existing data pipelines to provide business continuity and fulfill product enhancement requests
- Provide technical expertise to diagnose errors from production support teams
- Coordinate within on-site teams as well as work seamlessly with the US team
- An ideal candidate will develop and maintain exceptional SQL code bases and expand our capability through Python scripting

English level: Intermediate

Advantages of Working with Exadel:
- WELCOME BONUS $4000
- You’ll build your expertise with Sales Support, which provides assistance with existing and potential projects
- You can join any Exadel community or create your own to communicate with like-minded colleagues
- There are opportunities for continuing education as a mentor or speaker
- You can take part in internal and external meetups as a speaker or listener
- You’ll have the chance to improve your English skills with the help of native speakers
- We participate in cultural, sport, charity, and entertainment events, and we’d love to have you there, too!

About Sunvery

Sunvery is an agency of dedicated professionals. We care about all small details in the recruitment process to save time of the client and create the best candidate’s experience. Working with us you will feel all the advantages of having business with people that love what they do. It is our job to help you.
Let’s get to know each other to do more and achieve better results.

Company website:
http://sunvery.com.ua/

DOU company page:
https://jobs.dou.ua/companies/sunvery/