Error
Senior Data Engineer (offline)
About the Role:
At thredUP, we live a true data driven culture with an ever growing appetite for data and a mindset to generate insights and make informed business decisions. In this role, you will shape the roadmap for the next generation of data-platform that is easy to use, elastic and cost efficient. This platform should make it easy for data engineers to build batch and streaming pipelines as well as make it easy to interact with the data for the end consumers. Build a robust machine-learning platform to develop, test, and deploy machine learning models deployed for both batch and realtime use cases. Additionally, support the current technology stack and evaluate newer tools/technologies that reduce the support cost and provide improved productivity and experience.
You will interact in a highly collaborative environment of data engineers,data scientists, product managers, domain experts and business leaders to deliver data solutions.
Responsibilities:
Ideate and build the next generation product roadmap for the data platform team.
Own Airflow deployments, integration with Datadog and CI/CD.
Own the Mlflow machine learning platform and find alternatives or enhance it to support input data versioning and model deployment in A/B testing mode.
Build and evangelize reusable components for data pipelines.
Implement a solution to capture metadata and lineage.
Own the enterprise event bus solution.
Own the databricks environment.
Own and shape the feature store infrastructure and roadmap.
Be available for critical production support issues.
Requirements:
8+ years of experience in building scalable data platforms and tools.
Demonstrated experience in implementing Spark for data processing, both batch and streaming.
Demonstrated experience in implementing Kafka for real time data processing.
Demonstrated experience providing rest endpoints to expose data to other applications.
Experience integrating and supporting Databricks.
Working with noSQL stores like HBASE/DynamoDB.
Experience providing solutions to handle data privacy.
Experience in implementing machine learning platforms like MLFlow,Tensorflow, Sagemaker.
Experience in deploying Airflow as a scheduling tool.
Experience in implementing CI/CD pipelines using Jenkins.
Experience working with Kubernetes.
Experience working with Datadog.
Expert level using Python and PySpark.
Understanding with AWS Data technologies (such as Redshift, S3, Glue)
Experience with repositories like Git, nexus (pypi).
Bachelor's or Master’s degree in computer science, information systems, or a related technical discipline.
Excellent communication and problem solving skills.
Well organized and able to manage multiple projects in a fast-paced demanding environment
What We Offer:
High-competitive top market salary
The opportunity to make a massive impact & influence outcomes for our business and customers alongside passionate coworkers
Autonomy. The ability to make, own, and carry out decisions
Working within a modern tech stack
Flexible working hours (possibility to work from home on Tuesdays and Thursdays)
Uncounted paid vacations
Full-coverage medical insurance, free lunches on Wednesdays, English classes, etc.
Relocation assistance and cost coverage program for candidates from other countries and cities
At thredUP, we live a true data driven culture with an ever growing appetite for data and a mindset to generate insights and make informed business decisions. In this role, you will shape the roadmap for the next generation of data-platform that is easy to use, elastic and cost efficient. This platform should make it easy for data engineers to build batch and streaming pipelines as well as make it easy to interact with the data for the end consumers. Build a robust machine-learning platform to develop, test, and deploy machine learning models deployed for both batch and realtime use cases. Additionally, support the current technology stack and evaluate newer tools/technologies that reduce the support cost and provide improved productivity and experience.
You will interact in a highly collaborative environment of data engineers,data scientists, product managers, domain experts and business leaders to deliver data solutions.
Responsibilities:
Ideate and build the next generation product roadmap for the data platform team.
Own Airflow deployments, integration with Datadog and CI/CD.
Own the Mlflow machine learning platform and find alternatives or enhance it to support input data versioning and model deployment in A/B testing mode.
Build and evangelize reusable components for data pipelines.
Implement a solution to capture metadata and lineage.
Own the enterprise event bus solution.
Own the databricks environment.
Own and shape the feature store infrastructure and roadmap.
Be available for critical production support issues.
Requirements:
8+ years of experience in building scalable data platforms and tools.
Demonstrated experience in implementing Spark for data processing, both batch and streaming.
Demonstrated experience in implementing Kafka for real time data processing.
Demonstrated experience providing rest endpoints to expose data to other applications.
Experience integrating and supporting Databricks.
Working with noSQL stores like HBASE/DynamoDB.
Experience providing solutions to handle data privacy.
Experience in implementing machine learning platforms like MLFlow,Tensorflow, Sagemaker.
Experience in deploying Airflow as a scheduling tool.
Experience in implementing CI/CD pipelines using Jenkins.
Experience working with Kubernetes.
Experience working with Datadog.
Expert level using Python and PySpark.
Understanding with AWS Data technologies (such as Redshift, S3, Glue)
Experience with repositories like Git, nexus (pypi).
Bachelor's or Master’s degree in computer science, information systems, or a related technical discipline.
Excellent communication and problem solving skills.
Well organized and able to manage multiple projects in a fast-paced demanding environment
What We Offer:
High-competitive top market salary
The opportunity to make a massive impact & influence outcomes for our business and customers alongside passionate coworkers
Autonomy. The ability to make, own, and carry out decisions
Working within a modern tech stack
Flexible working hours (possibility to work from home on Tuesdays and Thursdays)
Uncounted paid vacations
Full-coverage medical insurance, free lunches on Wednesdays, English classes, etc.
Relocation assistance and cost coverage program for candidates from other countries and cities
About thredUP
ThredUP Inc. is the world’s largest online platform where you can buy and sell high-quality secondhand clothes. The company was founded in 2009 and the Head Office is based in Oakland, California.We are foremost a technology company and that`s reflected in everything we do. We love solving hard problems with the software. We think world-class technology drives long-term competitive advantage. We`re hiring software engineers, industrial engineers, and data scientists so we can make the best data-driven decisions over and over again.
We believe deeply that happy, personally fulfilled employees are the best ones. That means we do things a little differently around here to make sure you`re always engaged, fresh and firedUP.
Who We Are
A growing team of 70+ engineers.
What We Use
AWS, Kubernetes, Ruby, NodeJS, Redis, MySQL, MongoDB, RabbitMQ
LANGUAGES AND FRAMEWORKS:
APIs and Services - NodeJS, Ruby on Rails, Frontend, ReactJS and Redux
Data Engineering - Java, Scala, Python
Common Tools - Docker, Newrelic, Scalyr
DevOps Tools - Terraform, Jenkins, DataDog, Ansible, PagerDuty
We will be glad to see you as a part of our happy team!
Company website:
http://www.thredup.com
DOU company page:
https://jobs.dou.ua/companies/thredup-inc/
The job ad is no longer active
Job unpublished on
30 October 2020
Look at the current jobs Python Kyiv→
Average salary range of similar jobs in
analytics →
Similar jobs
Ukraine
Senior Python Developer at Luxoft
Ukraine
Ukraine
All jobs Python Kyiv All jobs thredUP