Middle Python Engineer (Big Data retraining) (offline)

In this collaboration, we make lasting improvements to their performance and realize their most important goals. Over nearly a century, our client built a company uniquely equipped for this task.
Together with our client, we are building a software product that leverages decades of client company marketing and sales experience helping leading global companies improve pricing, promotion, assortments, and performance management. Our solution is the ETL framework which loads and validates data for downstream applications in the client’s ecosystem.
We are extending our team of Python Engineers to help our client develop the solution based on Apache Spark and Databricks in both Azure and AWS clouds.

YOU ARE
A Python Engineer with at least 2-year proven experience in software development industry interested to join a distributed team and work together with the client on manufacturing the ETL solution.
You have seasoned skills and such experience:
— Software Engineer proven background (Python, Apache Spark development)
— Developing Data Pipelines for Data Ingestion, Processing and Transformation of data at scale using PySpark and Spark SQL
— Hands-on expertise with Spark performance optimization
— Working with Streaming using Spark on Event Hub/Kafka/Kinesis
— Orchestration tools like azure data factory, AWS data pipeline, Prefect, or Airflow
— Different Azure and AWS native components: e.g. Azure Event Grid/ Functions/Log Analytics/ ADLS, AWS S3/ SNS/ SQS/ Lambda/ Cloud Trails
— Building ETL pipelines and solutions with DataBricks
— Background and knowledge of software development lifecycles

And the following soft skills:
— Understanding of Agile methodologies and desire to work in Agile environment
— Team player comfortable with office and remote work in a distributed team
— Good communication skills and desire to work in the environment of open communication both in the development team and with the client
— Intermediate strong level and higher English level

YOU WANT TO WORK WITH
— Participation in all aspects of the software life cycle, including analysis, components design, development, unit testing, CI/CD, and production deployment
— Backlog analysis, estimation, feature decomposition
— Coding on Python, Apache Spark, Databricks, Azure, AWS, and other related technologies
— Contribution to manufacturing solution which creates value for the end-clients
— Cross-functional and distributed teams
— Communication and collaboration with internal and client teams

TOGETHER WE WILL
— Run the project for our client to build a great product that makes difference on the market
— Develop and work with the great team across Ukraine, other European countries, and the US
— Support your technical and personal growth – we have a dedicated career plan for all roles in our company
— Take part in internal and external events where you can build and promote your personal brand
— Care about your individual initiatives – we are open for them, just come and share your ideas
— Share many other advantages with you such as attractive salary, modern office, a package of benefits, language classes