Lead Data Platform Engineer (offline)

On behalf of Beeswax, Sigma Software is looking for a Lead Data Platform Engineer to join our Data Platforms Engineering (DPE) team. This team provides external customers and internal teams with queryable access to the billions of daily events that occur in the bidding platform. It operates a large-scale distributed system that ingests millions of events per second and applies business rules to process and provide the events to customers in real time. The team also builds ETL pipelines using Snowflake Data Warehouse and synthesizes data sets that power customer dashboards, reports, and business intelligence tools.

CUSTOMER
Beeswax (https://www.beeswax.com/about/) provides extremely high-scale Bidder-as-a-Service solutions in advertising technology, works with global businesses, and has to date raised $28M (incl. the most recent Series B raise of $15M).
Sigma Software works together with Beeswax to enable the delivery of numerous key components of the platform, and is looking for engineers to complement Beeswax engineering team and drive further development of the platform.

PROJECT
The project is about building the next generation of real-time bidding software that enables sophisticated marketers to break free from the limitations and constraints of opaque, one-size-fits-all programmatic buying platforms. Most of the ETL is written in Python and managed by Airflow DAGs.
As a Lead Data Platform Engineer, you will be involved in direct ownership and technical supervision of global distributed engineering teams, including engineers in Ukraine and the U.S.

RESPONSIBILITIES
- Owning the entire pipeline and keeping the costs down, the performance up, and the engineering process optimal
- Developing platform features for customers to monitor and analyze their marketing campaigns
- Scaling the distributed system and infrastructure to the next level
- Optimizing algorithms and software architectures to save cloud hosting costs

REQUIREMENTS
- 5+ years’ of related experience building data products with Python
- Solid knowledge in algorithms and data structures
- Experience with AWS technologies — Glue, Lambda, Step Functions, S3, etc.
- Experience with developing data pipelines based on one of the mainstream frameworks like Spark/Flink/Presto, etc.
- Experience with developing data lakes and data warehouses based on one of the mainstream technologies like Hive/Snowflake/OLAP/Hudi, etc.
- Knowledge in SQL and solid experience with NoSQL or RDBMS technologies
- Experience with data integrations and different data formats CSV, Protobuf, Parquet, Avro, ORC, etc.
- Solid understanding of technical excellence and hands-on experience with code reviews, test development, and CI/CD
- An understanding of what it means to build data processing systems at scale – if you love articles on highscalability.com you’ll fit right in
- Comfort in a Linux ecosystem

About Sigma Software

Sigma Software is a place where Nordic Traditions meet Ukrainian Spirit to create Superior Software. We combine the best practices and approaches from Swedish and Ukrainian cultures. Taking high demand for quality, minimal hierarchy, freedom of decision-making, and attention to every opinion from Swedes, as a Ukrainian company we demonstrate flexibility and dedication to every project and every customer.

We are IT consulting and software product company with development offices in Ukraine, Sweden, the USA, Canada, Poland, and Australia. We deliver smartest solutions to our customers in the areas of government, telecommunications, advertising, automotive, gaming, and others. Being a part of Sigma Group, one of the largest Nordic IT corporations, we are a global player with more than 5000 employees in 12 countries and over 1500 in Ukraine.

We work with startups, software houses, and enterprises providing the products and services that suit our clients the most. Company`s R&D centers are mastering the trending technologies and directions: Infotainment, AR/VR, Blockchain, Machine Learning, Data Science, Artificial Intelligence, and others.

Company website:
https://career.sigma.software/

DOU company page:
https://jobs.dou.ua/companies/sigma-software/