Senior Big Data Engineer (Azure/GCP) (offline)

WE ARE
We are a big distributed team working with a fantastic customer, a giant in the mining industry, located in Canada. Our customer is a diversified resource company committed to responsible mining and mineral development with business units focused on steelmaking coal, copper, zinc, and energy. Headquartered in Vancouver, British Columbia (B.C.), Canada, they own or have interests in 13 operating mines, a large metallurgical complex, and several major development projects in the Americas. The client has expertise across a wide range of activities related to exploration, development, mining, and minerals processing, including smelting and refining, health and safety, environmental protection, materials stewardship, recycling, and research.

Our customer’s corporate strategy is focused on exploring for, developing, acquiring, and operating world-class, long-life assets in stable jurisdictions that operate through multiple price cycles.

YOU ARE
Excited about:
• Azure Data Factory
• Databricks or HDInsight or Synapse Analytics
• Azure SQL DW (a.k.a. Synapse SQL Dedicated Pool)
• Azure Blob Storage and Azure Data Lake
• Azure SQL DB/Azure SQL MI/SQL Server
• Azure Functions
• Apache Spark
• Event Hubs or similar (Kafka)
• Azure Stream Analytics or similar (Spark, Flink, Storm)
• Azure Cosmos DB (nice to have)

Experienced in:
• Complex cloud services management concepts
• Networking (virtual networks, firewalls, communication between services)
• Authentication and security (IAM, service principals and managed identities)
• Logging and monitoring
• Event-driven architecture (Event Grid, Azure Functions, Logic Apps)
• Hadoop ecosystem (e.g. Hive, Impala, Kafka, Spark, HBase, Presto)
• Work of streaming platforms and stream ingestion services (Event Hubs, Kafka)
• Stream analytics concepts and technologies (Flink, Spark, Storm, Azure Stream Analytics)
• Database modeling, DWH design, and implementation
• ETL/ELT process design and implementation
• Massive-parallel-processing (MPP) systems: Azure SQL DW (Synapse), GCP BigQuery, Impala, AWS Redshift
• NoSQL databases
• Optimization of code, ETL processes, and SQL queries
• Having a deep knowledge of SQL language and database management techniques (row-level security, built-in database roles, partitioning, index maintenance)
• OLAP systems and reporting tools (Azure Analysis Service, Power BI)
• Python (PySpark, pandas, airflow)
• Git and Git flow
• CI/CD process building tools (Azure DevOps,)
• Project management methodologies (Agile, Waterfall)
• End-to-end architecture of big data solutions design and implementation

Possessing:
• Capability of communicating with stakeholders in written and verbal form
• Ability to suggest the best solution among different options and conducting trade-off analysis
• Strong problem-solving skills
• Team-leadership skills
• Upper-Intermediate Low English level

YOU WANT TO WORK WITH
• Modern technologies, popular on the market
• Interesting customers
• Challenging projects
• Either alone on a subproject or in a team
• Both developing new functionality and improving the existing ones
• Remote teams located in Ukraine, Poland & Canada

TOGETHER WE WILL
• Accomplish great things
•Get a great deal of learning and development opportunities along with our structured career path
•Process dynamic projects and still very stable place to work
•Take part in internal and external events where you can build and promote your personal brand
• Give you access to experienced specialists willing to share their knowledge
• Care about your individual initiatives – we are open for them, just come and share your ideas


It’s an exciting time to join us and find yourself a place in our growing success story!

About SoftServe

SoftServe is the largest Ukrainian IT company, a team of 8000+ thinkers and makers, true professionals and good people. We like what we do and do it well. For us, that means a lot.

From engineering to architecture, business analytics to project management, artificial intelligence to customer support solutions, and so much more — choose from a variety of paths and grow your dreams.

Our company isn’t just about technology — it’s about open-minded people who love technology, and use it to extend boundaries and connect people, businesses and ideas for the better. We encourage that passion by helping our employees not only build great careers but live great lives.

Company website:
https://www.softserveinc.com/uk-ua

DOU company page:
https://jobs.dou.ua/companies/softserve/