Jobs

We are Boosta — an international IT company with a portfolio of successful products, performance marketing projects, and our investment fund, Burner. Boosta was founded in 2014, and since then, the number of Boosters has grown to 600+.

We’re looking for a Data Engineer to join our team in the iGaming industry, where real-time insights, affiliate performance, and marketing analytics are at the center of decision-making. In this role, you’ll own and scale our data infrastructure, working across affiliate integrations, product analytics, and experimentation workflows.

Your primary responsibilities will include building and maintaining data pipelines, implementing automated data validation, integrating external data sources via APIs, and creating dashboards to monitor data quality, consistency, and reliability. You’ll collaborate daily with the Affiliate Management team, Product Analysts, and Data Scientists to ensure the data powering our reports and models is clean, consistent, and trustworthy.

WHAT YOU’LL DO

• Design, develop, and maintain ETL/ELT pipelines to transform raw, multi-source data into clean, analytics-ready tables in Google BigQuery, using tools such as dbt for modular SQL transformations, testing, and documentation.
• Integrate and automate affiliate data workflows, replacing manual processes in collaboration with the related stakeholders.
• Proactively monitor and manage data pipelines using tools such as Airflow, Prefect, or Dagster, with proper alerting and retry mechanisms in place.
• Emphasize data quality, consistency, and reliability by implementing robust validation checks, including schema drift detection, null/missing value tracking, and duplicate detection using tools like Great Expectations or
• Build a Data Consistency Dashboard (in Looker Studio, Power BI, Tableau or Grafana) to track schema mismatches, partner anomalies, and source freshness, with built-in alerts and escalation logic.
• Ensure timely availability and freshness of all critical datasets, resolving latency and reliability issues quickly and sustainably.
• Control access to cloud resources, implement data governance policies, and ensure secure, structured access across internal teams.
• Monitor and optimize data infrastructure costs, particularly related to BigQuery usage, storage, and API-based ingestion.
• Document all pipelines, dataset structures, transformation logic, and data contracts clearly to support internal alignment and knowledge sharing.
• Build and maintain postback-based ingestion pipelines to support event-level tracking and attribution across the affiliate ecosystem.
• Collaborate closely with Data Scientists and Product Analysts to deliver high-quality, structured datasets for modeling, experimentation, and KPI reporting.

• Act as a go-to resource across the organization for troubleshooting data discrepancies, supporting analytics workflows, and enabling self-service data access.

   

WHAT WE EXPECT FROM YOU

• Strong proficiency in SQL and Python.
• Experience with Google BigQuery and other GCP tools (e.g., Cloud Storage, Cloud Functions, Composer).
• Proven ability to design, deploy, and scale ETL/ELT pipelines.
• Hands-on experience integrating and automating data from various platforms.
• Familiarity with postback tracking, attribution logic, and affiliate data reconciliation.
• Skilled in orchestration tools like Airflow, Prefect, or Dagster.
• Experience with Looker Studio, Power BI, Tableau, or Grafana for building dashboards for data quality monitoring.
• Use of Git for version control and experience managing CI/CD pipelines (e.g., GitHub Actions).
• Experience with Docker to build isolated and reproducible environments for data workflows.
• Exposure to iGaming data structures and KPIs is a strong advantage.

• Strong sense of data ownership, documentation, and operational excellence.

   

HOW IT WORKS

• Stage 1: pre-screen with a recruiter.
• Stage 2: test task.
• Stage 3: interview.
• Stage 4: bar-raising.
• Stage 5: reference check.
• Stage 6: job offer!

A trial period for this position is 3 months, during which we will get used to working together.

WHAT WE OFFER

• 28 business days of paid off
• Flexible hours and the possibility to work remotely
• Medical insurance and mental health care
• Compensation for courses, trainings
• English classes and speaking clubs
• Internal library, educational events
• Outstanding corporate parties, teambuildings

About us:

EveryMatrix is a leading B2B SaaS provider delivering iGaming software, content and services. We provide casino, sports betting, platform and payments, and affiliate management to 200 customers worldwide.

But that's not all! We're not just about numbers, we're about people. With a team of over 1000 passionate individuals spread across twelve countries in Europe, Asia, and the US, we're all united by our love for innovation and teamwork.

EveryMatrix is a member of the World Lottery Association (WLA) and European Lotteries Association. In September 2023 it became the first iGaming supplier to receive WLA Safer Gambling Certification. EveryMatrix is proud of its commitment to safer gambling and player protection whilst producing market leading gaming solutions.

Join us on this exciting journey as we continue to redefine the iGaming landscape, one groundbreaking solution at a time.
 

We are looking for a passionate and dedicated Junior QA to join our team in Lviv!

About the unit:

DataMatrix is a part of EveryMatrix platform that is responsible for collecting, storing, processing and utilizing hundreds of millions of transactions from the whole platform every single day. We develop Business Intelligent solutions, reports, 3rd party integrations, data streaming and other products for both external and internal use. The team consists of 35 people and is located in Lviv.

What You'll get to do:

• Develop real time data processing and aggregations
• Create and modify data marts (enhance our data warehouse)
• Take care of internal and external integrations
• Forge various types of reports

Our main stack:

• DB: BigQuery, PostgreSQL
• ETL: Apache Airflow, Apache NiFi
• Streaming: Apache Kafka

What You need to know:

Here's what we offer:

• Start with 22 days of annual leave, with 2 additional days added each year, up to 32 days by your fifth year with us.
• Stay Healthy: 10 sick leave days per year, no doctor's note required; 30 medical leave days with medical allowance
• Support for New Parents:
• 21 weeks of paid maternity leave, with the flexibility to work from home full-time until your child turns 1 year old.
• 4 weeks of paternity leave, plus the flexibility to work from home full-time until your child is 13 weeks old.

Our office perks include on-site massages and frequent team-building activities in various locations.

Benefits & Perks:

• Daily catered lunch or monthly lunch allowance. 
• Private Medical Subscription. 
• Access online learning platforms like Udemy for Business, LinkedIn Learning or O’Reilly, and a budget for external training.
• Gym allowance

At EveryMatrix, we're committed to creating a supportive and inclusive workplace where you can thrive both personally and professionally. Come join us and experience the difference!

Boosty Labs is one of the most prominent outsourcing companies in the blockchain domain. Among our clients are such well-known companies as Ledger, Consensys, Storj, Animoca brands, Walletconnect, Coinspaid, Paraswap, and others.

About project: Advanced blockchain analytics and on-the-ground intelligence to empower financial institutions, governments & regulators in the fight against cryptocurrency crime

• Requirements:
  • 6+ years of experience with Python backend development
    Solid knowledge of SQL (including writing/debugging complex queries)
    Understanding of data warehouse principles and backend architecture
  • Experience working in Linux/Unix environments
    Experience with APIs and Python frameworks (e.g., Flask, FastAPI)
  • Experience with PostgreSQL
  • Familiarity with Docker
  • Basic understanding of unit testing
  • Good communication skills and ability to work in a team
  • Interest in blockchain technology or willingness to learn
  • Experience with CI/CD processes and containerization (Docker, Kubernetes) is a plus
  • Strong problem-solving skills and the ability to work independently
• Responsibilities:
  • Integrate new blockchains, AMM protocols, and bridges into the our platform
  • Build and maintain data pipelines and backend services
  • Help implement new tools and technologies into the system
  • Participate in the full cycle of feature development – from design to release
  • Write clean and testable code
  • Collaborate with the team through code reviews and brainstorming
• Nice to Have:
  • Experience with Kafka, Spark, or ClickHouse
  • Knowledge of Kubernetes, Terraform, or Ansible
  • Interest in crypto, DeFi, or distributed systems
  • Experience with open-source tools
  • Some experience with Java or readiness to explore it
• What we offer:
  • Remote working format 
  • Flexible working hours
  • Informal and friendly atmosphere
  • The ability to focus on your work: a lack of bureaucracy and micromanagement
  • 20 paid vacation days
  • 7 paid sick leaves
  • Education reimbursement
  • Free English classes
  • Psychologist consultations

• Recruitment process:

  Recruitment Interview – Technical Interview

The client is seeking an experienced Data Engineer to build and migrate data solutions to Google Cloud Platform (GCP) in support of data analytics and ML/AI initiatives.

Key responsibilities:

• Develop data products on GCP using BigQuery and DBT
• Integrate data from multiple sources using Python and Cloud Functions
• Orchestrate pipelines with Terraform and Cloud Workflows
• Collaborate with Solution Architects, Data Scientists, and Software Engineers

Tech stack:
GCP (BigQuery, Cloud Functions, Cloud Workflows), DBT, Python, Terraform, Git

Requirements:
Ability to work independently and within cross-functional teams; 
Strong hands-on experience;
English: Upper Intermediate or higher

Nice to have:
Experience with OLAP cubes and PowerBI

📣 Senior Data Engineer | Fintech | Remote | Full-Time

🧠 Level: Senior
🗣️ English: Upper-Intermediate or higher
🕒 Workload: Full-time
🌍 Location: Fully remote (Preference for time zones close to Israel)
🕐 Time Zone: CET (Israel)
🚀 Start Date: ASAP
📆 Duration: 6+ months

🧾 About the Client:
Our client is an innovative fintech company dedicated to optimizing payment transaction success rates. Their advanced technology integrates seamlessly into existing infrastructures, helping payment partners and platforms recover lost revenue by boosting transaction approval rates.

🔧 Project Stage: Ongoing development

💼 What You’ll Be Doing:

• Design and implement robust, scalable data pipelines and ETL workflows
• Develop comprehensive end-to-end data solutions to support analytics, product, and business needs
• Define data requirements, architect systems, and build reliable data models
• Integrate backend logic into data processes for actionable insights
• Optimize system performance, automate processes, and monitor for improvements
• Collaborate closely with cross-functional teams (Product, Engineering, Data Science)

🧠 Must-Have Skills:

• 5+ years of experience in data engineering
• Deep expertise in building data warehouses and BI ecosystems
• Strong experience with modern analytical databases (e.g., Snowflake, Redshift)
• Proficient with data transformation tools (e.g., dbt, Dataform)
• Familiar with orchestration tools (e.g., Airflow, Prefect)
• Skilled in Python or Java and advanced SQL (including performance tuning)
• Experience managing large-scale data systems in cloud environments
• Infrastructure as code and DevOps mindset

🤝 Soft Skills:

• High ownership and accountability
• Strong communication and collaboration abilities
• Experience in dynamic, startup-like environments
• Analytical thinker with a proactive mindset
• Comfortable working independently
• Fluent spoken and written English

🧪 Tech Stack:
Python or Java, SQL, Snowflake, Redshift, dbt, Dataform, Airflow

📋 Interview Process:

1. English Check (15 min)
2. Technical Interview (1–1.5 hours)
3. Final Interview (1 hour) – Client

Our long-standing client from the UK is looking for a Senior Data Engineer 

Project: Decommissioning legacy software and systems

Tech stack:
DBT, Snowflake, SQL, Python, Fivetran

Requirements:

• Solid experience with CI/CD processes in SSIS
• Proven track record of decommissioning legacy systems and migrating data to modern platforms (e.g., Snowflake)
• Experience with AWS (preferred) or Azure
• Communicative and proactive team player — able to collaborate and deliver
• Independent and flexible when switching between projects
• English: Upper Intermediate or higher

We are currently seeking a skilled Data Engineer to join our team in the development and maintenance of robust data solutions. This role involves building and optimizing data pipelines, managing ETL processes, and supporting data visualization needs for business-critical use cases.
 

As part of your responsibilities, you will design and implement cloud infrastructure on AWS using AWS CDK in Python, contribute to solution architecture, and develop reusable components to streamline delivery across projects. You will also implement data quality checks and design scalable data models leveraging both SQL and NoSQL technologies.

Project details:

• Start: ASAP
• Duration: Until 31.12.2026
• Location: Remote
• Language: English

Responsibilities:

• Develop, monitor, and maintain efficient ETL pipelines and data workflows
• Build infrastructure on AWS using AWS CDK (Python)
• Design and implement reusable data engineering components and frameworks
• Ensure data quality through validation, testing, and monitoring mechanisms
• Contribute to solution architecture and technical design
• Create and optimize scalable data models in both SQL and NoSQL databases
• Collaborate with cross-functional teams including data scientists, analysts, and product owners

Requirements:

• Solid experience in building and maintaining ETL pipelines
• Hands-on experience with data visualization tools or integrations (e.g., Tableau, Power BI, or custom dashboards via APIs)
• Strong working knowledge of AWS services, especially with AWS CDK (Python)
• Good understanding of SQL and NoSQL database technologies
• Familiarity with version control systems (e.g., Git)
• Experience working in Agile environments
• Strong communication skills and ability to work autonomously in remote teams

Who we are:

Adaptiq is a technology hub specializing in building, scaling, and supporting R&D teams for high-end, fast-growing product companies in a wide range of industries.

About the Product:
Our client is a leading SaaS company offering pricing optimization solutions for e-commerce businesses. Its advanced technology utilizes big data, machine learning, and AI to assist customers in optimizing their pricing strategies and maximizing their profits.

About the Role:
As a Data Engineer, you will operate at the intersection of data engineering, software engineering, and system architecture. This is a high-impact, cross-functional role where you’ll take end-to-end ownership — from designing scalable infrastructure and writing robust, production-ready code to ensuring the reliability and performance of our systems in production.

Key Responsibilities:

• Collaborate closely with software architects and DevOps engineers to evolve our AI training, inference, and delivery architecture and deliver resilient, scalable, production-grade machine learning pipelines.
• Design and implement scalable machine learning pipelines with Airflow, enabling efficient parallel execution.
• Enhance our data infrastructure by refining database schemas, developing and improving APIs for internal systems, overseeing schema migrations, managing data lifecycles, optimizing query performance, and maintaining large-scale data pipelines.
• Implement monitoring and observability, using AWS Athena and QuickSight to track performance, model accuracy, operational KPIs and alerts.
• Build and maintain data validation pipelines to ensure incoming data quality and proactively detect anomalies or drift.
• Represent the data science team’s needs in cross-functional technical discussions and solutions design.

Required Competence and Skills:

• A Bachelor’s or higher in Computer Science, Software Engineering or a closely related technical field, demonstrating strong analytical and coding skills.
• 8+ years of experience as a data engineer, software engineer, or similar role, with a proven track record of using data to drive business outcomes.
• Strong Python skills, with experience building modular, testable, and production-ready code.
• Solid understanding of Databases and SQL, including indexing best practices, and hands-on experience working with large-scale data systems (e.g., Spark, Glue, Athena).
• Practical experience with Airflow or similar orchestration frameworks, including designing, scheduling, maintaining, troubleshooting, and optimizing data workflows (DAGs).
• A solid understanding of data engineering principles: ETL/ELT design, data integrity, schema evolution, and performance optimization.
• Familiarity with AWS cloud services, including S3, Lambda, Glue, RDS, and API Gateway.

Nice-to-Haves

• Experience with MLOps practices such as CI/CD, model and data versioning, observability, and deployment.
• Familiarity with API development frameworks (e.g., FastAPI).
• Knowledge of data validation techniques and tools (e.g., Great Expectations, data drift detection).
• Exposure to AI/ML system design, including pipelines, model evaluation metrics, and production deployment.

Why Us?

We provide 20 days of vacation leave per calendar year (plus official national holidays of a country you are based in).

We provide full accounting and legal support in all countries we operate.

We utilize a fully remote work model with a powerful workstation and co-working space in case you need it.

We offer a highly competitive package with yearly performance and compensation reviews.

We are building a next-generation AI-powered platform designed for comprehensive observability of digital infrastructure, including mobile networks and data centers. By leveraging advanced analytics, automation, and real-time monitoring, we empower businesses to optimize performance, enhance reliability, and prevent failures before they happen.

Our platform delivers deep insights, anomaly detection, and predictive intelligence, enabling telecom operators, cloud providers, and enterprises to maintain seamless connectivity, operational efficiency, and infrastructure resilience in an increasingly complex digital landscape.

We have offices in Doha, Qatar and Muscat, Oman. This position requires relocation to one of these offices.

Job Summary
As a Senior Data Engineer, you will be responsible for building and maintaining end-to-end data infrastructure that powers our AI-driven observability platform. You will work with large-scale datasets, both structured and unstructured, and design scalable pipelines that enable real-time monitoring, analytics, and machine learning. This is a hands-on engineering role requiring deep expertise in data architecture, cloud technologies, and performance optimization.
Key Responsibilities

Data Pipeline Development
 

• Design, develop, and maintain scalable ETL/ELT pipelines from scratch using modern data engineering tools
• Ingest and transform high-volume data from multiple sources, including APIs, telemetry, and internal systems
• Write high-performance code to parse and process large files (JSON, XML, CSV, etc.)
• Ensure robust data delivery for downstream systems, dashboards, and ML models

Infrastructure & Optimization
 

• Build and manage containerized workflows using Docker and Kubernetes
• Optimize infrastructure for performance, availability, and cost-efficiency
• Implement monitoring, alerting, and data quality checks across the data pipeline stack

Collaboration & Best Practices
 

• Work closely with AI/ML, backend, and platform teams to define and deliver on data requirements
• Enforce best practices in data modeling, governance, and engineering
• Participate in CI/CD processes, infrastructure automation, and documentation

Required Qualifications

Experience
 

• 4+ years of hands-on experience in data engineering or similar backend roles
• Proven experience designing and deploying production-grade data pipelines from scratch

Technical Skills
 

• Proficiency in Python or Scala for data processing
• Deep knowledge of SQL and noSQL systems (e.g., MongoDB, DynamoDB, Cassandra, Firebase)
• Hands-on experience with cloud platforms (AWS, GCP, or Azure)
• Familiarity with data tools like Apache Spark, Airflow, Kafka, and distributed systems
• Experience with CI/CD practices and DevOps for data workflows

Soft Skills
 

• Excellent communication skills and the ability to work independently in a fast-paced environment
• Strong analytical mindset and attention to performance, scalability, and system reliability

Preferred Qualifications
 

• Background in the telecom or IoT industry
• Certifications in cloud platforms or data technologies
• Experience with real-time streaming, event-driven architectures, or ML/Ops
• Familiarity with big data ecosystems (e.g., Hadoop, Cloudera)
• Knowledge of API development or experience with Flask/Django
• Experience setting up A/B test infrastructure and experimentation pipelines

Nice to have 
 

Experience with the integration and maintenance of vector databases (e.g., Pinecone, Weaviate, Milvus, Qdrant) to support LLM workflows including embedding search, RAG, and semantic retrieval.

 
 What We Offer
 

• Performance-Based Compensation: Tied to achieving and exceeding performance targets, with accelerators for surpassing goals
• Shares and Equity: Participation in our Employee Stock Option Plan (ESOP)
• Growth Opportunities: Sponsored courses, certifications, and continuous learning programs
• Comprehensive Benefits: Health insurance, pension contributions, and professional development support
• Annual Vacation: Generous paid annual leave
• Dynamic Work Environment: A culture of innovation, collaboration, and creative freedom
• Impact and Ownership: Shape the future of digital infrastructure and leave your mark
• Flexible Work Arrangements: Options to work remotely or from our offices
• A Mission-Driven Team: Join a diverse, passionate group committed to meaningful change

Dataforest is seeking an experienced Senior Data Engineer to join our dynamic team. You will be responsible for developing and maintaining data-processing architecture, as well as optimizing and monitoring our internal systems.
Requirements:
- 3+ years of commercial experience with Python.
- Solid foundational knowledge of ElasticSearch, including:

• Ability to perform batch updates using bulk operations.
• Understanding index mapping and how to adapt it for your project’s needs.

• (Nice to Have) Some exposure to vector search concepts.

  - Experience working with PostgreSQL databases.
  - Proven experience in setting up and managing monitoring systems with CloudWatch, Prometheus, and Grafana.
  - Profound understanding of algorithms and their complexities, with the ability to analyze and optimize them effectively.
  - Excellent programming skills in Python with a strong emphasis on optimization and code structuring.
  - Solid understanding of ETL principles and best practices.
  - Excellent collaborative and communication skills, with demonstrated ability to mentor and support team members.
  - Experience working with Linux environments, cloud services (AWS), and Docker.
  - Strong decision-making capabilities with the ability to work independently and proactively.
  
  Will be a plus:
  - Experience in web scraping, data extraction, cleaning, and visualization.
  - Understanding of multiprocessing and multithreading, including process and thread management.
  - Familiarity with Redis.
  - Experience with Flask / Flask-RESTful for API development.
  - Knowledge and experience with Kafka.
  
  Key Responsibilities:
  - Develop and maintain a robust data processing architecture using Python.
  - Effectively utilize ElasticSearch and PostgreSQL for efficient data management.
  - Design and manage data pipelines using Kafka and SQS.
  - Optimize code structure and performance for maximum efficiency.
  - Design and implement efficient ETL processes.
  - Analyze and optimize algorithmic solutions for better performance and scalability.
  - Collaborate within the AWS stack to ensure flexible and reliable data processing systems.
  - Provide mentorship and guidance to colleagues, fostering a collaborative and supportive team environment.
  - Independently make decisions related to software architecture and development processes to drive the project forward.
  
  We offer:

- Great networking opportunities with international clients, challenging tasks;

- Building interesting projects from scratch using new technologies;

- Personal and professional development opportunities;

- Competitive salary fixed in USD;

- Paid vacation and sick leaves;

- Flexible work schedule;

- Friendly working environment with minimal hierarchy;

- Team building activities and corporate events.

Project description

We are hiring a Senior Full-Stack Software Developer. Our client team consists of frontend and backend developers, data engineers, data scientists, QA engineers, cloud engineers, and project managers.

Responsibilities

Participate in requirements clarification and sprint planning sessions.

Design technical solutions and implement them, inc ETL Pipelines

Build robust data pipelines in PySpark to extract, transform, using PySpark

Optimize ETL Processes

Enhance and tune existing ETL processes for better performance, scalability, and reliability

Writing unit and integration tests.

Support QA teammates in the acceptance process.

Resolving PROD incidents as a 3rd line engineer.

Skills

Must have

Min 7 Years of experience in IT/Data

Bachelor in IT or related field.

Exceptional logical reasoning and problem-solving skills

Programming: Proficiency in PySpark for distributed computing and Python for ETL development.

SQL: Strong expertise in writing and optimizing complex SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake.

Data Warehousing: Experience working with data warehousing concepts and platforms, ideally DataBricks

ETL Tools: Familiarity with ETL tools & processes

Data Modelling: Experience with dimensional modelling, normalization/denormalization, and schema design.

Version Control: Proficiency with version control tools like Git to manage codebases and collaborate on development.

Data Pipeline Monitoring: Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance.

Data Quality Tools: Experience implementing data validation, cleansing, and quality framework

Nice to have

Understanding of Investment Data domain.

Languages

English: B2 Upper Intermediate

At Uvik Software, we are looking for a talented 🔎 Data Engineer 🔎 to join our team. If you are passionate about data, cloud technologies, and building scalable solutions, this role is for you!

You will work on designing, developing, and optimizing data pipelines, implementing machine learning models, and leveraging cloud platforms like AWS(preferred), Azure, or GCP. You’ll collaborate with cross-functional teams to transform raw data into actionable insights, enabling smarter business decisions.
 

📊Key Responsibilities:
 

• Develop and maintain scalable ETL/ELT pipelines for data processing.
• Design and optimize data warehouses and data lakes on AWS, Azure, or GCP.
• Implement machine learning models and predictive analytics solutions.
• Work with structured and unstructured data, ensuring data quality and integrity.
• Optimize query performance and data processing workflows.
• Collaborate with software engineers, analysts, and business stakeholders to deliver data-driven solutions.

📈Requirements:
 

• 4+ years of experience as a Data Engineer.
• Strong proficiency in SQL and experience with relational and NoSQL databases.
• Hands-on experience with cloud services: AWS (preferred), Azure, or GCP.
• Proficiency in Python or Scala for data processing.
• Experience with Apache Spark, Kafka, Airflow, or similar tools.
• Solid understanding of data modeling, warehousing, and big data processing frameworks.
• Experience with machine learning frameworks (TensorFlow, Scikit-learn, PyTorch) is a plus.
• Familiarity with DevOps practices, CI/CD pipelines, and Infrastructure as Code (Terraform, CloudFormation) is an advantage.

• Project Description:

  We are hiring a Senior Full-Stack Software Developer. Our client team consists of frontend and backend developers, data engineers, data scientists, QA engineers, cloud engineers, and project managers.
   

• Responsibilities:

  • Participate in requirements clarification and sprint planning sessions.
  • Design technical solutions and implement them, inc ETL Pipelines - Build robust data pipelines in PySpark to extract, transform, using PySpark
  • Optimize ETL Processes - Enhance and tune existing ETL processes for better performance, scalability, and reliability
  • Writing unit and integration tests.
  • Support QA teammates in the acceptance process.
  • Resolving PROD incidents as a 3rd line engineer.
   

• Mandatory Skills Description:

  * Min 7 Years of experience in IT/Data
  * Bachelor in IT or related field.
  * Exceptional logical reasoning and problem-solving skills
  * Programming: Proficiency in PySpark for distributed computing and Python for ETL development.
  * SQL: Strong expertise in writing and optimizing complex SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake.
  * Data Warehousing: Experience working with data warehousing concepts and platforms, ideally DataBricks
  * ETL Tools: Familiarity with ETL tools & processes
  * Data Modelling: Experience with dimensional modelling, normalization/denormalization, and schema design.
  * Version Control: Proficiency with version control tools like Git to manage codebases and collaborate on development.
  * Data Pipeline Monitoring: Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance.
  * Data Quality Tools: Experience implementing data validation, cleansing, and quality framework
   

• Nice-to-Have Skills Description:

  Understanding of Investment Data domain.

N-iX is looking for a  Senior Data Engineer (with Data Science/MLOps experience) to join our team!

Our client: a global biopharmaceutical company.

As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. Your background in machine learning and data science will be valuable in optimizing data workflows, enabling efficient model deployment, and supporting AI-driven initiatives. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.

Key Responsibilities:

• Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
• Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development.
• Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
• Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency.
• Collaborate with Data Scientists to facilitate model deployment and integration into production environments.
• Support the implementation of basic ML Ops practices, such as model versioning and monitoring.
• Assist in optimizing data pipelines to improve machine learning workflows.
• Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.

• Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.

   

Tools and skills you will use in this role:

• Palantir Foundry
• Python
• PySpark
• SQL

• TypeScript

   

Required:

• 5+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry;
• Strong proficiency in Python and PySpark;
• Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.);
• Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow);
• Expertise in data modeling, data warehousing, and ETL/ELT concepts;
• Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.);
• Proficiency in containerization technologies (e.g., Docker, Kubernetes);
• Familiarity with ML Ops concepts, including model deployment and monitoring.
• Basic understanding of machine learning frameworks such as TensorFlow or PyTorch.
• Exposure to cloud-based AI/ML services (e.g., AWS SageMaker, Azure ML, Google Vertex AI).
• Experience working with feature engineering and data preparation for machine learning models.
• Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities.
• Strong communication and teamwork abilities;
• Understanding of data security and privacy best practices;

• Strong mathematical, statistical, and algorithmic skills.

   

Nice to have:

• Certification in Cloud platforms, or related areas;
• Experience with search engine Apache Lucene, Web Service Rest API;
• Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry;
• Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous;

• Previous experience working with JavaScript and TypeScript.

   

We offer*:

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

*not applicable for freelancers

Оur Clіent іs seekіng а prоаctіve Senіоr Dаtа Engіneer tо jоіn theіr teаm.

Аs а Senіоr Dаtа Engіneer, yоu wіll plаy а crіtіcаl rоle іn desіgnіng, develоpіng, аnd mаіntаіnіng sоphіstіcаted dаtа pіpelіnes, Оntоlоgy Оbjects, аnd Fоundry Functіоns wіthіn Pаlаntіr Fоundry.

Yоur bаckgrоund іn mаchіne leаrnіng аnd dаtа scіence wіll be vаluаble іn оptіmіzіng dаtа wоrkflоws, enаblіng effіcіent mоdel deplоyment, аnd suppоrtіng АІ-drіven іnіtіаtіves.

The іdeаl cаndіdаte wіll pоssess а rоbust bаckgrоund іn clоud technоlоgіes, dаtа аrchіtecture, аnd а pаssіоn fоr sоlvіng cоmplex dаtа chаllenges.

Key Respоnsіbіlіtіes:

• Cоllаbоrаte wіth crоss-functіоnаl teаms tо understаnd dаtа requіrements, аnd desіgn, іmplement аnd mаіntаіn scаlаble dаtа pіpelіnes іn Pаlаntіr Fоundry, ensurіng end-tо-end dаtа іntegrіty аnd оptіmіzіng wоrkflоws.
• Gаther аnd trаnslаte dаtа requіrements іntо rоbust аnd effіcіent sоlutіоns, leverаgіng yоur expertіse іn clоud-bаsed dаtа engіneerіng. Creаte dаtа mоdels, schemаs, аnd flоw dіаgrаms tо guіde develоpment.
• Develоp, іmplement, оptіmіze аnd mаіntаіn effіcіent аnd relіаble dаtа pіpelіnes аnd ETL/ELT prоcesses tо cоllect, prоcess, аnd іntegrаte dаtа tо ensure tіmely аnd аccurаte dаtа delіvery tо vаrіоus busіness аpplіcаtіоns, whіle іmplementіng dаtа gоvernаnce аnd securіty best prаctіces tо sаfeguаrd sensіtіve іnfоrmаtіоn.
• Mоnіtоr dаtа pіpelіne perfоrmаnce, іdentіfy bоttlenecks, аnd іmplement іmprоvements tо оptіmіze dаtа prоcessіng speed аnd reduce lаtency.
• Cоllаbоrаte wіth Dаtа Scіentіsts tо fаcіlіtаte mоdel deplоyment аnd іntegrаtіоn іntо prоductіоn envіrоnments.
• Suppоrt the іmplementаtіоn оf bаsіc ML Оps prаctіces, such аs mоdel versіоnіng аnd mоnіtоrіng.
• Аssіst іn оptіmіzіng dаtа pіpelіnes tо іmprоve mаchіne leаrnіng wоrkflоws.
• Trоubleshооt аnd resоlve іssues relаted tо dаtа pіpelіnes, ensurіng cоntіnuоus dаtа аvаіlаbіlіty аnd relіаbіlіty tо suppоrt dаtа-drіven decіsіоn-mаkіng prоcesses.
• Stаy current wіth emergіng technоlоgіes аnd іndustry trends, іncоrpоrаtіng іnnоvаtіve sоlutіоns іntо dаtа engіneerіng prаctіces, аnd effectіvely dоcument аnd cоmmunіcаte technіcаl sоlutіоns аnd prоcesses.

Tооls аnd skіlls yоu wіll use іn thіs rоle:

• Pаlаntіr Fоundry
• Pythоn
• PySpаrk
• SQL
• TypeScrіpt

Requіred:

• 5+ yeаrs оf experіence іn dаtа engіneerіng, preferаbly wіthіn the phаrmаceutіcаl оr lіfe scіences іndustry;
• Strоng prоfіcіency іn Pythоn аnd PySpаrk;
• Prоfіcіency wіth bіg dаtа technоlоgіes (e.g., Аpаche Hаdооp, Spаrk, Kаfkа, BіgQuery, etc.);
• Hаnds-оn experіence wіth clоud servіces (e.g., АWS Glue, Аzure Dаtа Fаctоry, Gооgle Clоud Dаtаflоw);
• Expertіse іn dаtа mоdelіng, dаtа wаrehоusіng, аnd ETL/ELT cоncepts;
• Hаnds-оn experіence wіth dаtаbаse systems (e.g., PоstgreSQL, MySQL, NоSQL, etc.);
• Prоfіcіency іn cоntаіnerіzаtіоn technоlоgіes (e.g., Dоcker, Kubernetes);
• Fаmіlіаrіty wіth ML Оps cоncepts, іncludіng mоdel deplоyment аnd mоnіtоrіng.
• Bаsіc understаndіng оf mаchіne leаrnіng frаmewоrks such аs TensоrFlоw оr PyTоrch.
• Expоsure tо clоud-bаsed АІ/ML servіces (e.g., АWS SаgeMаker, Аzure ML, Gооgle Vertex АІ).
• Experіence wоrkіng wіth feаture engіneerіng аnd dаtа prepаrаtіоn fоr mаchіne leаrnіng mоdels.
• Effectіve prоblem-sоlvіng аnd аnаlytіcаl skіlls, cоupled wіth excellent cоmmunіcаtіоn аnd cоllаbоrаtіоn аbіlіtіes.
• Strоng cоmmunіcаtіоn аnd teаmwоrk аbіlіtіes;
• Understаndіng оf dаtа securіty аnd prіvаcy best prаctіces;
• Strоng mаthemаtіcаl, stаtіstіcаl, аnd аlgоrіthmіc skіlls.

Nіce tо hаve:

• Certіfіcаtіоn іn Clоud plаtfоrms, оr relаted аreаs;
• Experіence wіth seаrch engіne Аpаche Lucene, Web Servіce Rest АPІ;
• Fаmіlіаrіty wіth Veevа CRM, Reltіо, SАP, аnd/оr Pаlаntіr Fоundry;
• Knоwledge оf phаrmаceutіcаl іndustry regulаtіоns, such аs dаtа prіvаcy lаws, іs аdvаntаgeоus;
• Prevіоus experіence wоrkіng wіth JаvаScrіpt аnd TypeScrіpt.

Cоmpаny оffers:

• Flexіble wоrkіng fоrmаt – remоte, оffіce-bаsed оr flexіble
• А cоmpetіtіve sаlаry аnd gооd cоmpensаtіоn pаckаge
• Persоnаlіzed cаreer grоwth
• Prоfessіоnаl develоpment tооls (mentоrshіp prоgrаm, tech tаlks аnd trаіnіngs, centers оf excellence, аnd mоre)
• Аctіve tech cоmmunіtіes wіth regulаr knоwledge shаrіng
• Educаtіоn reіmbursement
• Memоrаble аnnіversаry presents
• Cоrpоrаte events аnd teаm buіldіngs