Jobs Data Engineer

Our client is a Canadian financial services company undergoing significant growth and modernization of its data ecosystem. The team is building a scalable cloud-based data platform that will serve as a foundation for analytics, reporting, and data-driven decision-making across the organization.
 

You will join the Core Data Platform team and take ownership of designing and developing enterprise-grade data solutions.

Responsibilities

• Design and implement scalable data models in Snowflake.
• Build, optimize, and maintain ELT/ETL pipelines using dbt.
• Develop and support workflow orchestration using Airflow or Dagster.
• Write clean, reusable, and maintainable Python code for data processing and monitoring.
• Collaborate with Tech Leads, analysts, and business stakeholders to define requirements and deliver solutions.
• Participate in architecture discussions and drive technical decisions.
• Ensure high code quality through reviews, testing, documentation, and CI/CD practices.
• Work with cloud-native services across AWS and Azure environments.
• Contribute to metadata management, logging, monitoring, and production support.

Must Have

• 7+ years of experience in Data Engineering.
• Strong hands-on experience with Python and advanced SQL.
• Experience with Apache Spark or similar large-scale data processing frameworks.
• Solid experience with workflow orchestration tools (Apache Airflow or Dagster).
• Strong expertise in Snowflake and enterprise data warehouse architectures.
• Experience designing secure data platforms, including:
  • data security implementation;
  • access control;
  • data masking policies;
  • handling sensitive and PII data.
• 3+ years of experience with cloud platforms (AWS, Azure, or GCP).
• Experience building and maintaining CI/CD pipelines.
• Strong understanding of software engineering best practices, testing, and documentation.
• Ability to work independently and take ownership of end-to-end delivery.
• Excellent communication skills and experience working directly with stakeholders.
• Upper-Intermediate/Advanced English level (C1).

Nice to Have

• Experience with Data Mesh architecture.
• Experience with Snowflake UniStore and Hybrid Tables.
• Infrastructure as Code experience (Terraform, Ansible).
• Experience working in the financial domain.
• AWS certifications.

Tech Stack

• Snowflake
• dbt Core / dbt Cloud
• Apache Airflow / Dagster
• Python
• SQL
• Apache Spark
• AWS, Azure
• Terraform
• GitHub Actions

Interview Process

• HR Interview
• Technical Interview
• Short video introduction (2–3 minutes)
• Client Interview

Looking for a Data Engineer to join the Dataforest team. If you are looking for a friendly team, a healthy working environment, and a flexible schedule ‒ you have found the right place to send your CV.

Skills requirements:
• 2+ years of experience with Python;
• 2+ years of experience as a Data Engineer;
• Experience with Pandas;
• Experience with SQL DB / NoSQL (Redis, Mongo, Elasticsearch) / BigQuery;
• Familiarity with Amazon Web Services;
• Knowledge of data algorithms and data structures is a MUST;
• Working with high volume tables 10m+.

Optional skills (as a plus):
• Experience with Spark (pyspark);
• Experience with Airflow;
• Experience with Kafka;
• Experience in statistics;
• Knowledge of DS and Machine learning algorithms..

Key responsibilities:
• Create ETL pipelines and data management solutions (API, Integration logic);
• Different data processing algorithms;
• Involvement in creation of forecasting, recommendation, and classification models.

We offer:

• Great networking opportunities with international clients, challenging tasks;

• Building interesting projects from scratch using new technologies;

• Personal and professional development opportunities;

• Competitive salary fixed in USD;

• Paid vacation and sick leaves;

• Flexible work schedule;

• Friendly working environment with minimal hierarchy;

• Team building activities, corporate events.

About the role

We are looking for a Senior Backend Engineer o join the AgInsights Platform team.

The platform enables data-driven decision-making in agriculture by integrating agronomic and machine learning models into scalable cloud-native services.

You will play a key role in building and scaling the AgInsights Platform, developing backend services, integrating agronomic models, and improving the tooling and infrastructure that enable data-driven decision-making in agriculture. This is a hands-on engineering role with real ownership, where you will work across platform and model boundaries to deliver reliable, production-ready systems in a largely greenfield environment.

Responsibilities

• Build and maintain backend services and APIs (e.g., using FastAPI)
• Integrate and operationalise agronomic and data-driven models
• Design and implement data workflows (e.g., with Apache Airflow)
• Develop and improve internal tooling, SDKs, and developer experience
• Deploy and operate services in cloud-native environments (Kubernetes on Amazon Web Services)
• Contribute to CI/CD and GitOps practices (e.g., CircleCI, Argo CD)
• Improve observability, monitoring, and system reliability

• Collaborate closely with data scientists, model developers, and platform engineers

   

Requirements

• 4+ years of commercial experience with Python
• 3+ years of experience with FastAPI
• Experience with Redis and Celery
• 3+ years of experience with Pandas
• Experience with Apache Airflow and data orchestration
• Solid experience with AWS cloud services

• Upper-Intermediate English or higher

   

Nice to Have

• Experience with machine learning platforms or MLOps practices
• Experience with data engineering and large-scale data processing
• Experience with GitOps tools such as Argo CD
• Experience in AgTech, agriculture, geospatial, or environmental data domains

OneTrust Senior Engineer – Contractor Position

Role Overview

We are seeking an experienced OneTrust Senior Engineer (contractor) to support a DSAR automation project for a major enterprise client. The project involves integrating a significant number of applications into OneTrust's DSAR module using Targeted Data Discovery (TDD) to automate data subject identification, data collection, and support for portability/access rights. The final scope of integrations is currently being defined by the client.

Scope of Work

Configuration and customization of OneTrust DSAR module and Targeted Data Discovery (TDD)

Design and implementation of integrations between OneTrust and target applications (mix of enterprise group systems, custom applications, and cloud platforms).

Development of custom connectors where pre-built connectors are not available

Configuration of automated data discovery workflows (identification & data collection)

Collaboration with application owners on integration requirements (OneTrust side)

Testing, troubleshooting, and optimization of integrations

Documentation and knowledge transfer

Note: changes in the target applications are to be conducted by the client. This role to focus only on OneTrust platform and integration layer to the apllications. 

Required Experience & Skills

Hands-on experience with OneTrust platform, specifically:

DSAR / Privacy Rights Automation module

Targeted Data Discovery (TDD) – connector configuration and custom integrations

Integration Hub / workflow configuration

Proven track record of delivering OneTrust integration projects at enterprise scale

Strong understanding of GDPR data subject rights (access, portability, erasure, rectification)

Experience with API integration (REST, SOAP, JDBC/ODBC) and custom connector development

Ability to assess and classify applications by integration complexity and recommend appropriate integration approach (pre-built connector vs. custom API vs. DB query)

Experience working with diverse application landscapes (SaaS, on-premise, legacy, enterprise platforms such as SAP, Salesforce, etc.)

Comfortable working independently with minimal supervision – single-developer setup with PM/coordination support provided by the client

Experience with large enterprise / corporate group environments with complex application landscapes

Certifications

Preferred (not hard requirement): 

OneTrust Certified Professional (any relevant OneTrust certification)

CIPT (Certified Information Privacy Technologist) or equivalent privacy/data protection certification

Or similiar

We're looking for a remote Software Engineer to help build one of the largest data platforms.

Our platform processes million events every day that power analytics and products used by very large amount of users.

If you enjoy solving large-scale engineering problems, building distributed systems, and working with modern cloud technologies, we'd love to hear from you.

What you'll work on

• Build and improve large-scale data pipelines.
• Develop high-performance batch and streaming applications.
• Design reliable distributed systems.
• Improve platform performance, scalability, and reliability.
• Collaborate with product and engineering teams to deliver production-ready solutions.

Requirements

• 3+ years of software engineering experience.
• Strong Java or Scala skills.
• Experience building distributed systems in the cloud.
• Familiarity with AWS or another major cloud platform.
• Strong problem-solving skills.
• Good English communication.

Nice to Have (not must)

• Python
• Terraform
• CI/CD
• DevOps experience
• SaaS experience

What You'll Get

• Competitive salary
• Paid vacation
• Paid sick leave
• Brand-new MacBook after probation

IT Craft is looking for a Senior Data Engineer to join our team.

As a Senior Data Engineer, you will design, build, and optimize enterprise data pipelines and lakehouse solutions aligned with the given data architecture, governance standards, and cloud-first strategy. You will partner with cross-functional teams to deliver secure, scalable, and high-quality data solutions that enable analytics, reporting, and AI-driven capabilities.

Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines across enterprise systems, including ERP, CRM, and operational platforms;
• Build and support cloud-based data lakehouse architecture aligned with medallion layers and governance standards;
• Develop and maintain data models, semantic layers, and curated datasets for analytics and business intelligence;
• Translate business requirements into technical data solutions in collaboration with product, engineering, and business stakeholders;
• Ensure data quality, integrity, and security in alignment with given data governance and compliance standards;
• Optimize SQL queries, data pipelines, and storage performance across AWS and Azure platforms;
• Support data integration initiatives, including Data Lake, D365 ERP, and CRM/AMS platforms;
• Monitor pipeline health, troubleshoot issues, and ensure high availability and reliability of data systems;
• Contribute to the continuous improvement of data architecture, standards, and best practices;
• Support AI and analytics initiatives by enabling high-quality, accessible data for downstream consumption.

Requirements:

Technical Skills and Experience:

• 5+ years of experience in data engineering or data platform development;
• Strong experience designing and building ETL/ELT pipelines in cloud environments;
• Hands-on experience with AWS (S3, Redshift, Glue, DMS) and Azure (Data Factory, SSIS);
• Strong proficiency in SQL and relational database design;
• Solid understanding of data warehousing, data lakes, and lakehouse architecture;
• Experience with structured, semi-structured, and unstructured data processing;
• Experience with data modeling, data quality, and performance optimization;
• Experience with Git, Azure DevOps, and CI/CD practices;
• Strong analytical, problem-solving, and communication skills;
• At least an Upper-Intermediate level of spoken and written English.

Non-Technical Skills:

• Build positive working relationships across multiple IT disciplines and staff levels;
• Collaborate effectively and welcome feedback on ongoing projects;
• Respond to business issues with an appropriate sense of urgency;
• Know when to escalate a problem or seek assistance;
• Be organized, proactive, and self-motivated;
• Communicate clearly, both verbally and in writing;
• Demonstrate strong problem-solving skills and attention to detail;
• Identify and document business and system requirements;
• Thrive in a high-energy, team-focused environment;
• Deliver high-quality results while meeting project schedules.

Nice to Have:

• Experience with Databricks, Spark, or Azure Fabric;
• Experience with Power BI or enterprise reporting platforms;
• Familiarity with AI/ML data enablement and tools (e.g., AWS Bedrock, RAG concepts).

Role Characteristics:

• Technical individual contributor role with ownership of data engineering deliverables;
• Works on complex initiatives aligned with a given enterprise data strategy;
• Collaborates with cross-functional teams across IT, analytics, and business units;
• Contributes to architecture decisions and continuous improvement efforts.

What We Offer:

• Competitive compensation according to the qualifications;
• Flexible working hours, remote work;
• Opportunity for career growth;
• Reward for sports activities;
• In-house English training;
• A friendly team of open-minded people.

Please send your CV.

By submitting your application, you consent to the processing of your personal data in accordance with IT Craft's Privacy Policy, available at https://itechcraft.com/datenschutz/.

About AppsFlyer:

AppsFlyer provides a SaaS marketing analytics platform that measures and optimizes marketing activities across mobile, web, CTV, PC, and console applications. AppsFlyer is known for its massive backend production. At any given moment, thousands of servers are consuming 150+ billion mobile app events, crunching our users’ data, serving requests, and communicating on a massive scale.

To maintain the universe we call AppsFlyer, we practice modern production operations with a complete self-serve CI/CD platform, a highly integrated observability stack for our micro-services, backends, and infrastructure, a culture of ownership and eagerness for quality.

The Analytics group is responsible for showing our clients the stories their data is telling. Through complex aggregation, mission-tailored analytical databases, and carefully crafted APIs we are able to provide slice-and-dice analysis in our beautiful dashboards and through the use of external integrations.

About the Role:

As a Data Engineer within the Analytics group at AppsFlyer, you will own the end-to-end journey of event data - from ingestion and processing to storage, modeling, and API delivery. 

You will design and implement data pipelines using Apache Airflow and Spark, choose and optimize analytical databases, and integrate new components in our hybrid microservices environment. You will collaborate with product managers and cross-functional teams, troubleshoot production incidents, and influence our migration toward Google Cloud and BigQuery. This role offers autonomy over feature design, real impact on a platform handling billions of events daily, and the chance to contribute to open-source projects or speak at industry forums.

Key Responsibilities:

• Develop and maintain data processing pipelines using Apache Airflow, Scala Spark or PySpark.
• Select, model and optimize analytical databases for high-throughput, low-latency queries.
• Design and implement backend services and APIs for data ingestion, aggregation and client consumption.
• Monitor system performance and stability; diagnose and resolve production issues.
• Collaborate with product managers and engineers to plan and deliver complex features.
• Drive migration efforts to Google Cloud Platform, BigQuery and modern data tooling.
• Participate in on-call rotations, alerting via PagerDuty and incident response procedures.
• Document system architecture and data flows; maintain code quality and tests.

Required Competence and Skills:

• 3+ years of software development experience with a focus on data engineering.
• Practical experience with Apache Spark (Scala or PySpark) and Apache Airflow.
• Experience building and maintaining high-throughput, low-latency distributed data systems.
• Strong SQL skills and experience with data modeling for analytics workloads.
• Familiarity with JVM languages (Scala, Java, Clojure) or Python for backend development.
• Experience with cloud platforms - preferably GCP - and data warehouses such as BigQuery.
• Proven ownership of production systems and on-call incident management.
• Excellent communication skills in English for distributed teamwork.
• B.Sc. in Computer Science or equivalent practical experience.

Nice to Have:

• Production experience with large-scale databases and ETL tooling.
• Hands-on background in Go or Clojure backend services.
• Experience with production-grade BigQuery ETL and data pipelines.
• Contribution to open-source projects or public speaking at meetups/conferences.
• An “AI mindset” - familiarity with tools like GitHub Copilot and emerging AI workflows.

Benefits Package includes:

• Health Insurance
• Paid Unlimited Vacation Days + all national holidays + additional recharge days
• Meals Reimbursement
• Sport Reimbursement
• Breakfast in the office
• Mental health program
• Team building, happy hours, and other team activities
• Paid sick days
• Snacks, fruits & ice-cold beer
• All new team members are provided with a brand-new Mac laptop with 2 monitors and a Starter package

About the Project: Migration of SharePoint 2016 solutions to Office 365 and Power Platform, automation of internal banking processes, and development of solutions aimed at improving employee productivity within the Bank.

Your future responsibilities:

• Develop, implement, and administer solutions and business processes on the Microsoft Power Platform and Microsoft 365 (Office 365)
• Work with Office 365 and Power Platform SaaS services, including Power Apps, Power Automate, Power BI, Dataverse, Microsoft Teams, SharePoint Online, Azure SQL, and Python
• Solve integration challenges using REST APIs
• Migrate SharePoint 2016 solutions to Office 365 and Power Platform
• Automate internal banking processes
• Develop solutions to enhance the productivity of Bank employees

Your skills and experience:

• Hands-on experience with Office 365, Power Platform, and SharePoint cloud technologies
• Knowledge and understanding of Microsoft Azure cloud services, ETL processes, and SQL databases
• Familiarity with AWS services and practical programming experience in Python, C#, PowerShell, and JavaScript, as well as web technologies, will be considered an advantage
• Basic knowledge of networking technologies and security systems
• Ability to work effectively both independently and as part of a team
• Responsibility, integrity, strong execution discipline, and excellent self-organization skills

We offer what matters most to you:

• Competitive salary: we guarantee a stable income and annual bonuses for your personal contribution. Additionally, we have a referral reward program for attracting new colleagues to Raiffeisen Bank
• Social package: official employment, 28 days of paid leave, additional “maternity leave” for fathers, and financial assistance for parents upon the birth of children
• Comfortable working conditions: the possibility of a hybrid work format, offices equipped with shelters and generators, provision with modern equipment
• Wellbeing program: all employees have access to medical insurance from the first working day; consultations with a psychologist, nutritionist or lawyer; discount program for sports and shopping; family days for children and adults; massage in the office
• Learning and development: access to over 130 online educational resources; corporate training programs, online library, mentoring program
• A great team: our colleagues are a community where curiosity, talent and innovation are welcomed. We support each other, learn together and grow. You can find like-minded people in over 15 professional communities, reading or sports clubs
• Career opportunities: we encourage advancement within the bank between functions
• Innovation and technology. Infrastructure: AWS, Kubernetes, Docker, GitHub, GitHub actions, ArgoCD, Prometheus, Victoria, Vault, OpenTelemetry, ElasticSearch, Crossplain, Grafana. Languages: Java (main), Python (data), Go (infra, security), Swift (IOS), Kotlin (Andorid)Datastores: Sql-Oracle, PgSql, MsSql, Sybase. Data management: Kafka, AirFlow, Spark, Flink, we develop expertise in AI and actively integrate it into processes
• Support program for defenders: we preserve jobs and pay the average salary to mobilized people. We have a support program for veterans, and the Bank’s veteran community is developing. We are working to raise awareness among managers and teams on the issues of veterans’ return to civilian life. Raiffeisen Bank is recognized as one of the best employers for veterans (Forbes)

______________________________________________________________________

Про проєкт: Міграція рішень SharePoint 2016 на Office 365 and Power Platform, автоматизація внутрішньобанківських процесів, розробка рішень по підвищенню продуктивності співробітників Банку.

Твої майбутні обов’язки: 

• Розробка, впровадження та адміністрування рішень та процесів на платформі Microsoft Power Platform та Microsoft 365 (Office 365), з використанням SaaS сервісів Office 365/Power Platform (Power Apps, Power Automate, Power BI, Dataverse, MS Teams, SharePoint Online, Azure SQL), додатково Python
• Вирішення інтеграційних задач з використанням REST API
• Міграція рішень SharePoint 2016 на Office 365 + Power Platform
• Автоматизація внутрішньобанківських процесів
• Розробка рішень по підвищенню продуктивності співробітників Банку

Твій досвід та навички:

• Досвід роботи з хмарними технологіями Office 365, Power Platform, SharePoint
• Знання та розуміння хмарних технології та сервісів Microsoft Azure, ETL процесів та SQL баз даних
• Додатковою перевагою буде знайомство з сервісами AWS, практичне володіння мовами програмування (Python, C#, PowerShell, JS), веб-технологіями
• Базові знання мережевих технологій та систем захисту
• Досвід роботи як в команді так і самостійно над поставленими задачами
• Відповідальність, порядність, виконавча дисципліна, самоорганізація

Пропонуємо те, що має значення саме для тебе: 

• Конкурентна заробітна плата: гарантуємо стабільний дохід та річні бонуси за твій особистий внесок. Додатково, у нас діє реферальна програма винагороди за залучення нових колег до Райффайзен Банку
• Соціальний пакет: офіційне працевлаштування, 28 днів оплачуваної відпустки, додатковий “декрет” для татусів, та матеріальна допомога для батьків при народженні дітей
• Комфортні умови праці: можливість гібридного формату роботи, офіси забезпеченні укриттями та генераторами, забезпечення сучасною технікою
• Wellbeing програма: для всіх співробітників доступні медичне страхування з першого робочого дня; консультації психолога, нутриціолога чи юриста; дисконт програми на спорт та покупки; family days для дітей та дорослих; масаж в офісі
• Навчання та розвиток: доступ до понад 130 навчальних онлайн-ресурсів; корпоративні навчальні програми, онлайн бібліотека, програма менторства
• Крута команда: наші колеги — це спільнота, де вітаються допитливість, талант та інновації. Ми підтримуємо один одного, вчимося разом та зростаємо. Ти можеш знайти однодумців у понад 15-ти професійних ком’юніті, читацькому чи спортивному клубах
• Кар’єрні можливості: ми заохочуємо просування всередині банку між функціями
• Інновації та технології. Infrastructure: AWS, Kubernetes, Docker, GitHub, GitHub actions, ArgoCD, Prometheus, Victoria, Vault, OpenTelemetry, ElasticSearch, Crossplain, Grafana. Languages: Java (main), Python (data), Go(infra,security), Swift (IOS), Kotlin (Andorid) Datastores: Sql-Oracle, PgSql, MsSql, Sybase. Data management: Kafka, AirFlow, Spark, Flink, розвиваємо експертизу в AI та активно інтегруємо в процеси
• Програма підтримки захисників і захисниць: ми зберігаємо робочі місця та виплачуємо середню заробітну плату мобілізованим. Для ветеранів та ветеранок у нас діє програма підтримки, розвивається ветеранська спільнота Банку. Ми працюємо над підвищенням обізнаності керівників та команд з питань повернення ветеранів до цивільного життя. Райффайзен Банк відзначений як один з найкращих роботодавців для ветеранів (Forbes)

Our client is a prominent global wealth and asset management firm focused on delivering innovative investment solutions and a networked ecosystem of international opportunities. The organization operates within a highly regulated environment, prioritizing the transformation of complex concepts into actionable financial strategies for a global clientele.

Project overview

The project involves the development and expansion of a centralized, scalable data ecosystem. Having successfully ingested the initial data source, the team is now moving into a high-growth phase to integrate multiple high-value financial and operational data streams. The goal is to provide C-level executives and advisors with a unified, reliable reporting layer for strategic decision-making.

Position overview

As a Senior Data Engineer, you will be a technical cornerstone of the data platform team. You will be responsible for the end-to-end engineering of data pipelines, from ingestion to transformation, ensuring that the Snowflake warehouse is optimized for complex wealth management analytics. You will work at the intersection of sophisticated financial data and enterprise-grade engineering.

Responsibilities

• Build and maintain scalable data pipelines for ingestion into Snowflake.
• Develop and manage transformations using dbt, including modeling, testing, and comprehensive documentation.
• Design and orchestrate complex data workflows using Prefect.
• Utilize Workato to integrate and normalize data from critical SaaS platforms, including Addepar, NetSuite, Salesforce, Morningstar, and UKG.
• Design specialized data models tailored for portfolio, client, and financial reporting.
• Ensure data quality, lineage, and governance best practices while optimizing performance and costs within Snowflake.
• Partner with Tableau developers and business stakeholders to align technical delivery with reporting needs.

Requirements

• 5+ years of experience in data engineering with a focus on building modern data platforms.
• Hands-on experience with Snowflake and dbt, supported by strong SQL skills and advanced data modeling expertise.
• DBT certification.
• Proven familiarity with ETL/ELT patterns and API-based ingestion.
• Practical experience with orchestration tools such as Prefect or Airflow.
• A solid understanding of financial or wealth management data structures.

Nice to have

• Experience supporting reporting requirements for Tableau-based visualization layers.
• Experience within the Wealth Management or Investment Management sector, with specific familiarity handling investment and portfolio-related data.
• Understanding of regulatory requirements regarding financial data handling and privacy.
• Background in integrating market data providers such as Bloomberg or Morningstar.
• Advanced SQL skills and experience with Python for data engineering tasks.

Project Description

We help marketers connect the digital and physical world. We provide data-driven solutions to enhance marketing campaigns by leveraging location and audience data to reveal consumer behavior and enable more precise targeting and measurement. We work on high-end / high-performance / high-throughput systems for in-time analysis of data for autonomous driving and other big data applications e.g. for E-commerce.

Job Responsibilities

Work in a self-organised agile team with a high level of autonomy, and you will actively shape your team's culture.

Design, build, and standardise privacy-first big data architectures, large-scale data pipelines, and advanced analytics solutions in AWS.

Develop complex integrations with third-party partners, transferring terabytes of data.

Align with other Data experts on data (analytics) engineering best practices and standards, and introduce those standards and data engineering expertise to the team in order to enhance existing data pipelines and build new ones.

Successfully partner up with the Product team to constantly develop further and improve our platform features.

Requirements:

• 4+ years in a Data Engineering or similar high-scale role.
• Expert-level Python skills. Familiarity with Java or Scala is a major plus.
• Proven hands-on experience building scalable solutions directly within AWS.
• Deep proficiency in high-throughput architectures using Kafka, Spark, Hadoop, MongoDB, AWS Batch, AWS Glue, Athena, Airflow, and dbt.
• Exceptional SQL and data transformation skills, with an eye for optimizing NoSQL and SQL databases.
• Ability to simplify complex technical concepts and a passion for mentoring junior engineers in a collaborative environment.

About the Role

We're looking for a sharp, analytically mindedcontractor to support our accounting team with workpaper modernization and dataquery work. This is a hands-on, execution-focused engagement suited for someonewho moves fast, works independently, and takes ownership.

Technical Requirements

 *   Advanced Excel proficiency — pivot tables, dynamic arrays, Power Query, and building structured reporting tools for high-volume datasets
 *   Advanced SQL skills — complex queries, stored procedures, window/analytical functions, and query optimization
 *   Hands-on experience with dbt, Google BigQuery, and Airflow
 *   4–6 years of hands-on experience analyzing and engineering large datasets in a business or finance context
 *   Demonstrated ability to pick up unfamiliar tools and systems quickly

Soft Skills & Work Style

 *   Highly organized with the ability to juggle multiple deliverables
 *   Strong attention to detail without losing sight of the bigger picture
 *   Self-starter who operates well with minimal oversight
 *   Collaborative — comfortable interfacing with accounting and operations teammates
 *   Professional proficiency in English (written and verbal)

We are seeking a motivated Junior Big Data Engineer to join our team. In this role, you will contribute to the development and maintenance of data pipelines, data models, and data processing solutions within modern cloud and big data environments. You will work closely with senior engineers to build scalable data solutions and support data-driven business initiatives.

The ideal candidate has hands-on experience with Python, PySpark, and SQL, a solid understanding of data engineering fundamentals, and an interest in working with large-scale data platforms and AI-powered solutions.

Key Responsibilities:

• Support the design, development, and maintenance of data pipelines and ETL/ELT processes.
• Develop and optimize data transformation workflows using Python and PySpark.
• Assist in integrating data from multiple sources while ensuring data quality, consistency, and reliability.
• Collaborate with data engineers, data scientists, and AI/ML engineers to prepare and manage datasets for analytics and machine learning applications.
• Participate in data modeling, schema design, and data warehousing activities.
• Monitor data pipelines, investigate issues, and contribute to performance improvements.
• Follow data governance, security, and privacy best practices.
• Document technical solutions, processes, and data flows.
• Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.

Tools and skills you will use in this role:

• Palantir Foundry
• Python
• PySpark
• SQL
• TypeScript

Requirements:

• 1+ year of experience in data engineering
• Strong proficiency in Python and SQL
• Hands-on experience with PySpark
• Familiarity with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.)
• Basic experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow)
• Understanding of ETL/ELT pipelines and data integration techniques
• Experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.)
• Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities
• Strong communication and teamwork abilities
• Strong mathematical, statistical, and algorithmic skills
• English - Upper-Intermediate or higher

Nice to have:

• Experience with AI/ML
• Previous experience working with JavaScript and TypeScript

We offer*:

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

*not applicable for freelancers

Are you passionate about building scalable, reliable data systems that power real-world solutions? We are looking for a Senior Data Engineer to join our team and work remotely from Europe, Ukraine, or LATAM.

At Sigma Software, we partner with innovative companies to deliver cutting-edge technology solutions. This role offers the opportunity to design and operate a canonical data platform that integrates diverse external data sources, ensuring high quality and flexibility.

Why join us? You’ll work with modern technologies, collaborate with talented professionals across multiple regions, and have the freedom to experiment and innovate while contributing to impactful projects in the AdTech domain.

Customer

Our client is a fast-growing AdTech company focused on solving real-world challenges in digital advertising and data-driven marketing. They specialize in building highly resilient and scalable systems that encourage experimentation and innovation. Their data platform is designed to be both powerful and flexible, enabling engineers to introduce new ideas and leverage the latest technologies to optimize advertising performance and audience insights.

Project

The project involves developing and maintaining a canonical data platform that integrates multiple external data sources. It supports both full data loads and incremental updates, ensures high data quality, and leverages AI-assisted tools for monitoring and issue detection.

Key Technologies: Java, Scala, Apache Beam/Apache Spark, SQL, GCP Dataflow, REST APIs, AI-assisted tools, event-driven architectures

Responsibilities

• Design, build, and maintain reliable data pipelines to ingest and process data from external systems
• Implement integrations using Java or Scala, ensuring scalability and resilience
• Handle both full data loads and incremental updates efficiently
• Collaborate with engineering and product teams to align on integration and data needs
• Develop and maintain a unified internal data model
• Ensure data quality, detect and resolve incorrect or incomplete data
• Utilize AI-assisted tools to improve data quality and operational efficiency
• Monitor and optimize data pipelines for production readiness

Requirements

• At least 5 years of experience as a Data Engineer or Backend/Data Engineer
• Strong production experience with Java or Scala
• Experience with Apache Beam or Apache Spark
• Proven experience integrating external systems via REST APIs (pagination, rate limiting, token-based authentication)
• Strong data modelling skills with structured, relational data
• Solid SQL knowledge
• Experience with GCP Dataflow
• Experience operating data pipelines in production environments
• Strong communication skills and ability to collaborate across teams
• At least an Upper Intermediate level of English

WILL BE A PLUS:

• Experience with event-driven architectures or messaging systems
• Designing canonical schemas across multiple data sources
• Experience with LLM (Large Language Models)

Personal Profile

• Proactive and detail-oriented
• Thrives in collaborative environments
• Enjoys solving complex integration challenges
• Comfortable experimenting with new technologies
• Committed to improving data systems

About the Client

Our client is an AI-driven product company focused on building intelligent agents that automate and enhance customer interactions across multiple channels.

As the platform continues to grow, they are looking for a Senior Data Engineer / Platform Engineer to help scale and improve the company's data infrastructure, pipelines, and tooling.

About the Role

You will play a key role in designing, building, and maintaining a reliable and scalable data ecosystem that powers analytics, product insights, and operational workflows.

This position is ideal for someone who enjoys working across data platforms, integrations, infrastructure, and analytics enablement while ensuring high standards of data quality and reliability.

What You'll Do

• Design, build, and maintain scalable ETL/ELT pipelines and workflows
• Improve data quality, reliability, monitoring, and observability across the data platform
• Build and maintain integrations between internal and external systems
• Collaborate closely with engineering, product, implementation, and business teams
• Ensure data consistency, accessibility, and trustworthiness across analytics and operational use cases
• Optimize data models, transformations, and storage strategies
• Support the evolution of the company's modern data platform and tooling ecosystem
• Troubleshoot and resolve data pipeline and platform issues

Requirements

• 5+ years of experience in Data Engineering or Platform Engineering
• Proven experience building and maintaining production-grade data systems
• Strong experience with cloud data platforms, preferably Google Cloud Platform (GCP)
• Advanced SQL skills
• Experience designing, implementing, and supporting ETL/ELT pipelines
• Experience with data orchestration and workflow management tools
• Strong knowledge of Microsoft SQL Server
• Hands-on experience with ClickHouse
• Experience working with Fivetran
• Strong understanding of data architecture, performance, and scalability
• Excellent verbal and written English communication skills
• Ability to work independently in a fast-paced environment

Nice to Have

• Experience with modern analytics stacks and data warehousing solutions
• Experience with data observability and monitoring tools
• Familiarity with AI/ML data pipelines
• Experience supporting product analytics and operational reporting
• Startup or high-growth product company experience

What We're Looking For

• Strong ownership mindset
• Passion for building reliable and scalable data systems
• Attention to detail and commitment to data quality
• Ability to collaborate effectively across technical and non-technical teams
• Comfortable working in a dynamic, rapidly evolving environment

What We're Looking For

Seeking Alpha is looking for a Senior Data Engineer responsible for designing, building, and maintaining the infrastructure necessary for analyzing large data sets. This individual should be an expert in data management, ETL (extract, transform, load) processes, and data warehousing and should have experience working with various big data technologies, such as Hadoop, Spark, and NoSQL databases. In addition to technical skills, a Senior Data Engineer should have strong communication and collaboration abilities, as they will be working closely with other members of the data and analytics team, as well as other stakeholders, to identify and prioritize data engineering projects and to ensure that the data infrastructure is aligned with the overall business goals and objectives.

The Senior Data Engineer will be engaged with the company as a contractor (Private Entrepreneur).

What You'll Do

• Work closely with data scientists/analytics and other stakeholders to identify and prioritize data engineering projects and to ensure that the data infrastructure is aligned with business goals and objectives
• Design, build and maintain optimal data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources, including external APIs, data streams, and data stores. 
• Continuously monitor and optimize the performance and reliability of the data infrastructure, and identify and implement solutions to improve scalability, efficiency, and security
• Stay up-to-date with the latest trends and developments in the field of data engineering, and leverage this knowledge to identify opportunities for improvement and innovation within the organization
• Solve challenging problems in a fast-paced and evolving environment while maintaining uncompromising quality.
• Implement data privacy and security requirements to ensure solutions comply with security standards and frameworks.
• Enhance the team's dev-ops capabilities.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 2+ years of proven experience developing large-scale software using an object-oriented or functional language.
• 5+ years of professional experience in data engineering, focusing on building and maintaining data pipelines and data warehouses
• Strong experience with Spark, Scala, and Python, including the ability to write high-performance, maintainable code
• Experience with AWS services, including EC2, S3, Athena, Kinesis/Firehose Lambda and EMR
• Familiarity with data warehousing concepts and technologies, such as columnar storage, data lakes, and SQL
• Experience with data pipeline orchestration and scheduling using tools such as Airflow
• Strong problem-solving skills and the ability to work independently as well as part of a team
• High-level English - a must. 
• A team player with excellent collaboration skills.

Nice to Have:

• Expertise with Vertica or Redshift, including experience with query optimization and performance tuning
• Experience with machine learning and/or data science projects
• Knowledge of data governance and security best practices, including data privacy regulations such as GDPR and CCPA.
• Knowledge of Spark internals (tuning, query optimization)

Join a Company That Invests in You

Seeking Alpha is the world’s leading community of engaged investors. We’re the go-to destination for investors looking for actionable stock market opinions, real-time market analysis, and unique financial insights. At the same time, we’re also dedicated to creating a workplace where our team thrives. We’re passionate about fostering a flexible, balanced environment with remote work options and an array of perks that make a real difference.

Here, your growth matters. We prioritize your development through ongoing learning and career advancement opportunities, helping you reach new milestones. Join Seeking Alpha to be part of a company that values your unique journey, supports your success, and champions both your personal well-being and professional goals.