Jobs Data Engineer

Position Type: Full-time, Remote

This role involves support/creation of web scraping configurations, that are running on our engine and are based on regular expressions. You will work with server logs, HTTP requests, regexp tools, spreadsheets, and big structured and unstructured files. This role combines tech duties and project coordination duties in the future. See more https://www.webspidermount.com/jobmarketpulse/

Skills to succeed in this role are:

1. HARD SKILLS

• General knowledge of web technologies such as HTML, JavaScript, FTP, SFTP, XML, JSON, CSV, APIs.

• Regular expressions.

• Experience with web scraping tools and frameworks, such as Scrapy, BeautifulSoup, Selenium, etc

• Proficiency in Excel/Google Spreadsheets.

• Optional: XSLT templates, Velocity templates.

2. SOFT SKILLS:

• Proactivity and responsibility, attention to detail.

• Ability to create the work process

• Experience in team coordination

• Ability to work not only according to instructions but to create them for yourself

• English language - Intermediate (read and write without vocabulary)

3. DUTIES & RESPONSIBILITIES:

• Setting up new crawling robots using our own system, based on regular expressions

• Monitoring and improvement of existing crawling robots

• Making sure data is collected and provided correctly

• Communicating with clients via tickets

• Communication with team

• Solving not typical working issues

4. WORK SCHEDULE

• Work remotely from home

• Full time

• Target work schedule is 10:00-19:00 (GMT+2), flexible schedule allowed

WHAT WE OFFER

A competitive compensation package includes:

- wage and periodic reviews

- yearly bonus

- health support bonus

- performance-based growth opportunities

- paid vacation and sick leaves

- hardware

Online and offline test are will be provided after first interview

Please, apply with CV in English

salary $800-1200 gross per month, depends on skills

Quantum is a global technology partner delivering high-end software products that address real-world problems. 

We advance emerging technologies for outside-the-box solutions. We focus on Machine Learning, Computer Vision, Deep Learning, GIS, MLOps, Blockchain, and more.

Here at Quantum, we are dedicated to creating state-of-the-art solutions that effectively address the pressing issues faced by businesses and the world. To date, our team of exceptional people has already helped many organizations globally attain technological leadership.

We constantly discover new ways to solve never-ending business challenges by adopting new technologies, even when there isn’t yet a best practice. If you share our passion for problem-solving and making an impact, join us and enjoy getting to know our wealth of experience!

About the position

Quantum is expanding the team and has brilliant opportunities for a proactive Senior Data Engineer who can design, implement, and evolve scalable data systems in AWS. We are building a greenfield analytics platform supporting both batch and real-time data processing. This role is a strategic blend of hands-on development, high-level architectural decision-making, and end-to-end platform ownership.

The client is a technological research company that utilizes proprietary AI-based analysis and language models to provide comprehensive insights into global stocks in all languages. Our mission is to bridge the knowledge gap in the investment world and empower investors of all types to become “super-investors.”

Through our generative AI technology implemented into brokerage platforms and other financial institutions’ infrastructures, we offer instant fundamental analyses of global stocks alongside bespoke investment strategies, enabling informed investment decisions for millions of investors worldwide.

Must have skills:

• 5+ years of experience in Data Engineering
• Strong hands-on experience with Apache Spark (including Structured Streaming)
• Experience building both batch and streaming pipelines in production environments
• Proven experience designing AWS-based data lake architectures (S3, EMR, Glue, Athena)
• Experience with event streaming platforms such as Apache Kafka or Amazon Kinesis
• Experience implementing lakehouse formats such as Delta Lake
• Strong understanding of partitioning strategies and schema evolution
• Experience using SparkUI and AWS CloudWatch for profiling and optimization
• Strong understanding of Spark performance tuning (shuffle, skew, memory, partitioning)
• Proven track record of cost optimization in AWS environments
• Experience with Docker and CI/CD pipelines
• Experience with Infrastructure as Code (Terraform, AWS CDK, or similar)
• Familiarity with monitoring and observability practices
• Upper-Intermediate or higher English proficiency (spoken and written)

Would be a plus:

• Experience in the financial domain
• Experience running Spark workloads on Kubernetes
• Exposure to or interest in Large Language Models (LLMs) and AI integration
• Experience implementing data quality frameworks or metadata/lineage systems

Your tasks will include:

• Design and implement batch and streaming data pipelines using Apache Spark
• Build and evolve a scalable AWS-based data lake architecture
• Develop and maintain real-time data processing systems (event-driven pipelines)
• Own performance tuning and cost optimization of Spark workloads
• Define best practices for data modeling, partitioning, and schema evolution
• Implement monitoring, observability, and data quality controls
• Contribute to infrastructure automation and CI/CD for data workflows

• Participate in architectural decisions and mentor other engineers

   

We offer:

• Delivering high-end software projects that address real-world problems
• Surrounding experts who are ready to move forward professionally
• Professional growth plan and team leader support
• Taking ownership of R&D and socially significant projects
• Participation in worldwide tech conferences and competitions
• Taking part in regular educational activities
• Being a part of a multicultural company with a fun and lighthearted atmosphere
• Working from anywhere with flexible working hours

• Paid vacation and sick leave days

   

Join Quantum and take a step toward your data-driven future.

GlobalLogic is searching for a motivated, results-driven, and innovative software engineer to join our project team at a dynamic startup specializing in pet insurance. Our client is a leading global holding company that is dedicated to developing an advanced pet insurance claims clearing solution designed to expedite and simplify the veterinary invoice reimbursement process for pet owners.
You will be working on a cutting-edge system built from scratch, leveraging Azure cloud services and adopting a low-code paradigm. The project adheres to industry best practices in quality assurance and project management, aiming to deliver exceptional results.
We are looking for an engineer who thrives in collaborative, supportive environments and is passionate about making a meaningful impact on people’s lives. If you are enthusiastic about building innovative solutions and contributing to a cause that matters, this role could be an excellent fit for you.

Requirements

• Strong hands-on experience with Azure Databricks (DLT Pipelines, Lakeflow Connect, Delta Live Tables, Unity Catalog, Time Travel, Delta Share) for large-scale data processing and analytics
• Proficiency in data engineering with Apache Spark, using PySpark, Scala, or Java for data ingestion, transformation, and processing
• Proven expertise in the Azure data ecosystem: Databricks, ADLS Gen2, Azure SQL, Azure Blob Storage, Azure Key Vault, Azure Service Bus/Event Hub, Azure Functions, Azure Data Factory, and Azure CosmosDB
• Solid understanding of Lakehouse architecture, Modern Data Warehousing, and Delta Lake concepts
• Experience designing and maintaining config-driven ETL/ELT pipelines with support for Change Data Capture (CDC) and event/stream-based processing
• Proficiency with RDBMS (MS SQL, MySQL, PostgreSQL) and NoSQL databases
• Strong understanding of data modeling, schema design, and database performance optimization
• Practical experience working with various file formats, including JSON, Parquet, and ORC
• Familiarity with machine learning and AI integration within the data platform context
• Hands-on experience building and maintaining CI/CD pipelines (Azure DevOps, GitLab) and automating data workflow deployments
• Solid understanding of data governance, lineage, and cloud security (Unity Catalog, encryption, access control)
• Strong analytical and problem-solving skills with attention to detail
• Excellent teamwork and communication skills
• Upper-Intermediate English (spoken and written)

Job responsibilities

• Design, implement, and optimize scalable and reliable data pipelines using Databricks, Spark, and Azure data services
• Develop and maintain config-driven ETL/ELT solutions for both batch and streaming data
• Ensure data governance, lineage, and compliance using Unity Catalog and Azure Key Vault
• Work with Delta tables, Delta Lake, and Lakehouse architecture to ensure efficient, reliable, and performant data processing
• Collaborate with developers, analysts, and data scientists to deliver trusted datasets for reporting, analytics, and machine learning use cases
• Integrate data pipelines with event-based and microservice architectures leveraging Service Bus, Event Hub, and Functions
• Design and maintain data models and schemas optimized for analytical and operational workloads
• Identify and resolve performance bottlenecks, ensuring cost efficiency and maintainability of data workflows
• Participate in architecture discussions, backlog refinement, estimation, and sprint planning
• Contribute to defining and maintaining best practices, coding standards, and quality guidelines for data engineering
• Perform code reviews, provide technical mentorship, and foster knowledge sharing within the team
• Continuously evaluate and enhance data engineering tools, frameworks, and processes in the Azure environment

About the Product

We are building a US-based, data-driven product with a strong focus on scalability, performance, and cost efficiency.

Our mission is to design a modern data platform that transforms raw behavioral and monetization data into reliable, actionable business insights — in near real-time.

For us, data engineering is not just about moving data.
It’s about:

• Designing resilient architecture
• Optimizing for performance and cost
• Building reliable automation
• Ensuring architectural integrity at scale
•  

Role Overview

We are looking for a Senior Data Engineer who will take ownership of the data platform architecture and drive technical excellence across ingestion, modeling, and performance optimization.

This role requires deep expertise in SQL, Python, AWS infrastructure, and modern data stack principles. You will not only build pipelines — you will define standards, lead architectural decisions, and proactively improve system efficiency.

You will play a critical role in ensuring that data flows seamlessly from event streams to business-ready datasets while maintaining high performance, reliability, and cost control.

What Makes This Role Senior-Level

As a Senior Data Engineer, you will:

• Own architectural decisions for the data platform
• Identify scalability bottlenecks before they become incidents
• Optimize data infrastructure for performance and cost
• Lead technical code reviews and set engineering standards
• Mentor mid-level engineers
• Act as a technical partner to Product and Analytics stakeholders
• Balance real-time and batch processing strategies strategically

Technical Requirements

Must-Have

Expert-Level SQL

• Complex analytical queries and window functions
• Query optimization and execution plan analysis
• Identifying and eliminating performance bottlenecks
• Reducing query complexity and compute costs
• Designing partitioning and clustering strategies

Python

• Advanced data manipulation
• Building scalable ETL/ELT frameworks
• Writing production-grade data services
• Automation and monitoring scripts

AWS Core Infrastructure

• AWS Kinesis Firehose (near-real-time data streaming)
• Amazon S3 (data lake architecture and storage optimization)
• Designing reliable ingestion layers

Version Control

• Git (GitHub / GitLab)
• Branching strategies
• Leading technical code reviews
• Enforcing best practices in code quality

Nice-to-Have

Modern Data Stack

• dbt (modular SQL modeling, documentation, testing)
• Experience structuring layered data models (staging → intermediate → marts)

Data Warehousing

• Google BigQuery
• Slot management
• Cost-efficient querying
• Storage and compute optimization

Advanced Optimization Techniques

• Partitioning
• Clustering
• Bucketing
• Storage layout optimization

Integrations & Infrastructure

• Salesforce data integration
• Docker / ECS
• CI/CD for data workflows

AI / ML Exposure

• Supporting feature pipelines
• Understanding data requirements for ML systems

Key Responsibilities

Data Platform Architecture

• Design and maintain a scalable real-time and batch data platform
• Architect ingestion pipelines using AWS Kinesis and Python
• Ensure high availability and reliability of data flows

Real-Time Processing

• Enable near-real-time (seconds–minutes latency) data processing
• Build systems for operational alerting and anomaly detection
• Ensure early detection of monetization and traffic issues

Data Modeling

• Transform raw event data into business-ready datasets using dbt
• Design scalable, maintainable schemas aligned with product evolution

Performance & Cost Engineering

• Optimize SQL queries and storage structures
• Design cost-efficient partitioning strategies
• Monitor and reduce warehouse and infrastructure costs
• Balance real-time and batch processing appropriately

Engineering Excellence

• Lead and participate in code reviews
• Enforce high standards of performance, security, and maintainability
• Improve observability and monitoring across pipelines

Cross-Functional Collaboration

• Work closely with Data Analysts and Product Managers
• Translate business requirements into scalable technical solutions
• Clearly communicate trade-offs between speed, cost, and complexity

Type of Data We Process

• User behavior events (page views, clicks, searches, conversions)
• Ad & monetization events (impressions, clicks, CTR, attribution)
• System and integration logs (latency, errors, rate limits)

Why Real-Time Is Critical

• Detect broken ads or impression drops before revenue is lost
• Identify traffic anomalies or abuse early
• Enable same-day operational intervention
• Prevent negative user and advertiser experience

Near-real-time (seconds to minutes latency) is required for operational awareness.
Batch processing remains important for historical analysis and reporting — but not for incident detection.

Working Schedule

• Monday – Friday
• 16:00 – 00:00 Kyiv time
• Full alignment with US-based stakeholders

What We Value

• Strong ownership mindset
• Strategic thinking about architecture
• Focus on scalability, reliability, and cost efficiency
• Proactive problem-solving
• Clear communication with both technical and non-technical teams
• Ability to think beyond “just making it work”

Your future responsibilities:

• Collaborate with data and analytics experts to strive for greater functionality in our data systems
• Design, use and test the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies (DevOps & Continuous Integration)
• Drive the advancement of data infrastructure by designing and implementing the underlying logic and structure for how data is set up, cleansed, and ultimately stored for organizational usage
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Build data integration from various sources and technologies to the data lake infrastructure as part of an agile delivery team
• Monitor the capabilities and react on unplanned interruptions ensuring that environments are provided & loaded in time

Your skills and experience:

• Minimum 5 years experience in a dedicated data engineer role
• Experience working with large structured and unstructured data in various formats
• Knowledge or experience with streaming data frameworks and distributed data architectures (e.g. Spark Structured Streaming, Apache Beam or Apache Flink)
• Experience with cloud technologies (preferable AWS, Azure)
• Experience in Cloud services (Data Flow, Data Proc, BigQuery, Pub/Sub)
• Experience of practical operation of Big Data stack: Hadoop, HDFS, Hive, Presto, Kafka
• Experience of Python in the context of creating ETL data pipelines
• Experience with Data Lake / Data Warehouse solutions (AWS S3 // Minio)
• Experience with Apache Airflow
• Development skills in a Docker / Kubernetes environment
• Open and team-minded personality and communication skills
• Willingness to work in an agile environment

We offer what matters most to you:

• Competitive salary: we guarantee a stable income and annual bonuses for your personal contribution. Additionally, we have a referral program with rewards for bringing in new colleagues to Raiffeisen Bank
• Social package: official employment, 28 days of paid leave, additional paternity leave, and financial assistance for parents with newborns
• Comfortable working conditions: possibility of a hybrid work format, offices equipped with shelters and generators, modern equipment. Classification: PUBLIC
• Wellbeing program: all employees have access to medical insurance from the first working day; consultations with a psychologist, nutritionist, or lawyer; discount programs for sports and purchases; family days for children and adults; in-office massages
• Training and development: access to over 130 online training resources; corporate training programs in CX, Data, IT Security, Leadership, Agile. Corporate library and English lessons. • Great team: our colleagues form a community where curiosity, talent, and innovation are welcome. We support each other, learn together, and grow. You can find like-minded individuals in over 15 professional communities, reading clubs, or sports clubs
• Career opportunities: we encourage advancement within the bank across functions
• Innovations and technologies: Infrastructure: AWS, Kubernetes, Docker, GitHub, GitHub actions, ArgoCD, Prometheus, Victoria, Vault, OpenTelemetry, ElasticSearch, Crossplain, Grafana. Languages: Java (main), Python (data), Go (infra, security), Swift (IOS), Kotlin (Android). Data stores: Sql-Oracle, PgSql, MsSql, Sybase. Data management: Kafka, AirFlow, Spark, Flink
• Support program for defenders: we maintain jobs and pay average wages to mobilized individuals. For veterans, we have a support program and develop the Bank’s veterans community. We work on increasing awareness among leaders and teams about the return of veterans to civilian life. Raiffeisen Bank has been recognized as one of the best employers for veterans by Forbes

Why Raiffeisen Bank?

• Our main value is people, and we support and recognize them, educate them and involve them in changes. Join Raif’s team because for us YOU matter!
• One of the largest lenders to the economy and agricultural business among private banks
• Recognized as the best employer by EY, Forbes, Randstad, Franklin Covey, and Delo.UA
• The largest humanitarian aid donor among banks (Ukrainian Red Cross, UNITED24, Superhumans, СМІЛИВІ)
• One of the largest IT product teams among the country’s banks. • One of the largest taxpayers in Ukraine; 6.6 billion UAH were paid in taxes in 2023

Opportunities for Everyone:

• Rife is guided by principles that focus on people and their development, with 5,500 employees and more than 2.7 million customers at the center of attention
• We support the principles of diversity, equality and inclusiveness
• We are open to hiring veterans and people with disabilities and are ready to adapt the work environment to your special needs
• We cooperate with students and older people, creating conditions for growth at any career stage

Want to learn more? — Follow us on social media:

Facebook, Instagram, LinkedIn

___________________________________________________________________________________________

Райффайзен Банк — найбільший український банк з іноземним капіталом. Більше 30 років ми створюємо та вибудовуємо банківську систему нашої держави.

У Райфі працює понад 5 500 співробітників, серед них одна із найбільших продуктових ІТ-команд, що налічує понад 800 фахівців. Щодня пліч-о-пліч ми працюємо, щоб більш ніж 2,7 мільйона наших клієнтів могли отримати якісне обслуговування, користуватися продуктами і сервісами банку, розвивати бізнес, адже ми #Разом_з_Україною. 

Твої майбутні обов’язки:

• Співпраця з експертами з даних та аналітики, щоб досягти більшої функціональності наших систем даних
• Проектування, використання та тестування інфраструктури, необхідної для оптимального вилучення, перетворення та завантаження даних з широкого спектру джерел даних за допомогою технологій SQL та AWS для великих даних (DevOps та безперервна інтеграція)
• Сприяння розвитку інфраструктури даних шляхом проектування та впровадження базової логіки та структури для налаштування, очищення та, зрештою, зберігання даних для використання в організації
• Збирати великі, складні набори даних, що відповідають функціональним/нефункціональним бізнес-вимогам
• Створювати інтеграцію даних з різних джерел та технологій в інфраструктуру озера даних як частина гнучкої команди з постачання
• Моніторити можливості та реагувати на незаплановані перебої, забезпечуючи своєчасне надання та завантаження середовищ

Твій досвід та навички:

• Мінімум 5 років досвіду роботи на посаді спеціалізованого інженера з даних
• Досвід роботи з великими структурованими та неструктурованими даними в різних форматах
• Знання або досвід роботи з фреймворками потокових даних та розподіленими архітектурами даних (наприклад,
• Spark Structured Streaming, Apache Beam або Apache Flink)
• Досвід роботи з хмарними технологіями (бажано AWS, Azure)
• Досвід роботи з хмарними сервісами (Data Flow, Data Proc, BigQuery, Pub/Sub)
• Досвід практичної експлуатації стеку Big Data: Hadoop, HDFS, Hive, Presto, Kafka
• Досвід роботи з Python у контексті створення ETL-потоків даних
• Досвід роботи з рішеннями Data Lake / Data Warehouse (AWS S3 // Minio)
• Досвід роботи з Apache Airflow
• Навички розробки в середовищі Docker / Kubernetes
• Відкрита та командна особистість, комунікативні навички
• Готовність працювати в гнучкому середовищі

Пропонуємо те, що має значення саме для тебе: 

• Конкурентна заробітна плата: гарантуємо стабільний дохід та річні бонуси за твій особистий внесок. Додатково, у нас діє реферальна програма винагороди за залучення нових колег до Райффайзен Банку.
• Соціальний пакет: офіційне працевлаштування, 28 днів оплачуваної відпустки, додатковий “декрет” для татусів, та матеріальна допомога для батьків при народженні дітей.
• Комфортні умови праці: можливість гібридного формату роботи, офіси забезпеченні укриттями та генераторами, забезпечення сучасною технікою.
• Wellbeing програма: для всіх співробітників доступні медичне страхування з першого робочого дня; консультації психолога, нутриціолога чи юриста; дисконт програми на спорт та покупки; family days для дітей та дорослих; масаж в офісі.
• Навчання та розвиток: доступ до понад 130 навчальних онлайн-ресурсів; корпоративні навчальні програми з CX, Data, IT Security, Лідерства, Agile. Корпоративна бібліотека та уроки англійської.
• Крута команда: наші колеги — це спільнота, де вітаються допитливість, талант та інновації. Ми підтримуємо один одного, вчимося разом та зростаємо. Ти можеш знайти однодумців у понад 15-ти професійних ком’юніті, читацькому чи спортивному клубах.
• Кар’єрні можливості: ми заохочуємо просування всередині банку між функціями.
• Інновації та технології. Infrastructure: AWS, Kubernetes, Docker, GitHub, GitHub actions, ArgoCD, Prometheus, Victoria, Vault, OpenTelemetry, ElasticSearch, Crossplain, Grafana. Languages: Java (main), Python (data), Go(infra,security), Swift (IOS), Kotlin (Andorid). Datastores: Sql-Oracle, PgSql, MsSql, Sybase. Data management: Kafka, AirFlow, Spark, Flink.
• Програма підтримки захисників і захисниць: ми зберігаємо робочі місця та виплачуємо середню заробітну плату мобілізованим. Для ветеранів та ветеранок у нас діє програма підтримки, розвивається ветеранська спільнота Банку. Ми працюємо над підвищенням обізнаності керівників та команд з питань повернення ветеранів до цивільного життя. Райффайзен Банк відзначений як один з найкращих роботодавців для ветеранів (Forbes).

Чому Райффайзен Банк? 

• Наша головна цінність — люди і ми даємо їм підтримку і визнання, навчаємо, залучаємо до змін. Приєднуйся до команди Райфу, адже для нас ТИ маєш значення! 
• Один із найбільших кредиторів економіки та аграрного бізнесу серед приватних банків 
• Визнаний найкращим працедавцем за версіями EY, Forbes, Randstad, Franklin Covey, Delo.UA 
• Найбільший донор гуманітарної допомогисеред банків (Червоний Хрест України, UNITED24, Superhumans, СМІЛИВІ) 
• Один із найбільших платників податків в Україні, за 2023 рік було сплачено 6,6 млрд гривень

Можливості для всіх: 

• Райф керується принципами, що фокусуються на людині та її розвитку, у центрі уваги 5 500 співробітників та понад 2,7 мільйони клієнтів  
• Підтримуємо принципи різноманіття, рівності та інклюзивності
• Ми відкриті до найму ветеранів і людей з інвалідністю та готові адаптувати робоче середовище під ваші особливі потреби
• Співпрацюємо зі студентами та людьми старшого віку, створюючи умови для зростання на будь-якому етапі кар’єри

Бажаєш дізнатися більше? — Підписуйся на нас у соц.мережах:

Facebook, Instagram, LinkedIn 

Looking for a Data Engineer to join the Dataforest team. If you are looking for a friendly team, a healthy working environment, and a flexible schedule ‒ you have found the right place to send your CV.

Skills requirements:
• 2+ years of experience with Python;
• 2+ years of experience as a Data Engineer;
• Experience with Pandas;
• Experience with SQL DB / NoSQL (Redis, Mongo, Elasticsearch) / BigQuery;
• Familiarity with Amazon Web Services;
• Knowledge of data algorithms and data structures is a MUST;
• Working with high volume tables 10m+.

Optional skills (as a plus):
• Experience with Spark (pyspark);
• Experience with Airflow;
• Experience with Kafka;
• Experience in statistics;
• Knowledge of DS and Machine learning algorithms..

Key responsibilities:
• Create ETL pipelines and data management solutions (API, Integration logic);
• Different data processing algorithms;
• Involvement in creation of forecasting, recommendation, and classification models.

We offer:

• Great networking opportunities with international clients, challenging tasks;

• Building interesting projects from scratch using new technologies;

• Personal and professional development opportunities;

• Competitive salary fixed in USD;

• Paid vacation and sick leaves;

• Flexible work schedule;

• Friendly working environment with minimal hierarchy;

• Team building activities, corporate events.

Dataforest is looking for a Senior Data Engineer to join our team and work on the Dropship project — a cutting-edge data intelligence platform for e-commerce analytics.
You will be responsible for developing and maintaining a scalable data architecture that powers large-scale data collection, processing, analysis, and integrations.

If you are passionate about data optimization, system performance, and architecture, we’re waiting for your CV!

Requirements:
• 4+ years of commercial experience with Python;
• Advanced experience with SQL DBs (optimisations, monitoring, etc.);
• PostgreSQL — must have;
• Solid understanding of ETL principles (architecture/ monitoring/ alerting/search and resolve bottlenecks);
• Experience with Message brokers: Kafka/ Redis;
• Experience with Pandas;
• Familiar with AWS infrastructure (boto3, S3 buckets, etc);
• Experience working with large volumes of data;
• Understanding the principles of medallion architecture.   

Will Be a Plus:
• Understanding noSQL DBs (Elastic);
• TimeScaleDB;
• PySpark;
• Experience with e-commerce or fintech.   
 

Key Responsibilities:

• Develop and maintain a robust and scalable data processing architecture using Python.

•  Design, optimize, and monitor data pipelines using Kafka and AWS SQS.

•  Implement and optimize ETL processes for various data sources.

•  Manage and optimize SQL and NoSQL databases (PostgreSQL, TimeScaleDB, Elasticsearch).

•  Work with AWS infrastructure to ensure reliability, scalability, and cost efficiency.

•  Proactively identify bottlenecks and suggest technical improvements.

 We offer:

•  Working in a fast-growing company;

•  Great networking opportunities with international clients, challenging tasks;

• Personal and professional development opportunities;
• Competitive salary fixed in USD;
• Paid vacation and sick leaves;
• Flexible work schedule;
• Friendly working environment with minimal hierarchy;
• Team building activities, corporate events.

We are looking for you!
 

As we continue to design and build data-driven solutions across diverse domains — we’re seeking a Data Engineer who thrives on transforming data into impactful insights. If you’re passionate about crafting robust architectures, optimizing data pipelines, and enabling intelligent decision-making at scale, we’d love to have you join our global team and shape the next generation of data excellence with us.

Contract type: Gig contract.

Skills and experience you can bring to this role
 

Qualifications & experience:
 

• 3+ years of intensive experience as a Data Engineer or in a similar role, with a demonstrable track record of leading large-scale projects;
• Mastery in Python and data stack (NumPy, Pandas, scikit-learn);
• Good Understanding of SQL/RDBMS and familiarity with data warehouses (BigQuery, Snowflake, Redshift, etc.);
• Experience building ETL data pipelines (Airflow, Prefect, Dagster, etc);
• Experience with modern Scrum-based Software Development Life Cycle (SDLC);
• Strong communication skills to explain technical insights to non-technical stakeholders.

Nice to have:

• Hands-on experience with Python web stack (Fast API / Flask);
• Proven expertise in designing and optimizing large-scale data pipelines;
• Comprehensive understanding of data governance principles and data quality management practices;
• Understand marketing and media metrics (i.e., what conversion rate is and how it is calculated).
• Exceptional leadership, communication, and collaboration skills, with a knack for guiding and nurturing teams.
   

Educational requirements:

• Bachelor’s degree in Computer Science, Information Systems, or a related discipline is preferred.

What impact you’ll make 
 

• Lead the design, development, testing, and maintenance of scalable data architectures, ensuring they align with business and technical objectives;
• Spearhead the creation of sophisticated data pipelines using Python, leveraging advanced Snowflake capabilities such as Data Shares, Snowpipe, Snowpark, and more;
• Collaborate intensively with data scientists, product teams, and other stakeholders to define and fulfill intricate data requirements for cross-channel budget optimization solutions;
• Drive initiatives for new data collection, refining existing data sources, and ensuring the highest standards of data accuracy and reliability;
• Set the gold standard for data quality, introducing cutting-edge tools and frameworks to detect and address data inconsistencies and inaccuracies; and
• Identify, design, and implement process improvements, focusing on data delivery optimization, automation of manual processes, and infrastructure enhancements for scalability.

What you’ll get 
 

Regardless of your position or role, we have a wide array of benefits in place, including flexible working (hybrid/remote models) and generous time off policies (unlimited vacations, sick and parental leaves) to make it easier for all people to thrive and succeed at Star. On top of that, we offer an extensive reward and compensation package, intellectually and creatively stimulating space, health insurance and unique travel opportunities.

Your holistic well-being is central at Star. You'll join a warm and vibrant multinational environment filled with impactful projects, career development opportunities, mentorship and training programs, fun sports activities, workshops, networking and outdoor meet-ups.

We are seeking a Senior Data Engineer to deliver data-driven solutions that optimize fleet utilization and operational efficiency across 46,000+ assets in 545+ locations. You will enable decision-making through demand forecasting, asset cascading, contract analysis, and risk detection, partnering with engineering and business stakeholders to take models from concept to production on AWS. 

Requirements 

• 5+ years of experience in data engineering 
• 3+ years of hands-on experience building and supporting production ETL/ELT pipelines 
• Advanced SQL skills (CTEs, window functions, performance optimization) 
• Strong Python skills (pandas, API integrations) 
• Proven experience with Snowflake (schema design, Snowpipe, Streams, Tasks, performance tuning, data quality) 
• Solid knowledge of AWS services: S3, Lambda, EventBridge, IAM, CloudWatch, Step Functions 
• Strong understanding of dimensional data modeling (Kimball methodology, SCDs) 
• Experience working with enterprise systems (ERP, CRM, or similar) 

Nice-to-haves 

• Experience with data quality frameworks (Great Expectations, Deequ) 
• Knowledge of CDC tools and concepts (AWS DMS, Kafka, Debezium) 
• Hands-on experience with data lake technologies (Apache Iceberg, Parquet) 
• Exposure to ML data pipelines and feature stores (SageMaker Feature Store) 
• Experience with document processing tools such as Amazon Textract 

Core Responsibilities 

• Design and develop ETL/ELT pipelines using Snowflake, Snowpipe, internal systems, Salesforce, SharePoint, and DocuSign 
• Build and maintain dimensional data models in Snowflake using dbt, including data quality checks (Great Expectations, Deequ) 
• Implement CDC patterns for near real-time data synchronization 
• Manage and evolve the data platform across S3 Data Lake (Apache Iceberg) and Snowflake data warehouse 
• Build and maintain Medallion architecture data lake in Snowflake 
• Prepare ML features using SageMaker Feature Store 
• Develop analytical dashboards and reports in Power BI 

What we offer   

• Continuous learning and career growth opportunities 
• Professional training and English/Spanish language classes   
• Comprehensive medical insurance 
• Mental health support 
• Specialized benefits program with compensation for fitness activities, hobbies, pet care, and more 
• Flexible working hours 
• Inclusive and supportive culture 
   

Вимоги до володіння мовами

Англійська

B1 – Середній

Українська

Носій мови
 

Про компанію Trinetix

Established in 2011, Trinetix is a dynamic tech service provider supporting enterprise clients around the world. 

Headquartered in Nashville, Tennessee, we have a global team of over 1,000 professionals and delivery centers across Europe, the United States, and Argentina. We partner with leading global brands, delivering innovative digital solutions across Fintech, Professional Services, Logistics, Healthcare, and Agriculture. 

Our operations are driven by a strong business vision, a people-first culture, and a commitment to responsible growth. We actively give back to the community through various CSR activities and adhere to international principles for sustainable development and business ethics. 

To learn more about how we collect, process, and store your personal data, please review our Privacy Notice: https://www.trinetix.com/corporate-policies/privacy-notice 

Company Description

Are you an experienced Data Engineer ready to tackle complex, high-load, and data-intensive systems? We are looking for a Senior professional to join our team in Ukraine, Europe, working full-time on a project that will make a real impact in the public sector.

At Sigma Software, we specialize in delivering innovative solutions for enterprise clients and public organizations. In this role, you will contribute to building an integrated platform that collects, processes, and visualizes critical indicators, enabling better decision-making and analytics.

Why join us? You will work with a modern big data stack, have end-to-end involvement from ingestion to machine learning workflows, and be part of a professional team that values ownership, collaboration, and continuous improvement.

PROJECT
You will be involved in developing an integrated platform that processes both batch and streaming data, ensures secure and governed data environments, and supports advanced analytics and machine learning workflows. The solution will leverage modern big data technologies to provide actionable insights for the public sector.

Job Description

• Design and implement data ingestion pipelines for batch and streaming data
• Configure and maintain data orchestration workflows (Airflow, NiFi) and CI/CD automation for data processes
• Design and organize data layers within Data Lake architecture (HDFS, Iceberg, S3)
• Build and maintain secure and governed data environments using Apache Ranger, Atlas, and SDX
• Develop SQL queries and optimize performance for analytical workloads in Hive/Impala
• Collaborate on data modeling for analytics and BI, ensuring clean schemas and dimensional models
• Support machine learning workflows using Spark MLlib or Cloudera Machine Learning (CML)

Qualifications

• Proven experience in building and maintaining large-scale data pipelines (batch and streaming)
• Strong knowledge of data engineering fundamentals: ETL/ELT, data governance, data warehousing, Medallion architecture
• Strong SQL skills for Data Warehouse data serving
• Minimum 3 years of experience in Python or Scala for data processing
• Hands-on experience with Apache Spark, Kafka, Airflow, and distributed systems optimization
• Experience with Apache Ranger and Atlas for security and metadata management
• Upper-Intermediate English proficiency

WILL BE A PLUS

• Experience with Cloudera Data Platform (CDP)
• Advanced SQL skills and Hive/Impala query optimization
• BS in Computer Science or related field
• Exposure to ML frameworks and predictive modeling

PERSONAL PROFILE

• Ownership mindset and proactive approach
• Ability to drive initiatives forward and suggest improvements
• Team player with shared responsibility for delivery speed, efficiency, and quality
• Excellent written and verbal communication skills

We seek a Junior Data Engineer with basic pandas and SQL experience.

At Dataforest, we are actively seeking Data Engineers of all experience levels.

If you're ready to take on a challenge and join our team, please send us your resume.

We will review it and discuss potential opportunities with you.

Requirements:

• 6+ months of experience as a Data Engineer

• Experience with SQL ;

• Experience with Python;

Optional skills (as a plus):

• Experience with ETL / ELT pipelines;

• Experience with PySpark;

• Experience with Airflow;

• Experience with Databricks;

Key Responsibilities:

• Apply data processing algorithms;

• Create ETL/ELT pipelines and data management solutions;

• Work with SQL queries for data extraction and analysis;

• Data analysis and application of data processing algorithms to solve business problems;

We offer:

• Onboarding phase with hands-on experience with major DE stack, including Pandas, Kafka, Redis, Cassandra, and Spark

• Opportunity to work with the high-skilled engineering team on challenging projects;

• Interesting projects with new technologies;

• Great networking opportunities with international clients, challenging tasks;

• Building interesting projects from scratch using new technologies;

• Personal and professional development opportunities;

• Competitive salary fixed in USD;

• Paid vacation and sick leaves;

• Flexible work schedule;

• Friendly working environment with minimal hierarchy;

• Team building activities, corporate events.

CrunchCode — міжнародна сервісна ІТ-компанія з досвідом близько 7 років у розробці вебсервісів і вебзастосунків. Ми працюємо у форматах staff augmentation (outstaff) та outsourcing і підключаємо спеціалістів до проєктів клієнтів у довгостроковій моделі співпраці.

Ми працюємо переважно з проєктами в доменах логістики (включно з last mile),e-commerce, fintech та банкінгу, а також enterprise-рішеннями.
Для нас важливо, щоб проєкт був “чистим” і зрозумілим з точки зору етики та цінності для користувачів.

Ми принципово не беремо проєкти, пов’язані з:
● gambling / гемблінгом,
● adult-контентом та порнографією,
● шахрайством або будь-якою розробкою, що спрямована на обман чи маніпуляції.

What We Offer:
● Fully remote work
● Long-term, stable project
● High level of autonomy and trust
● Minimal bureaucracy
● Direct impact on business-critical logistics systems
● Long-term engagement, not a short-term contract.

Required: 
4/5 hours overlap with PST required, start ASAP, initial term with possible extension

Project Overview:
Healthcare solution, innovative and dynamic. Client create a solution, to speed up the process of inserting data by doctors. On average, doctors have to log in to 30 different systems to make sure the treatment will be covered by the insurance company.  So their solution make the copy of info (ex, all clients info) and spread it around all systems they need. This significantly decreases the time. Patients or doctors don’t pay for it, but the insurance companies.

Client Location: USA

Requirements (Must-have):
• 5+ years in data engineering or similar role
• Strong SQL skills
• Experience with Fivetran, dbt, Airflow (or similar orchestration tools)
• Snowflake or equivalent cloud data warehouse experience
• Familiar with BI tools (Superset, Looker, Tableau)
• AWS experience in a data context
• Able to work independently on assigned tasks
• 3–4 hrs/day overlap with PST
• Bonus: healthcare data experience (FHIR, HL7) or HIPAA knowledge

Responsibilities:
• Monitor for upstream schema changes & update pipelines
• Troubleshoot ETL/ELT job failures
• Debug & optimize Superset queries
• Address data quality/access issues
• Document fixes & changes

Hiring Process:
- Intro call
- Technical discussion (focused on real experience)
- Offer
Start: ASAP

We are looking for a Senior Data Engineer to join AltexSoft and strengthen our data engineering practice on a large-scale, high-impact project within the travel and hospitality domain. In this role, you will work hands-on with complex data ecosystems, taking responsibility for the stability, scalability, and performance of mission-critical data integrations.
You will play a key role in resolving non-trivial technical issues, improving existing pipelines, and evolving engineering processes to make data operations more resilient and proactive. The position offers a strong technical challenge and real influence on systems that process massive volumes of data used by analytics platforms and customer-facing products.
 

You Have

• 5+ years of experience in Python and proven experience working with large-scale datasets.
• Experience with PMS integrations/Hospitality domain
• Solid background in designing, building, and maintaining data processing pipelines.
• Experience with cloud platforms (GCP, AWS, or Azure).
• Hands-on skills with SQL and data storage/querying systems (e.g., BigQuery, BigTable, or similar).
• Knowledge of containerization and orchestration tools (Docker, Kubernetes).
• Ability to troubleshoot and debug complex technical issues in distributed systems.
• Strong communication skills in English, with the ability to explain technical details to both technical and non-technical stakeholders.
• Experience using AI coding assistants (e.g., Cursor, GitHub Copilot, or similar) in day-to-day development tasks.

• Experience with Google Cloud services such as Pub/Sub, Dataflow, and ML-driven data workflows.

   

Would be a plus

• Experience with airline, travel, or hospitality-related datasets.
• Exposure to observability and monitoring tools for large-scale data systems.
• Experience building AI-powered solutions or integrating AI pipelines/APIs into software projects.
• Experience with 2nd tier PMS market like Tesipro or Maestro.

• Or any property management systems APIs.

   

You Are Going To

• Maintain and enhance existing data integrations, ensuring the reliability, accuracy, and quality of incoming data.
• Lead the investigation and resolution of complex incidents by performing deep technical analysis and debugging.
• Communicate effectively with stakeholders (including customer-facing teams and external partners) by providing transparent and timely updates.
• Collaborate with partners to troubleshoot integration issues and ensure smooth data flow.
• Identify opportunities to improve processes, tooling, and documentation to scale and streamline data operations.
• Contribute to the design and delivery of new data engineering solutions supporting business-critical systems.

We offer

Job Description

We're excited if you have:
- 4+ years of commercial data engineering/analytics experience
- Good culture fit and excellent team player
- Strong level knowledge of Python
- Strong knowledge of SQL
- Experience with ETL/ELT and Reverse ETL (Hightouch preferred)
- Experience with Data warehouse systems (e.g. Snowflake)
- Experience with CDP and Analytics systems
- Strong English, both verbal (video meetings online) and written (requirements, descriptions, blueprints).
- BS or MS degree in Computer Science or equivalent

It is a plus if you have:
- Experience with analytics: Tableau, Power BI, DOMO

Job Responsibilities

What you'll be doing
- Work in the team working under agile software engineering (analysis, architecture, technical design, task planning, coding, PR reviews, maintenance, etc.) framework
- Build & maintain data engineering pipelines in the media domain space
- Work with APIs, webhooks, and batch processes
- Design and optimize data schemas, queries, storage, processing costs (e.g. in Snowflake)
- Clean and enrich data using SQL-based transformations
- Set up data validation checks, implement data observability, manage PII
- Sync data across various systems
- Document data pipelines, transformations, best practises
- Collaborate with Product, Engineering Managers, Analytics and Data engineering teams in to build and enhance the data pipelines

Department/Project Description

Development, refactoring, and maintenance of data and analytics pipelines for an international broadcasting company headquartered in New York, US. The company owns several television channels/brands, developed state-of-the-art TV streaming applications for Android TV, Android Mobile, Apple TV, and Fire TV platforms, and wants to improve its data processing.

CrunchCode — міжнародна сервісна ІТ-компанія з досвідом близько 7 років у розробці вебсервісів і вебзастосунків. Ми працюємо у форматах staff augmentation (outstaff) та outsourcing і підключаємо спеціалістів до проєктів клієнтів у довгостроковій моделі співпраці.

Ми працюємо переважно з проєктами в доменах логістики (включно з last mile),e-commerce, fintech та банкінгу, а також enterprise-рішеннями.
Для нас важливо, щоб проєкт був “чистим” і зрозумілим з точки зору етики та цінності для користувачів.

Ми принципово не беремо проєкти, пов’язані з:
● gambling / гемблінгом,
● adult-контентом та порнографією,
● шахрайством або будь-якою розробкою, що спрямована на обман чи маніпуляції.

What We Offer:
● Fully remote work
● Long-term, stable project
● High level of autonomy and trust
● Minimal bureaucracy
● Direct impact on business-critical logistics systems
● Long-term engagement, not a short-term contract.

Required: 
Data migration to Snowflake/dbt using AI-native development (Cursor/Claude) and clean SQL/Python

Project Overview:
Project overview: client is an "old school" organization currently undergoing a digital transformation. They are building agentic tools and hiring technologists to differentiate themselves in the education space.

Domain: Education

Requirements (Must-have):
- SQL, dbt Cloud/pipelines, Snowflake, Python

Responsibilities:
- Optimize the initial user experience (post-conversion), Focus on deepening user engagement after they join the society (rather than just driving immediate monetization or LTV), Run experiments to iterate on the sign-up and product experience.

Hiring Process:
- Intro call
- Technical discussion (focused on real experience)
- Offer
Start: ASAP