Quantum

Quantum is a global technology partner delivering high-end software products that address real-world problems. 

We advance emerging technologies for outside-the-box solutions. We focus on Machine Learning, Computer Vision, Deep Learning, GIS, MLOps, Blockchain, and more.

Here at Quantum, we are dedicated to creating state-of-the-art solutions that effectively address the pressing issues faced by businesses and the world. To date, our team of exceptional people has already helped many organizations globally attain technological leadership.

We constantly discover new ways to solve never-ending business challenges by adopting new technologies, even when there isn’t yet a best practice. If you share our passion for problem-solving and making an impact, join us and enjoy getting to know our wealth of experience!

About the position

Quantum is expanding the team and has brilliant opportunities for a proactive Senior Data Engineer who can design, implement, and evolve scalable data systems in AWS. We are building a greenfield analytics platform supporting both batch and real-time data processing. This role is a strategic blend of hands-on development, high-level architectural decision-making, and end-to-end platform ownership.

The client is a technological research company that utilizes proprietary AI-based analysis and language models to provide comprehensive insights into global stocks in all languages. Our mission is to bridge the knowledge gap in the investment world and empower investors of all types to become “super-investors.”

Through our generative AI technology implemented into brokerage platforms and other financial institutions’ infrastructures, we offer instant fundamental analyses of global stocks alongside bespoke investment strategies, enabling informed investment decisions for millions of investors worldwide.

Must have skills:

• 5+ years of experience in Data Engineering
• Strong hands-on experience with Apache Spark (including Structured Streaming)
• Experience building both batch and streaming pipelines in production environments
• Proven experience designing AWS-based data lake architectures (S3, EMR, Glue, Athena)
• Experience with event streaming platforms such as Apache Kafka or Amazon Kinesis
• Experience implementing lakehouse formats such as Delta Lake
• Strong understanding of partitioning strategies and schema evolution
• Experience using SparkUI and AWS CloudWatch for profiling and optimization
• Strong understanding of Spark performance tuning (shuffle, skew, memory, partitioning)
• Proven track record of cost optimization in AWS environments
• Experience with Docker and CI/CD pipelines
• Experience with Infrastructure as Code (Terraform, AWS CDK, or similar)
• Familiarity with monitoring and observability practices
• Upper-Intermediate or higher English proficiency (spoken and written)

Would be a plus:

• Experience in the financial domain
• Experience running Spark workloads on Kubernetes
• Exposure to or interest in Large Language Models (LLMs) and AI integration
• Experience implementing data quality frameworks or metadata/lineage systems

Your tasks will include:

• Design and implement batch and streaming data pipelines using Apache Spark
• Build and evolve a scalable AWS-based data lake architecture
• Develop and maintain real-time data processing systems (event-driven pipelines)
• Own performance tuning and cost optimization of Spark workloads
• Define best practices for data modeling, partitioning, and schema evolution
• Implement monitoring, observability, and data quality controls
• Contribute to infrastructure automation and CI/CD for data workflows

• Participate in architectural decisions and mentor other engineers

   

We offer:

• Delivering high-end software projects that address real-world problems
• Surrounding experts who are ready to move forward professionally
• Professional growth plan and team leader support
• Taking ownership of R&D and socially significant projects
• Participation in worldwide tech conferences and competitions
• Taking part in regular educational activities
• Being a part of a multicultural company with a fun and lighthearted atmosphere
• Working from anywhere with flexible working hours

• Paid vacation and sick leave days

   

Join Quantum and take a step toward your data-driven future.