Senior Backend Engineer. High-Performance Data Streaming

We are looking for a senior backend engineer to build a high-performance service for streaming large datasets.

This is not a conventional CRUD backend role. You will work on persistent HTTP/3 connections, asynchronous I/O, object-storage range reads, binary data transfer, authentication, request scheduling, etc.

What you will do

• Design and build the data-streaming service in Python.
• Implement HTTP/3 and QUIC-based client-server communication.
• Integrate with S3-compatible object storage.
• Build request prioritisation, cancellation, retries, caching, and backpressure.
• Implement token-based authentication and fine-grained access control.
• Integrate Python services with native libraries and binary data formats.
• Add metrics, tracing, load testing, and failure recovery.
• Work closely with desktop visualisation and Python/ML client teams.
• Benchmark streaming performance against download-first workflows.

What we are looking for

• Strong production experience with Python.
• Experience with asynchronous Python, task scheduling, and concurrent I/O.
• Experience building high-throughput or low-latency backend systems.
• Good understanding of networking, HTTP, TLS, and binary protocols.
• Practical knowledge of S3, MinIO, Ceph, or similar object storage.
• Experience with streaming I/O, byte-range reads, caching, and memory management.
• Strong performance-profiling and debugging skills.
• Ability to design stable interfaces between independently developed systems.

Nice to have

• Production experience with C++. 
• Experience with HTTP/3, QUIC, WebTransport, or high-performance RPC.
• Background in distributed storage, CDNs, databases, filesystems, or media streaming.
• Familiarity with scientific visualisation, HPC, simulation, or large multidimensional datasets.
• Experience with CUDA or GPU data pipelines.
• Experience with OAuth, OIDC, JWT, and capability-based access.
• Knowledge of Kubernetes and OpenTelemetry.