Senior Backend Engineer (LLM and AI Infrastructure)

CodeTiburon is looking for a Senior Backend Engineer (LLM & AI Infrastructure) to join our team and work closely with one of our long-term clients.

About the project:

We are a deep-tech company building state-of-the-art LLM-based assistants augmented with knowledge graphs. The platform focuses on combining large language models with structured knowledge systems to create more accurate, reliable, and scalable AI assistants.
 

The project involves building robust backend infrastructure that powers AI applications, enabling scalable model inference, retrieval systems, and knowledge graph integrations within a multi-tenant SaaS environment.
 

Responsibilities:
 

• Architect, deploy, and operate scalable backend services and multi-tenant SaaS systems in Kubernetes-based cloud environments
• Design and operate high-throughput data pipelines (batch and streaming)
• Build APIs and services integrating LLM inference, retrieval systems, and knowledge graphs
• Productionize research-grade AI systems into reliable distributed systems
   

Requirements (Must Have):
 

• 7+ years of backend engineering experience
• Strong experience with data pipelines and SaaS architectures
• Strong proficiency in Python
• Deep understanding of distributed systems and cloud-native environments
• Strong hands-on experience with Kubernetes in production environments. Candidates should be comfortable deploying, operating, scaling, and troubleshooting distributed applications on Kubernetes and have practical experience with its core ecosystem (networking, storage, observability, autoscaling, and CI/CD integration).
   

Nice to Have:
 

• Go and/or Scala experience
• Hands-on experience with LLM systems (RAG, model serving, evaluation)
• Experience with knowledge graphs, vector databases, or hybrid retrieval architectures
  
   

Ideal for engineers who enjoy building production-grade systems around cutting-edge AI research.

 

If this sounds like you and your experience aligns with most of the qualifications above, we’d love to hear from you. Please send us your CV.

Thank you for your interest. Each application is carefully reviewed, and candidates whose experience and background best align with the role will be contacted regarding the next steps.