Senior Python Software Engineer (AI / RAG / LLM)

Senior Python Software Engineer (AI / RAG / LLM)

Project Details

• Location: Ukraine / EU
• Work format: Remote, full-time
• Duration: 3+ months
• Rate: Up to $22/hour
• English: B2+

We are looking for a Senior Python Software Engineer to join the development of an AI-powered platform for a global consulting firm's construction and infrastructure projects practice.

The platform processes over 1 million documents (10+ TB per client) and enables users to ask complex questions across large project portfolios using AI assistants, intelligent document retrieval, and agent-based workflows.

Responsibilities

• Design and develop scalable Python backend services and APIs using FastAPI or similar frameworks.
• Build document search, navigation, and contextual retrieval services for AI assistants and agents.
• Implement LLM workflows, including tool calling, multi-step orchestration, structured outputs, and streaming responses with citations.
• Integrate RAG pipelines with hybrid search, reranking, and contextual retrieval.
• Develop model gateway capabilities, including caching, rate limiting, retries, and token/cost optimization.
• Integrate backend services with PostgreSQL and enforce document-level access permissions.
• Implement automated testing, CI/CD, observability, and infrastructure as code.
• Collaborate with AI and data engineers on system architecture, performance, and retrieval quality.

Requirements

• 5+ years of professional Python backend development experience.
• 1+ year of hands-on experience building production LLM applications.
• Strong experience with FastAPI or similar Python frameworks.
• Practical experience with RAG, hybrid search, reranking, and citations.
• Experience with agent frameworks or orchestration patterns such as LangGraph, LlamaIndex, Semantic Kernel, Bedrock Agents, or MCP.
• Strong PostgreSQL knowledge, including query optimization and performance tuning.
• Experience with asynchronous processing, queues, and caching.
• Production experience with AWS, Azure, or GCP.
• Experience with Docker, CI/CD, automated testing, and infrastructure as code (Terraform or AWS CDK).
• Understanding of observability, security, and production reliability.
• English: B2+.

Nice to Have

• Experience with AWS Bedrock, Lambda, ECS/EKS, API Gateway, or RDS.
• Experience with LLM evaluation and automated quality testing.
• Frontend experience with TypeScript and React.

If you have strong Python backend expertise and practical experience delivering LLM-powered applications in production, we'd be happy to hear from you!