Senior Python Engineer

Responsibilities:

• Develop and optimize data indexing, preprocessing, and deduplication pipelines.
• Integrate and configure RAG components, work with vector databases.
• Build ETL/ELT pipelines.
• Optimize system performance and scalability.

Requirements:

• Expert in Python
• Experience building data processing systems, ETL pipelines, or high-load services.
• Experience with asynchronous programming (asyncio, Celery, etc.).
• Secure data processing and serialization (JSON, MessagePack, Protobuf).
• Experience with PostgreSQL, MySQL, or NoSQL (MongoDB).
• Secure coding principles: input validation, avoiding injection attacks.
• Building secure internal APIs (not necessarily web-facing).
  Experience with Docker, Kubernetes, and secure container deployment.

• Familiarity with Linux hardening and secure configuration.

   

Nice to Have

• Experience with RAG and frameworks for building RAG pipelines.
• Experience working with vector databases.
• Understanding of data mining principles, unstructured data parsing, normalization, and cleaning.