Data Science NLP Senior
We are looking for a Generative AI Engineer with extensive experience in NLP, information retrieval, and Generative AI technologies to lead our projects. This role involves strategic planning, advanced development, and implementation of cutting-edge AI solutions, particularly using Large Language Models (LLMs) and industry standard NLP libraries and tools.
Responsibilities:
- Development and deployment of complex AI systems using Generative AI and NLP technologies.
- Architect high-performance AI solutions integrating multiple technologies and platforms.
- Drive innovation by exploring and implementing advanced AI methodologies and tools.
- Provide technical leadership and mentorship to junior+ engineers.
- Collaborate with stakeholders to define project scopes, goals, and deliverables that support business goals.
Required Skills:
- Expertise in Python, with extensive experience in AI-focused libraries like Sentence Transformers, spaCy, HuggingFace, pandas, numpy, NLTK, and related libraries.
- Expertise in object-oriented programming and software architecture, git/DevOps/similar version control tools
- Experience integrating cloud services (AWS, GCP, Azure, etc.) and related APIs into software
- Profound knowledge of NLP concepts including semantic embeddings, intent classification, text scraping, OCR, NER, data labeling, lemmatization in a multilingual environment, machine translation, and information retrieval.
- Demonstrable experience with Agile development and leading engineering teams.
- Understanding of LLM and ML model performance metrics and up-to-date knowledge of the market (AWS, Azure, and Anthropic offerings, current research)
- Deep understanding of NLP evaluation metrics such as Rouge, Recall N, Mean Reciprocal Rank, contextual relevance, semantic similarity, Faithfulness, Completeness, etc.
- Experience with Elasticsearch or similar document-level search technologies or a demonstrable knowledge of the algorithms used in such information retrieval tools
- Understanding of NLP concepts like RAG, Intent classification, Semantic similarity.
Preferred Qualifications:
- Strong experience with SQL and database management
- Proficiency in Docker, Fast-API, and designing scalable systems using Azure Cloud services.
- Experience with Langchain, LlamaIndex, DSPy, AzureOpenAI, and other libraries for interacting with LLMs (Experience with all libraries isn’t required, but familiarity with the concepts is essential)
- Proven track record of delivering large-scale AI projects in a corporate or enterprise environment.