Data Science NLP Senior

We are looking for a Generative AI Engineer with extensive experience in NLP, information retrieval, and Generative AI technologies to lead our projects. This role involves strategic planning, advanced development, and implementation of cutting-edge AI solutions, particularly using Large Language Models (LLMs) and industry standard NLP libraries and tools.


Responsibilities:

- Development and deployment of complex AI systems using Generative AI and NLP technologies.

- Architect high-performance AI solutions integrating multiple technologies and platforms.

- Drive innovation by exploring and implementing advanced AI methodologies and tools.

- Provide technical leadership and mentorship to junior+ engineers.

- Collaborate with stakeholders to define project scopes, goals, and deliverables that support business goals.

Required Skills:

- Expertise in Python, with extensive experience in AI-focused libraries like Sentence Transformers, spaCy, HuggingFace, pandas, numpy, NLTK, and related libraries.

- Expertise in object-oriented programming and software architecture, git/DevOps/similar version control tools

- Experience integrating cloud services (AWS, GCP, Azure, etc.) and related APIs into software

- Profound knowledge of NLP concepts including semantic embeddings, intent classification, text scraping, OCR, NER, data labeling, lemmatization in a multilingual environment, machine translation, and information retrieval.

- Demonstrable experience with Agile development and leading engineering teams.

- Understanding of LLM and ML model performance metrics and up-to-date knowledge of the market (AWS, Azure, and Anthropic offerings, current research)

- Deep understanding of NLP evaluation metrics such as Rouge, Recall N, Mean Reciprocal Rank, contextual relevance, semantic similarity, Faithfulness, Completeness, etc.

- Experience with Elasticsearch or similar document-level search technologies or a demonstrable knowledge of the algorithms used in such information retrieval tools

- Understanding of NLP concepts like RAG, Intent classification, Semantic similarity.

Preferred Qualifications:

- Strong experience with SQL and database management

- Proficiency in Docker, Fast-API, and designing scalable systems using Azure Cloud services.

- Experience with Langchain, LlamaIndex, DSPy, AzureOpenAI, and other libraries for interacting with LLMs (Experience with all libraries isn’t required, but familiarity with the concepts is essential)

- Proven track record of delivering large-scale AI projects in a corporate or enterprise environment.