Lead Java AQA Engineer (Generative AI-LLMs) IRC289450

Description

The client is one of the largest global independent private equity fund administrators, administering over $300 billion of private capital on behalf of its clients with offices in New York, San Francisco, Boston, Stamford, Dallas, and Luxembourg. They offer private fund sponsors a best-in-class combination of people, process, and technology, enabling fund sponsors to most effectively manage their operational infrastructure, financial reporting, and investor communications.

The client represents the most experienced and longest-tenured team in the private equity fund administration industry, with broad expertise across buyout, funds of funds, real estate, energy, infrastructure, credit, co-investment, hybrid funds, feeder funds, venture capital, retail, and managed accounts.

The project aims to provide well-prepared and formatted analytic data for the customer.

Requirements

• 6+ years QA experience
• Distributed backend systems
• API-heavy applications
• Enterprise web applications
• Experience with LLM-based systems (or strong understanding of AI system validation challenges)
• Java-based automation (RestAssured, JUnit/TestNG)
• Integration testing
• Performance validation

Critical Competencies

• Understanding that LLM systems are probabilistic
• Ability to design validation around tolerance ranges
• Risk-based testing mindset
• Enterprise governance awareness
• Leadership & coordination skills
•  

Job responsibilities

Own the end-to-end quality strategy and validation of an enterprise-grade AI-powered chatbot integrated with financial APIs. Responsible for quality governance across LLM behavior, backend services, frontend UI, and system integration.

• Define validation strategy for LLM-based orchestration
• Establish and maintain Golden Dataset validation framework
• Define manual drift validation process
• Prompt templates behavior
• Structured query outputs
• Guardrails & content safety enforcement
• Ensure reproducibility within defined tolerance limits
• API contract testing
• DTO normalization validation
• Context filtering & multi-tenant isolation tests
• Validate UI rendering
• Define regression scenarios for FE + BE integration
• Ensure UI reflects structured backend outputs correctly
• Own end-to-end test matrix
• Define performance validation approach
• Coordinate performance baseline verification
• Define automation coverage strategy
• Supervise Java-based automation framework
• Ensure CI integration of regression suite

• Define quality gates for release

   

What we offer

Culture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders. 

Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.

Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.

Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.