HTC Global Services wants you. Come build new things with us and advance your career. At HTC Global you'll collaborate with experts. You'll join successful teams contributing to our clients' success. You'll work side by side with our clients and have long-term opportunities to advance your career with the latest emerging technologies.

At HTC Global Services our consultants have access to a comprehensive benefits package. Benefits can include Paid-Time-Off, Paid Holidays, 401K matching, Life and Accidental Death Insurance, Short & Long Term Disability Insurance, and a variety of other perks.

Job Description:

We are seeking an experienced LLM Quality Assurance Test Engineer to evaluate, validate, and enhance our generative AI platforms specifically for Company Experience applications across parks, resorts, and cruise lines. These role is critical for ensuring our generative AI platforms provide accurate, helpful, and magical experiences for guests across all Company Experience touchpoints, maintaining Company's high standards for guest service and satisfaction. Key Responsibilities • Design and execute comprehensive test strategies for Large Language Models • Develop sophisticated prompting techniques to evaluate LLM responses about Company Experience offerings • Create test cases that validate accurate knowledge of parks, resorts, and cruise operations • Identify potential vulnerabilities and edge cases in guest-facing LLM interactions • Document and track model behaviours, issues, and improvements • Collaborate with AI/ML teams to improve model performance and safety

Basic Qualifications

• 3+ years of experience in Quality Assurance, with at least 1 year focused on AI/ML systems

• Demonstrated expertise in LLM evaluation methodologies and prompt engineering

• Strong understanding of LLM limitations, biases, and potential failure modes

• Excellent analytical and problem-solving skills

• Strong documentation and communication abilities

Technical Skills

• Experience with LLM testing frameworks and evaluation metrics

• Knowledge of prompt engineering best practices

• Understanding of AI safety and ethical considerations

• Familiarity with version control systems and bug tracking tools

• Basic programming skills for test automation (Python preferred)

Key Competencies

• Creative problem-solving for edge case discovery

• Attention to detail in identifying subtle model behaviors

• Strong analytical thinking for systematic testing approaches

• Ability to think like both a guest and an adversary

• Excellence in cross-functional collaboration

Preferred Qualifications

• Familiarity with Experience digital platforms (apps, websites, reservation systems)

• Understanding of guest experience standards and service values

• Deep understanding of Company parks, resorts, and cruise operations including:

o Theme Park attractions, entertainment, and experiences

o Resort properties and amenities

o Company Cruise Line itineraries and offerings

o Company Genie+ and Lightning Lane systems

o Dining reservations and options

o Special events and seasonal celebrations

o Guest services and operations

o Park policies and procedures