Quality Analyst (Remote)

About the role

We are seeking a full‑time Quality Analyst to evaluate a new personalization feature for an AI model. The role is remote and involves using your own personal data sources to assess how well the model integrates past conversations, email, search, and activity into relevant responses.

Key responsibilities

• Evaluate personalized AI responses using personal experiences as context.
• Design multi‑turn prompts that test the model’s ability to integrate personal data accurately.
• Assess responses for grounding, integration, helpfulness, and detect incorrect personalization.
• Review side‑by‑side AI output comparisons to identify subtle relevance differences.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong English reading and writing proficiency.
• Experience in prompt engineering or creating test cases for AI models.
• Ability to analyze nuanced and ambiguous AI outputs with rigor.
• Attention to detail for spotting subtle discrepancies.
• Willingness to use a personal Google account and enable data sources for testing.

Required skills

• Prompt engineering

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology and AI.
• Fully remote work environment.