AI Quality Analyst – Remote

About the role

We are seeking an AI Quality Analyst to evaluate a new personalization feature for an AI model. Working remotely, you will assess how well the model integrates personal data from past conversations, email, search and activity to deliver relevant, helpful responses.

Key responsibilities

• Evaluate the quality of personalized AI responses using your own personal experiences as context.
• Design creative, multi‑turn prompts that test the model’s ability to accurately integrate personal data sources.
• Assess model outputs for grounding, integration, helpfulness and identify incorrect personalization or forced connections.
• Review side‑by‑side comparisons of AI responses to detect subtle differences in relevance and accuracy.
• Provide detailed feedback on model behavior to improve personalization performance.

Required profile

• High proficiency in English reading and writing.
• Experience in prompt engineering or designing test cases for AI models.
• Strong analytical ability to evaluate nuanced and ambiguous AI responses.
• Familiarity with personalization concepts and evaluation metrics in AI systems.
• Attention to detail for spotting subtle discrepancies in model outputs.
• Willingness to use your primary personal Google account and enable personal data sources for assessment.
• Full‑time availability in your local time zone to support a global, 24‑hour operations team.

Required skills

• Prompt engineering

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology and AI development.