AI Quality Analyst – Remote

About the role

We are seeking a full‑time AI Quality Analyst to evaluate a new personalization feature for an AI model. You will assess how well the model integrates information from past conversations, email, search, and activity to deliver relevant responses.

Key responsibilities

• Evaluate the quality of personalized AI responses using personal experiences as context.
• Design creative multi‑turn prompts to test the model’s ability to accurately integrate personal data sources.
• Assess model outputs for grounding, integration, helpfulness and identify incorrect personalization or forced connections.
• Review side‑by‑side AI response comparisons to detect subtle relevance and accuracy differences.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong English reading and writing proficiency.
• Experience with prompt engineering or designing test cases for AI models.
• Ability to analytically evaluate nuanced and ambiguous AI responses.
• Familiarity with personalization concepts and AI evaluation metrics.
• Attention to detail for spotting subtle discrepancies in model outputs.
• Willingness to use your primary personal Google account and enable personal data sources for assessment.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.

Required skills

• Prompt engineering
• AI model evaluation
• Data integration testing

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology and AI.
• Remote work from anywhere.
• Inclusive, equal‑opportunity environment.