AI Quality Analyst – Remote

About the role

We are looking for an AI Quality Analyst to work remotely on a full‑time basis. You will evaluate a new personalization feature for an AI model, using your own experiences as context to assess how well the system integrates data from past conversations, email, search and activity.

Key responsibilities

• Evaluate the quality of personalized AI responses against real‑world personal data.
• Design creative multi‑turn prompts that test the model’s ability to integrate personal data sources accurately.
• Assess model outputs for grounding, relevance, helpfulness and correct personalization.
• Review side‑by‑side comparisons of AI responses to spot subtle differences in accuracy.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Strong English reading and writing proficiency.
• Experience in prompt engineering or creating test cases for AI models.
• Ability to analyse nuanced and ambiguous AI responses with rigor.
• Familiarity with personalization concepts and evaluation metrics.
• Attention to detail for identifying subtle output discrepancies.
• Willingness to use a personal Google account and enable personal data sources for testing.
• Full‑time availability in your local time zone to support a 24‑hour operations team.

Required skills

• Prompt engineering
• AI model evaluation

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology and AI.
• Fully remote work from anywhere.