AI Quality Analyst – Remote

About the role

We are looking for an AI Quality Analyst to work remotely on a full‑time basis. You will evaluate a new personalization feature for an AI model, using your own experiences as context and designing creative prompts to test the system’s ability to integrate personal data sources.

Key responsibilities

• Assess the quality of personalized AI responses and identify incorrect or forced connections.
• Design multi‑turn prompts that challenge the model’s integration of email, search, activity and conversation history.
• Review side‑by‑side comparisons of AI outputs to spot subtle differences in relevance and accuracy.
• Provide detailed feedback on grounding, integration and helpfulness to improve model performance.

Required profile

• Strong English reading and writing proficiency.
• Experience in prompt engineering or creating test cases for AI models.
• Ability to analyse nuanced and ambiguous AI responses with analytical rigor.
• Familiarity with personalization concepts and evaluation metrics.
• Willingness to use a personal Google account and enable data sources for testing.
• Full‑time availability in your local time zone to support a 24‑hour operations team.

Required skills

• Prompt engineering

What we offer

• Competitive compensation based on experience.
• Fully remote work from anywhere.
• Opportunity to contribute to a global leader in technology and AI.
• Equal‑opportunity employer.