AI Quality Analyst – Remote

About the role

We are looking for a remote AI Quality Analyst to evaluate a new personalization feature for an AI model. The role involves using your own experiences and data sources to test how well the model integrates personal information into its responses.

Key responsibilities

• Assess the quality of personalized AI responses using personal context.
• Design multi‑turn prompts that challenge the model’s ability to integrate data from emails, searches and activity.
• Evaluate responses for grounding, relevance, helpfulness and correct personalization.
• Compare side‑by‑side AI outputs to spot subtle differences in accuracy.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Excellent English reading and writing skills.
• Experience creating prompts or test cases for AI systems.
• Strong analytical ability to interpret nuanced model outputs.
• Willingness to use your personal Google account and enable data sources for testing.
• Full‑time availability in your local time zone to support a 24‑hour operations team.

Required skills

• Prompt engineering
• AI model evaluation
• Understanding of personalization concepts in AI

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology and AI.
• Fully remote work from anywhere.