AI Quality Analyst – Remote

About the role

We are seeking an AI Quality Analyst to work remotely on a full‑time basis. In this role you will evaluate a new personalization feature for an AI model, using your own experiences as context to assess how well the system integrates data from past conversations, email, search and activity.

Key responsibilities

• Evaluate the quality of personalized AI responses against real‑world personal data.
• Design creative multi‑turn prompts that test the model’s ability to integrate personal data sources accurately.
• Assess model outputs for grounding, relevance, helpfulness and correct personalization.
• Review side‑by‑side comparisons of AI responses to spot subtle differences in accuracy.
• Provide detailed feedback to improve the model’s personalization performance.

Required profile

• Fluent in English with strong reading and writing skills.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.
• Willingness to use your primary personal Google account and enable personal data sources for testing.

Required skills

• Prompt engineering.
• Experience designing test cases for AI models.
• Analytical ability to evaluate nuanced AI responses.

What we offer

• Competitive compensation based on experience.
• Opportunity to work with a global leader in technology, information and internet services.
• Remote work from anywhere.