AI Evaluation Specialist – Remote Contract

About the role

We are seeking an AI Evaluation Specialist to work remotely on a contract basis. The role focuses on assessing AI models and datasets to ensure they meet performance, accuracy, and fairness standards across diverse use cases.

Key responsibilities

• Conduct structured evaluations of AI models and datasets against predefined metrics.
• Identify, document, and recommend fixes for biases, errors, or inconsistencies in model outputs.
• Collaborate with cross‑functional teams to refine evaluation criteria and align them with business goals.
• Develop and maintain standardized evaluation frameworks for consistent AI assessment.
• Produce detailed reports summarizing findings, trends, and actionable recommendations.

Required profile

• Proven experience in AI model evaluation, testing, or validation in a technical or research setting.
• Strong analytical ability to interpret complex data and derive insights.
• Excellent written and verbal communication skills for documenting findings.
• Self‑motivated and able to work independently in a fully remote environment.

Required skills

• TensorFlow
• PyTorch
• AI model evaluation
• Bias detection
• Fairness metrics

What we offer

• Competitive hourly rate ranging from $22 to $70.
• Fully remote work with flexible scheduling.
• Opportunity to shape evaluation standards for a global technology leader.