Computer Science Domain Expert – Remote (Pay Per Task)

About the role

We are seeking highly qualified Computer Science Domain Experts to design and evaluate advanced CS problems that test AI model performance. This short‑term, remote contract offers flexible, task‑based compensation and the opportunity to shape benchmark datasets for cutting‑edge research.

Key responsibilities

• Design challenging, conceptual computer‑science problems across algorithms, systems design, cybersecurity, databases, networks, theory of computation, operating systems, and related areas.
• Develop clear, step‑by‑step reference solutions with rigorous logic and well‑structured explanations.
• Evaluate AI‑generated responses for correctness, reasoning quality, completeness, clarity, and alignment with problem requirements.
• Identify flaws, edge cases, and near‑miss reasoning patterns in AI outputs.
• Collaborate with researchers to refine benchmarks for undergraduate to PhD‑level topics.
• Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.

Required profile

• Ph.D. (completed or in progress) in Computer Science or a closely related field.
• Deep expertise in advanced CS reasoning and problem‑solving across multiple domains.
• Strong analytical, critical‑thinking, and written communication skills.
• Excellent attention to detail when evaluating assumptions, definitions, edge cases, and solution validity.
• Willingness to undergo a background check after onboarding.

Required skills

• Python (knowledge desirable but not mandatory).
• Data analysis concepts.

What we offer

• Task‑based compensation of $250 per approved task.
• Remote work with up to 40 hours/week and a required 4‑hour overlap with PST.
• Three‑month contract with immediate start.
• Opportunity to influence AI benchmark development in academia and industry.