Remote Computer Science Domain Expert

About the role

Turing, a leading AI research accelerator, is seeking PhD‑level computer science experts to design and evaluate challenging problems for large language models such as ChatGPT. This remote contractor position focuses on creating conceptual CS challenges that probe advanced reasoning across algorithms, systems design, cybersecurity, theory, databases, and networks.

Key responsibilities

• Design advanced, concept‑driven computer science problems that test AI model performance on undergraduate to PhD‑level topics.
• Develop clear, step‑by‑step reference solutions with rigorous logic and well‑structured explanations.
• Evaluate AI‑generated responses for correctness, reasoning quality, completeness, and alignment with problem requirements.
• Identify flaws, edge cases, and near‑miss reasoning patterns in model outputs.
• Collaborate with researchers to refine benchmarks across multiple CS domains.
• Provide structured feedback to improve problem quality, benchmark reliability, and evaluation standards.

Required profile

• PhD (completed or in progress) in Computer Science or a closely related field.
• Strong analytical and problem‑solving abilities in advanced CS topics.
• Ability to craft conceptual problems that require deep understanding rather than simple recall.
• Excellent written communication skills for clear, logical explanations.
• Meticulous attention to detail when evaluating reasoning, assumptions, and edge cases.
• No prior AI experience required.

Required skills

What we offer

• Contractor engagement with flexible hours (minimum 4 hours/day, up to 40 hours/week).
• Remote work with a required 4‑hour overlap with Pacific Standard Time.
• Opportunity to influence cutting‑edge AI evaluation benchmarks.