AI Testing Assistant

About the role

JHC Consulting is seeking an AI Testing Assistant to support internal research on how modern analytical models can be applied to high‑level strategic problems. This part‑time, contract position is fully remote and ideal for a student or recent graduate with a strong curiosity for logical analysis.

Key responsibilities

• Execute test scripts that evaluate large language models on complex governance scenarios.
• Review model outputs for internal consistency, logical fallacies, and potential errors.
• Draft concise memoranda summarising strengths, weaknesses, and benchmark results.
• Compare successive model iterations to track changes in reasoning capabilities.
• Develop prompts based on the firm’s methodology to probe model responses.
• Catalogue judgment or data‑interpretation errors that could mislead decision‑makers.
• Collaborate with principals to refine testing processes in line with advisory mandates.

Required profile

• Current or completed studies in a discipline that demands rigorous logic (e.g., philosophy, law, history, corporate finance).
• High standard of written English with clear, professional prose.
• Intellectual curiosity, skeptical mindset, and ability to work independently.
• Strong attention to detail when reviewing lengthy or repetitive documents.

Required skills

• Basic familiarity with generative AI tools and their response patterns.
• Proficiency with standard word‑processing and documentation software used in professional settings.