Senior Ruby Engineer – LLM Evaluation & Repository Validation

About the role

We are looking for a Senior Software Engineer with strong Ruby expertise to join our remote team. You will focus on evaluating large language models (LLMs) by analysing and fixing issues in popular open‑source repositories.

Key responsibilities

• Analyse and triage GitHub issues across trending open‑source libraries.
• Set up and configure code repositories, including Dockerisation and environment provisioning.
• Assess unit‑test coverage and overall code quality.
• Modify and run codebases locally to benchmark LLM performance in bug‑fixing scenarios.
• Collaborate with researchers to select challenging repositories and issues for LLM evaluation.
• Optionally lead a small team of junior engineers on related projects.

Required profile

• Minimum 3 years of professional experience (36 months) in software development.
• Strong proficiency in Ruby and familiarity with Git/GitHub workflows.
• Hands‑on experience with Docker and containerised development environments.
• Ability to evaluate and improve unit‑test coverage.
• Willingness to work at least 20 hours per week with a 4‑hour overlap with PST.

Required skills

• Ruby
• Docker
• Git
• GitHub
• Unit testing

What we offer

• Fully remote work arrangement.
• Opportunity to contribute to cutting‑edge AI research with leading LLM companies.
• Flexible weekly commitment options (20, 30 or 40 hours).