Backend Engineer (Python/JavaScript) – Remote $15/hr

About the role

We are looking for a skilled Backend Engineer to design and implement multi‑agent benchmark tasks for AI coding agents. This short‑term contract role is fully remote and focuses on building reproducible, Docker‑based evaluation environments.

Key responsibilities

• Build multi‑agent benchmark tasks based on real‑world open‑source code changes such as bug fixes, migrations, and refactors.
• Work with the Harbor evaluation framework to run and validate tasks inside Docker environments.
• Write clear, precise task instructions covering file paths, function signatures, expected behavior, and constraints.
• Design and implement Python verification scripts to validate agent‑generated code changes.
• Create decomposition strategies that split complex code changes across independent sub‑agents.
• Run, debug, and refine tasks within containerized environments to ensure reproducibility and determinism.
• Evaluate performance signals and continuously improve task quality, clarity, and difficulty.
• Contribute to the development of benchmarks for advanced AI coding agents.

Required profile

• Strong experience in Python and JavaScript development.
• Experience with AI coding benchmarks such as SWE‑bench or Terminal‑Bench.
• Proficiency navigating large open‑source codebases (e.g., Django, Flask, FastAPI, Node.js).
• Familiarity with Git workflows, including pull requests, diffs, cherry‑picking, and specific commits.
• Comfortable with Docker, including writing Dockerfiles, building images, and debugging containers.
• Experience writing test scripts using pytest, unittest, or custom assertion‑based testing.
• Ability to produce clear, unambiguous technical specifications.
• Self‑motivated and able to work independently in a remote setting.

Required skills

• Python
• JavaScript
• Docker
• Git
• pytest
• unittest
• Django
• Flask
• FastAPI
• Node.js

What we offer

• Short‑term contract (4 weeks) with flexible weekly hours (20‑40 h) and a required 4‑hour overlap with PST.
• Competitive hourly rate of $15 USD.
• Opportunity to work on cutting‑edge AI coding benchmark projects.