In short
Short-term contract hiring JavaScript engineers as code reviewers for an AI evaluation project: triaging GitHub issues, setting up and Dockerizing open-source repos, and assessing unit test quality to gauge LLM bug-fixing performance. Pays $25 per approved task; remote with immediate start.
About the role
Code Reviewer – JavaScript
Experience: 2+ Years
Job Type: Short-Term Contract
Location: Remote
Start Date: Immediate
Compensation: $25 per approved task
Domain: JavaScript | Code Review | Open Source | AI Evaluation | GitHub
Role Overview
We are looking for experienced JavaScript Software Engineers / Code Reviewers to support a short-term AI evaluation project involving public GitHub repositories, codebase review, test quality assessment, and bug-fixing evaluation.
The role requires strong hands-on software engineering skills and the ability to navigate, modify, run, and assess real-world codebases.
Key Responsibilities
- Analyze and triage GitHub issues across open-source repositories.
- Set up, configure, and run repositories locally.
- Handle Dockerization and development environment setup.
- Review and evaluate unit test coverage and test quality.
- Modify and run codebases to assess AI/LLM performance in bug-fixing scenarios.
Key Requirements
- 2+ years of professional software engineering experience.
- Strong hands-on experience with JavaScript.
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, debugging, and testing real-world software projects locally.
Preferred Skills
- Experience contributing to or reviewing open-source projects.
- Previous exposure to LLM research, AI evaluation, or coding benchmark projects.
- Experience building or testing developer tools, automation agents, or software testing systems.
Selection Process
- Interest Check Form (ICF):
- Technical Assessment:
- Assessment / Delivery Review
- Final Approval & Onboarding