# Python Developer-AI Evaluation at Linuxassociation
Source: https://true-hire-ten.vercel.app/jobs/python-developer-ai-evaluation-linuxassociation-iw3smiyy · Company profile: https://true-hire-ten.vercel.app/companies/linuxassociation · Apply on the employer's site: https://www.jobleads.com/ca/job/python-developer-ai-evaluation--canada--e405d20dd0afd9c018eb2b8c2dcd034f8?utm_source=freehire.me
## Job details
- Location: ,
- Work mode: Remote
- Employment type: Contract
- Category: Software Engineering
- Countries: Canada
- Posted: 2026-10-28 (1 days ago, fresh, reposted 2×)
- Skills named: ai, data-pipelines, data-quality, python, typescript
## About the role
ZettaMine Labs Pvt. Ltd. in Canada is seeking Senior Software Engineers for a remote, freelance Python/TypeScript evaluation project focused on improving AI models through high-quality training data and data rubric development.

You will design evaluation rubrics, build data pipelines, review data quality, and collaborate with researchers to translate qualitative judgments into scalable processes. Immediate availability and strong communication are valued.

Design, develop, and improve evaluation rubrics and criteria for preference data.
Review and label data ensuring high quality and accuracy.
Identify subtle issues in data and evaluation results.
Build and maintain pipelines/infrastructure for data generation, collection, and evaluation.
Analyze findings and prepare clear reports and recommendations.
Collaborate with researchers and engineers to scale qualitative judgments.
Support AI training/evaluation workflows to improve model outputs.
Communicate technical findings and suggest improvements to teams.

Experience building, maintaining, and improving software pipelines and infrastructure.
Hands-on experience with preference data collection and/or rubric creation.
Ability to review technical data and evaluate quality using defined criteria.
Strong analytical, problem-solving, and technical judgment skills.
Experience working with large codebases; VS Code is an advantage.
Excellent written and verbal communication skills.

Fully remote work environment
Cutting-edge AI projects
Competitive hourly compensation
© TrueHire. Listing data from freehire; applications go to the employer's own page.