Search
Go
This job is no longer accepting applications
This listing was closed on Aug 14, 2026.
Browse Open JobsSenior Software Engineer - Testing AI Coding Agents
Summary by AIEngineer.careers
Senior Software Engineer - Testing AI Coding Agents is a ML QA Engineer role (part-time). with Mindrift. in REMOTE, WORLDWIDE. Compensation shown: $106K+ (est.). Imported listing (source: jobs-radar.com). Apply on the employer's site (jobs-radar.com).
Imported listing (source: jobs-radar.com) · Apply on jobs-radar.com
REMOTE · WORLDWIDE
$106K+ (est.)
Part-time
SENIOR
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from jobs-radar.com
Mindrift connects specialists with project-based AI opportunities. This role involves creating challenging tasks and evaluation criteria to test AI coding agents. You will build realistic developer environments, design tasks, write tests, and iterate based on feedback.
Responsibilities
- Build realistic developer environments with codebase, infrastructure, and context
- Design tasks from intermediate states and define evaluation criteria
- Write tests that verify agent solutions and accept all valid approaches
- Iterate on tasks based on QA feedback
Requirements
- 5+ years in software development
- Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
- Experience writing tests (functional, integration)
- English proficiency B2+
Tech Stack
PythonReactTypeScriptFastAPIPostgreSQLRedis
Mindrift
Amsterdam · NL · 2779+ employees
Mindrift is an AI training and expert-sourcing platform created by Toloka. It connects domain experts and freelance contributors with technology companies to provide high-quality training data for generative AI models, including tasks like supervised fine-tuning, RLHF, model evaluation, and red-teaming.
