AI Engineer/ML Engineer - Senior Developers - AI Training is a AI Engineer role (contract). with Prolific Academic Ltd. in REMOTE, WORLDWIDE. Imported listing (source: ziprecruiter.com). Apply on the employer's site (ziprecruiter.com).
Imported listing (source: ziprecruiter.com) · Apply on ziprecruiter.com
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from ziprecruiter.com
Prolific is seeking AI and Machine Learning Engineers to join their Expert Network to train and evaluate LLMs. Participants will review model architectures, audit code, provide RLHF feedback, and benchmark performance. Qualified candidates should have deep expertise in ML, experience with PyTorch/TensorFlow, and knowledge of LLM workflows like RAG and RLHF. This is a remote, contract role with flexible hours and competitive pay up to $80/hour.
Responsibilities
Evaluate LLM Architecture Logic: review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
Audit Code & Notebooks: validate ML-specific code (e.g., training loops, data preprocessing scripts) for efficiency and correctness.
Refine RLHF Frameworks: provide high-quality human feedback to align models with human intent, safety, and helpfulness.
Analyze Model Reasoning: critically assess AI model's chain-of-thought (CoT) prompts and identify reasoning breakdowns.
Benchmark Performance: conduct comparative testing between model outputs based on specific technical taxonomies and performance metrics.
Requirements
BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or related quantitative field with focus on Machine Learning.
Prolific is a technology platform that provides access to high-quality human data for AI training and academic research. It helps researchers and AI developers recruit participants for online studies, surveys, and experiments.
