Search
Go
Applied Scientist, Artificial General Intelligence, Frontier AI
Summary by AIEngineer.careers
Applied Scientist, Artificial General Intelligence, Frontier AI is a LLM Evaluation Engineer role (full-time). with Amazon. in BELLEVUE, US. Compensation shown: $136K–$184K. Imported listing (source: emploive.com). Apply on the employer's site (emploive.com).
Imported listing (source: emploive.com) · Apply on emploive.com
BELLEVUE · US
$136K–$184K
Full-time
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from emploive.com
Join Amazon's Artificial General Intelligence (AGI) team to develop quality strategies and auditing frameworks for Large Language Models like Amazon Nova. You will build LLM-as-a-Judge systems and automated evaluation tools to ensure data integrity and model performance. This role combines statistical analysis, machine learning, and rigorous QA methodologies to support frontier AI development.
Responsibilities
- Develop comprehensive quality strategies and auditing frameworks for LLM data workflows
- Design and maintain LLM-as-a-Judge systems with custom architectures and evaluation rubrics
- Perform expert-level manual audits and meta-audits to evaluate auditor performance
- Conduct root cause analysis on data quality issues and optimize data collection processes
- Collaborate with core scientists and engineers to implement quality solutions for Amazon Nova models
Requirements
- Master's degree in Computer Science, Mathematics, Statistics, Machine Learning, or equivalent quantitative field
- Proficiency in programming languages such as Java, C++, or Python
- Experience with SQL and RDBMS (e.g., Oracle) or Data Warehouses
- Strong background in statistics, quality assurance, and auditing methodologies
Amazon
Seattle · US · 1556000+ employees
Amazon is a technology and retail company guided by principles of customer obsession, passion for invention, operational excellence, and long-term thinking. It operates in areas ranging from e-commerce and cloud computing to artificial intelligence and digital streaming.
