Search
Go
Agentic AI Optimization Developer
Summary by AIEngineer.careers
Agentic AI Optimization Developer is a AI Evaluation Researcher role (full-time). with Equifax. in TORONTO, CA. Imported listing (source: aihiringboard.com). Apply on the employer's site (aihiringboard.com).
Imported listing (source: aihiringboard.com) · Apply on aihiringboard.com
TORONTO · CA
—
Full-time
MID
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from aihiringboard.com
Equifax is hiring an Agentic AI Optimization Developer to build and maintain automated evaluation frameworks for production multi-agent systems. You will curate golden datasets, audit agent reasoning trajectories, and tune prompts, tool-calling, and RAG pipelines to keep autonomous workflows accurate and hallucination-free. The role sits at the intersection of software quality engineering, LLM evaluation, and LLMOps, partnering closely with AI solution leads and agent developers.
Responsibilities
- Curate and maintain golden datasets of documents, queries, and expected agent trajectories
- Design and implement automated continuous evaluation pipelines for accuracy, latency, token spend, and fallback reliability
- Trace and audit multi-step agent reasoning (ReAct, reflection loops) to identify logic deviations
- Refine system prompts, context windows, and few-shot examples for multi-step workflows
- Optimize tool and function-calling interactions with external APIs, databases, and UiPath RPA workflows
- Monitor deployed agents for semantic drift, prompt injection, infinite loops, and hallucinations
- Implement guardrail frameworks and optimize RAG pipelines for accurate knowledge retrieval
- Collaborate with AI solution leads and agent developers to feed evaluation insights into the development lifecycle
Equifax
Atlanta · US · 15000+ employees
Equifax Inc. is a global data, analytics, and technology company that helps financial institutions, businesses, employers, governments, and consumers make decisions with greater confidence. Its differentiated data, analytics, and cloud technology support lending, fraud prevention, identity, workforce, marketing, and financial-wellness use cases.
