Skip to main content

AI Engineer, Trust & Evaluation

Summary by AIEngineer.careers

AI Engineer, Trust & Evaluation is a AI Engineer role (full-time). with Equinix. in ONTARIO, CA. Compensation shown: $68K–$101K (est.). Imported listing (source: notify.careers). Apply on the employer's site (notify.careers).

Imported listing (source: notify.careers) · Apply on notify.careers

How our listings work

ONTARIO · CA
$68K–$101K (est.)
Full-time
MID
Apply Now

More AI jobs in Canada

The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.

Imported job description

Sourced from notify.careers

Equinix is hiring an AI Engineer for Trust & Evaluation to build the evaluation and trust capabilities of its GenAI platform. You will design platform features for agent evaluation at scale—golden datasets, synthetic test data, LLM-as-judge scoring, and production quality monitoring—and build the trust controls agents run on, including identity, access, guardrails, and data boundaries. The role involves root-cause analysis of agent failures and collaboration with product, platform, and security teams.

Responsibilities

  • Build evaluation platform features: dataset creation and versioning, golden datasets, synthetic test data, and reusable metric templates
  • Build agent scoring: code-based checks, LLM-as-judge, tool-call accuracy, and grounding checks
  • Build human-review features and recalibrate judge scores when reviewer agreement is low
  • Run evaluations at scale before release, on prompt/model/tool changes, and in production
  • Build and test trust controls: agent identity, per-user access, tool permissions, guardrails, and data boundaries
  • Run adversarial tests and red-teaming, turning findings into fixes and regression tests
  • Investigate agent failures end to end and build test and performance tooling
  • Turn production failures and user feedback into regression tests

Requirements

  • 1–4 years in AI/ML or software engineering (internships and applied research count)
  • Bachelor's degree in computer science, engineering, data science, mathematics, or equivalent experience
  • Proficiency in Python with version control, testing, and code review habits
  • Experience building backend services or platform features
  • Hands-on experience building evaluations or test systems for ML/LLM applications
  • Working knowledge of LLM applications (prompting, retrieval, agents)
  • Working knowledge of evaluation statistics and reviewer agreement measurement
  • Ability to write SQL and analyze results
  • Clear written and verbal communication

Nice to Have

  • Experience building evaluation or observability features used at scale
  • Experience with LLM evaluation and observability tools and OpenTelemetry tracing
  • Experience with red-teaming or adversarial testing of LLM systems
  • Experience with identity and access (OAuth 2.0, OIDC, delegated access)
  • Experience with performance, load, or test engineering
  • Experience with agent frameworks, MCP, or A2A
  • Experience with Google Cloud (Vertex AI, GKE) and Kubernetes
  • Familiarity with AI risk frameworks (NIST AI RMF, ISO 42001)
  • MS in a related field

Benefits

Health insurancelife insurancedisability insuranceretirement planrrsppaid vacationpaid holidaysemployee assistance program

Tech Stack

A2AGKEKubernetesLLMMCPOAuthOpenTelemetryPythonSQLVertex AI
Equinix

Equinix

Redwood City · US · 13716+ employees

Equinix (Nasdaq: EQIX) is the world's digital infrastructure company, operating a global footprint of 280 data centers in 77 markets across 36 countries in the Americas, Asia-Pacific, and EMEA. Founded in 1998, it enables businesses to bring together and interconnect the foundational infrastructure that powers their digital operations, including AI workloads.

Weekly job alert

Get a weekly email when new AI engineering jobs match your filters. Free — confirm your address to start.

Related Jobs