Search
Go
Principal AI Engineer - Context - Agents and Context
Summary by AIEngineer.careers
Principal AI Engineer - Context - Agents and Context is a AI Agent Engineer role (full-time). with Elastic. in CANADA, CA. Compensation shown: $113K–$162K (est.). Imported listing (source: jobera.com). Apply on the employer's site (jobera.com).
Imported listing (source: jobera.com) · Apply on jobera.com
CANADA · CA
$113K–$162K (est.)
Full-time
PRINCIPAL
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from jobera.com
Elastic is seeking a Principal AI Engineer to lead the Context Engine team, building the knowledge layer for AI agents interacting with enterprise data. You will own the end-to-end improvement loop for agentic behavior, including evaluation, telemetry, and safe iteration of prompts and skills in production. This role sits at the intersection of engineering, data science, and product, requiring deep expertise in agent frameworks and backend systems.
Responsibilities
- Own the production improvement loop for Context Engine, analyzing failure modes and fixing extraction automations, retrieval tools, and memory behaviors.
- Define safe iteration strategies for agents and skills, including versioning, rollout, regression coverage, and guardrails.
- Design telemetry systems to capture agent traces, tool calls, and knowledge retrieval for data-informed decision-making.
- Partner with data science on evaluation strategies, including golden datasets and evaluators for quality, latency, and cost.
- Mentor engineers in eval-driven development and write technical proposals shaping the roadmap.
Requirements
- 10+ years of software engineering experience with recent focus on shipping AI-driven products in production.
- Proven track record of eval-driven product improvement, diagnosing LLM/agent behavior from traces and feedback.
Elastic
Amsterdam (registered) and San Francisco (operational) · NL · 13556+ employees
Elastic is a Dutch-American software company that provides a Search AI platform for enterprise search, observability, and cybersecurity. It is known for its open-source foundation, including Elasticsearch, and helps organizations find answers in real-time from their data at scale.
