Search
Go
Software Engineering Manager, AI Platform
AUSTIN · US
$169K–$232K
Full-time
SENIOR
About the Role
Procore seeks a Software Engineering Manager to lead the AI Evaluation Platform team, building infrastructure and tooling to measure and improve the quality of AI agents. The role involves defining quality metrics, developing evaluation frameworks, and collaborating with AI/ML and product teams. This is a hybrid position in Austin, TX.
Responsibilities
- Lead and grow a team of engineers focused on evaluation infrastructure, quality measurement, and developer tooling for AI agents.
- Define the technical vision and roadmap for the Evaluation Platform.
- Partner with AI/ML, Product, and Agent teams to define quality metrics for agents.
- Design and deliver user-facing evaluation tools.
- Build frameworks for human-in-the-loop evaluation.
- Establish CI/CD quality gates for agent versions.
- Drive engineering excellence and recruit/mentor engineers.
Requirements
- 2+ years managing engineering teams or technical leads, with 7+ years total in software engineering.
- Experience building evaluation, quality measurement, or observability platforms for LLM-based or agentic systems.
- Strong understanding of evaluation methodologies: precision/recall, LLM-as-judge, etc.
- Hands-on technical depth in backend systems, data pipelines, or distributed infrastructure (Python, Go, or similar).
Procore
Carpinteria · US · 4421+ employees
Procore Technologies is a leading provider of cloud-based construction management software. Its platform enables collaboration between owners, general and specialty contractors, architects, and engineers to manage construction projects, finances, and resources effectively.
