LLM Ops Engineer

Litera is seeking an LLM Ops Engineer to build and operate a scalable, secure AI platform for legal technology products. The role involves deploying and managing LLMs across multiple providers, ensuring reliability and cost efficiency, and enabling engineering teams to use AI safely. This is a hybrid role based in Denver, CO with 3 days per week in the office.

• Build and operate a scalable AI platform for engineering teams.
• Ensure high availability and resiliency of AI services through intelligent routing, failover strategies, and production-grade infrastructure.
• Establish secure and compliant AI operations by protecting model access, safeguarding sensitive data, and enforcing governance standards.
• Create a consistent developer experience through unified APIs, self-service capabilities, tooling, and best practices.
• Optimize AI platform performance, reliability, and cost efficiency through proactive monitoring, analytics, and provider strategy management.
• Lead the evolution of AI operations capabilities by evaluating emerging technologies and recommending scalable solutions.
• Deliver observability and operational excellence through dashboards, alerting, quality monitoring, and service-level metrics.
• Support the safe deployment of AI solutions by implementing testing frameworks, quality controls, and production readiness standards.