Search
Go
AI Engineer
SAN FRANCISCO · US
$170K–$220K
Full-time
JUNIOR
About the Role
LiteLLM, the world's most popular AI Gateway, is hiring a Backend LLM Engineer to develop provider-agnostic APIs and unify request formats across LLM providers. You'll work directly with the founders on system design, developer experience, and building an interoperability layer across LLMs, MCPs, and agents. Ideal for a backend engineer with 1-2 years of experience who is passionate about open source and building developer tools used by thousands of teams.
Responsibilities
- Ensure LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec
- Write transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats
- Build provider-agnostic unification functionality (e.g. session management across non-OpenAI models)
- Contribute to system design for provider-level features at the gateway level
- Improve developer experience across LiteLLM's Python SDK for millions of users
- Build across LLMs, MCPs, and agents by maintaining an excellent LLM interoperability layer
Requirements
- 1-2 years of backend/full-stack experience with production systems
- Passion for open source and user engagement
- Experience working with the OpenAI API
- Strong work ethic and ability to thrive in small teams
- Eagerness to talk to users and help solve real problems
LiteLLM
San Francisco · US · 16+ employees
LiteLLM is an open-source software company that provides a unified interface for interacting with over 100 Large Language Models (LLMs). It acts as both a Python SDK for direct code integration and a self-hosted AI gateway/proxy server to manage API requests, cost tracking, guardrails, and load balancing.
