LiteLLM

About

LiteLLM is an open-source software company that provides a unified interface for interacting with over 100 Large Language Models (LLMs). It acts as both a Python SDK for direct code integration and a self-hosted AI gateway/proxy server to manage API requests, cost tracking, guardrails, and load balancing.