BerriAI

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Stars
62k
全站累计
Forks13k衍生分支贡献
LanguagePython核心开发语言
Created2023-07-27已运营 3.3 年
Last push2026-10-29最新代码提交

Star history

已连续追踪 101 天每日快照数据

期间增长:+34k (117.8%)
29k45k62k2025-09-292026-07-202026-10-29
GitHub 官方 Topics:
#ai-gateway#anthropic#azure-openai#bedrock#gateway#langchain#litellm#llm#llm-gateway#llmops#mcp-gateway#openai#openai-proxy#rust#rust-ai#vertex-ai