BerriAI

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

分享
Star
62k
全站累计
Fork13k衍生分支贡献
语言Python核心开发语言
创建于2023-07-27已运营 3.3 年
最近推送2026-10-29最新代码提交

Star 走势

已连续追踪 101 天每日快照数据

期间增长:+34k (117.8%)
29k45k62k2025-09-292026-07-202026-10-29
GitHub 官方 Topics:
#ai-gateway#anthropic#azure-openai#bedrock#gateway#langchain#litellm#llm#llm-gateway#llmops#mcp-gateway#openai#openai-proxy#rust#rust-ai#vertex-ai