⭐ 52.9k stars💬 text generation🔧 Pythonintermediate📄 NOASSERTION🔄 2026-07-08
About
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
⚡ Quick Start
git clone https://github.com/litellm.git🏷️ Topics
💻 Supported Platforms
maclinuxwindows
📋 Technical Details
- Repository
- BerriAI/litellm
- Language
- Python
- License
- NOASSERTION
- Stars
- 52,946
- Category
- text generation
- Difficulty
- intermediate
- Last Updated
- 2026-07-08
- Platforms
- mac, linux, windows
Frequently Asked Questions About litellm
What is litellm?
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
How do I install litellm?
Run: git clone https://github.com/litellm.git
What are the system requirements for litellm?
litellm supports mac, linux, windows. It is written in Python and is best suited for intermediate-level users. The repository has 52,946+ stars on GitHub and is licensed under NOASSERTION.