Getting Started Tutorial
End-to-End tutorial for LiteLLM Proxy to:
Agent & MCP Gateway
4 items
Config.yaml
3 items
Setup & Deployment
13 items
Demo LiteLLM Cloud
Admin UI
6 items
Architecture
12 items
All Endpoints (Swagger)
Authentication
10 items
Budgets + Rate Limits
10 items
Caching
For OpenAI/Anthropic Prompt Caching, go here
Memory Management
Store user preferences and feedback so your LLM remembers them across sessions. Scoped per user and team, with built-in access control.
Guardrails
8 items
Policies
4 items
Create Custom Plugins
Modify requests, responses, and more
LiteLLM Proxy CLI
The litellm-proxy CLI is a command-line tool for managing your LiteLLM proxy
Load Balancing, Routing, Fallbacks
A/B Testing - Traffic Mirroring
Traffic mirroring allows you to "mimic" production traffic to a secondary (silent) model for evaluation purposes. The silent model's response is gathered in the background and does not affect the latency or result of the primary request.
Logging, Alerting, Metrics
5 items
Making LLM Requests
6 items
Model Access
6 items
Secret Managers
10 items
Spend Tracking
9 items