Providers

Manage multiple LLM providers from a single interface. Configure API keys for OpenAI, Anthropic, Google, and local models.

Supported Providers

Provider	Models	Pricing (approx)
OpenAI	GPT-4o, GPT-4o-mini, GPT-4-turbo	$2.50-$10/1M tokens
Anthropic	Claude 3 Opus, Sonnet, Haiku	$0.25-$15/1M tokens
Google	Gemini Pro, Gemini Ultra	$0.50-$7/1M tokens
Local	Ollama, vLLM, any OpenAI-compatible	Free (your hardware)

Add a Provider

Add Providerbash

curl -X POST http://localhost:8000/api/v1/providers \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -d '{
    "name": "openai",
    "type": "openai",
    "api_key": "sk-your-openai-key",
    "base_url": "https://api.openai.com/v1",
    "enabled": true
  }'

Secure your API keys!

Provider API keys are encrypted and stored in the Secrets vault. Never share them. Use the Secrets tab to rotate keys periodically.

Cost Optimizer

Billing