LLM Gateway (one-api)
LLM Gateway (one-api) is a app in the osFoundry community catalog. Single OpenAI-compatible endpoint that fans out to OpenAI, Anthropic, Google, Mistral, Groq, Ollama, Azure, Bedrock, and 30+ other providers. Manage keys per channel, set per-token-budget quotas per user, log every request, and serve a uniform /v1/chat/completions API to all your downstream apps. Powered by songquanpeng/one-api — the simplest self-hosted way to standardize LLM access across an org.
Details
- Workspace: osfoundry
- Category: AI
- Pricing: Free
- Access: Community
Features
- Single /v1/chat/completions endpoint fans out to OpenAI, Anthropic, Google, Mistral, Groq, Ollama, Azure, Bedrock + 30 more
- Per-token quotas + cost ledger per user — set budgets, see usage, suspend over-spenders
- Issue per-app API keys without exposing upstream provider keys to downstream apps
- Every request logged with token count + estimated cost — searchable + exportable
- Channel failover — mark a channel as backup, auto-route when primary errors
- SQLite bundled — switch to MySQL via SQL_DSN env when you outgrow one process
Documentation
# LLM Gateway (one-api)
## First-boot setup
Default admin login is `root` / `123456` — **change it immediately** at Settings → Personal Settings → Password.
## Add a channel (upstream provider)
Channels are how one-api connects to upstream LLM providers.
1. **Channels** tab → **Add new channel**
2. Pick the provider (OpenAI, Anthropic, Google AI Studio, Azure, Mistral, Groq, Ollama, ...)
3. Paste the upstream API key (the platform never sees it)
4. Pick which model names this channel handles
5. Save
## Issue keys to your apps
After channels are configured, **Tokens** tab → **Add token** → set quota (in 1k-token units) → copy the `sk-...` key. Point any OpenAI-compatible SDK at:
```
base_url: https://<your-public-url>/v1
api_key: sk-<the issued token>
```
## Routing
Requests flow: client → one-api → matching channel (by model name) → upstream API → response back. one-api logs every request with token count + cost, lets you set per-user quotas, and lets you swap channels without touching client code.
## Storage
SQLite at `/data/one-api.db`. For high-throughput multi-tenant setups, switch to MySQL via `SQL_DSN` env (not bundled here).
How to use LLM Gateway (one-api) in osFoundry
Install LLM Gateway (one-api) into your workspace in one click, then fork it in osStudio to customise the prompts, tools, or configuration for your stack. Anyone in your workspace can pick up where you left off.
Other apps from the community
- CRM — Customer relationship management with contacts, deals, and pipeline tracking.
- Kanban Board — Drag-and-drop task board with swimlanes, labels, and team assignments.
- Helpdesk — Ticket triage and customer support inbox with SLA tracking.
- Page Builder — Block-based page editor with publishing to public URLs.
- Website Builder — Multi-page site builder with CMS, templates, and custom domains.
- Storefront — E-commerce storefront with product catalog, cart, and checkout.