LLM Gateway (one-api)
LLM Gateway (one-api) osFoundry community catalog में एक app है। Single OpenAI-compatible endpoint जो OpenAI, Anthropic, Google, Mistral, Groq, Ollama, Azure, Bedrock और 30+ अन्य providers में fan out करता है। हर channel की keys manage करें, per-user per-token-budget quotas set करें, हर request log करें, और अपने सभी downstream apps को एक समान /v1/chat/completions API serve करें। songquanpeng/one-api द्वारा powered — एक org में LLM access standardize करने का सबसे आसान self-hosted तरीका।
विवरण
- Workspace: osfoundry
- Category: AI
- मूल्य: Free
- Access: Community
Features
- Single /v1/chat/completions endpoint fans out to OpenAI, Anthropic, Google, Mistral, Groq, Ollama, Azure, Bedrock + 30 more
- Per-token quotas + cost ledger per user — set budgets, see usage, suspend over-spenders
- Issue per-app API keys without exposing upstream provider keys to downstream apps
- Every request logged with token count + estimated cost — searchable + exportable
- Channel failover — mark a channel as backup, auto-route when primary errors
- SQLite bundled — switch to MySQL via SQL_DSN env when you outgrow one process
Documentation
Documentation को upstream project द्वारा अंग्रेज़ी में मेंटेन किया जाता है।
# LLM Gateway (one-api)
## First-boot setup
Default admin login is `root` / `123456` — **change it immediately** at Settings → Personal Settings → Password.
## Add a channel (upstream provider)
Channels are how one-api connects to upstream LLM providers.
1. **Channels** tab → **Add new channel**
2. Pick the provider (OpenAI, Anthropic, Google AI Studio, Azure, Mistral, Groq, Ollama, ...)
3. Paste the upstream API key (the platform never sees it)
4. Pick which model names this channel handles
5. Save
## Issue keys to your apps
After channels are configured, **Tokens** tab → **Add token** → set quota (in 1k-token units) → copy the `sk-...` key. Point any OpenAI-compatible SDK at:
```
base_url: https://<your-public-url>/v1
api_key: sk-<the issued token>
```
## Routing
Requests flow: client → one-api → matching channel (by model name) → upstream API → response back. one-api logs every request with token count + cost, lets you set per-user quotas, and lets you swap channels without touching client code.
## Storage
SQLite at `/data/one-api.db`. For high-throughput multi-tenant setups, switch to MySQL via `SQL_DSN` env (not bundled here).
osFoundry में LLM Gateway (one-api) का उपयोग कैसे करें
एक क्लिक में LLM Gateway (one-api) को अपने workspace में install करें, फिर अपने stack के लिए prompts, tools, या configuration को customise करने के लिए इसे osStudio में fork करें। आपके workspace का कोई भी सदस्य वहीं से आगे बढ़ा सकता है जहाँ आपने छोड़ा था।
Community से अन्य apps
- CRM — Contacts, deals, और pipeline tracking के साथ customer relationship management।
- Kanban Board — एक Trello-style kanban and project board के साथ cards, boards, calendar and table views, and per-board properties. Powered by Focalboard (standalone personal server). Embedded SQLite एक persistent volume पर.
- Helpdesk — SLA tracking के साथ ticket triage और customer support inbox।
- Page Builder — Visual drag-and-drop page builder के साथ sections, themes, SEO, and publishing
- Website Builder — Multi-page website builder के साथ CMS collections, global navigation, footer, themes, and publishing
- Storefront — Product catalog, cart, और checkout के साथ e-commerce storefront।