Home / Features / Run any model / BYOK cloud API
BYOK Anthropic, OpenAI, Google, and any cloud API in osFoundry
osFoundry lets you bring your own keys (BYOK) for Anthropic Claude, OpenAI GPT, Google Gemini, Mistral, Together, Groq, DeepSeek, and any OpenAI-compatible provider. Keys are stored in your encrypted keychain, never in source code or logs. Your provider account is billed directly — osFoundry adds zero markup on tokens.
Quick answer
- Paste any provider API key into the BYOK dialog — encrypted at rest.
- Models from your key are auto-discovered and added to the catalog.
- No token markup — your provider bills you directly.
- Switch models per request, per agent, or via routing rules in osStudio.
Key capabilities
- Pre-built provider integrations for Anthropic, OpenAI, Google AI Studio + Vertex, Mistral, Together, Groq, DeepSeek, Cohere.
- Any OpenAI-compatible endpoint adds in seconds (base URL + key).
- Auto-discovery of available models from your key.
- Per-workspace key isolation — no key crosses workspace boundaries.
- Auto-fallback chain: if your primary model 429s, retry on the next configured model.
- Live model dispatch — Maestro picks the model per request via your routing rules.
How to do it in osFoundry
- Open the BYOK key dialog — Click the key icon in the Maestro chat panel or open Settings → Models → BYOK.
- Paste your provider key — Pick a provider, paste the key. osFoundry validates it and lists the models available on your account.
- Assign to a Maestro role — In the Pipeline tab, assign the discovered model to one of Maestro’s roles (router, direct, orchestrator, fallback). It’s live in every chat.
Use cases
- Team with existing Anthropic spend: Plug an existing Anthropic key into osFoundry. Spending continues on your Anthropic invoice; osFoundry adds no markup. Maestro becomes the orchestrator on top.
- Cost-sensitive solo dev: BYOK to Groq for cheap low-latency inference, BYOK to Anthropic for hard reasoning. Routing rules send 90% of traffic to Groq and only the hard tail to Claude.
Frequently asked questions
Is BYOK free?
Yes — bringing your key costs nothing extra in osFoundry. You pay only your provider for token usage.
Where are my API keys stored?
In your local OS keychain (macOS Keychain, Windows Credential Manager, Linux Secret Service). For cloud workspaces, keys are encrypted with workspace-controlled keys.
Can I use one provider key across all my workspaces?
Each workspace has its own key store for isolation. Copy a key to multiple workspaces if needed.
What happens when my key’s rate limit hits?
osFoundry surfaces the error in chat and (if configured) falls back to a different model defined by your routing rules.
Does osFoundry see my prompts?
Cloud-routed prompts pass through osFoundry to your provider (we need to forward the request). They are not logged beyond what you configure for audit. Local models never leave your device.
Can I rotate a key without downtime?
Yes — add the new key first; osFoundry uses both during the overlap window. Then delete the old key.
Pricing
BYOK itself is free in osFoundry. You pay only your provider for the tokens. osFoundry charges nothing on top of cloud provider pricing.
Related features