Qwen2.5 7B Instruct
Qwen2.5 7B Instruct is a chat model from Qwen, released October 16, 2024. Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and...
by Qwen · 33K token context window
Best for
- low-latency chat and routing
- request routing and triage
- text classification
Ways to use Qwen2.5 7B Instruct in osFoundry
Connect with your own key (BYOK)
Open the key dialog and paste your Qwen API key. osFoundry discovers Qwen2.5 7B Instruct automatically — assign it to a Maestro role (router, direct, orchestrator, or fallback) in the Pipeline tab and it is live in every chat. Your key, your provider account — no token markup.
Use it in a Room App
Room Apps declare AI features in their manifest, then call them with invokeAI:
import { invokeAI } from '@osfoundry/app-sdk'
// 'summarize' is an AI feature declared in your app manifest.
const result = await invokeAI('summarize', userText)
Call it from your own apps
Once a model is wired into your workspace you can host it as an API and reach it from your own services, scripts, or CI — outside osFoundry.
Run Qwen2.5 7B Instruct yourself
Qwen2.5 7B Instruct is also available as open weights — self-host it for full data control and no per-token cost. See that page for GPU requirements and a cost comparison against API pricing.
Qwen2.5 7B Instruct vs similar models
| Model | Org | Params | Context | Input price | Self-host |
|---|
| Qwen2.5 7B Instruct | Qwen | — | 33K | $ 0.040 /1M | API only |
| Magnum v4 72B | anthracite-org | — | 16K | $ 3.00 /1M | API only |
| Inflection 3 Pi | Inflection | — | 8K | $ 2.50 /1M | API only |
| UnslopNemo 12B | TheDrummer | — | 33K | $ 0.400 /1M | API only |
Licence
Hosted — usage subject to provider terms — Hosted-only model — usage governed by the provider's API terms. Bring your own provider key.
No weights distributed; usage subject to provider terms.
Frequently asked about Qwen2.5 7B Instruct
How much does Qwen2.5 7B Instruct cost?
Qwen2.5 7B Instruct is metered at $ 0.040 /1M for input, and $ 0.100 /1M for output. Bring your own Qwen API key — osFoundry passes through provider pricing without markup.
Can I use Qwen2.5 7B Instruct commercially?
Commercial use is allowed with conditions. Hosted-only model — usage governed by the provider's API terms. Bring your own provider key. No weights distributed; usage subject to provider terms.
What is the context window of Qwen2.5 7B Instruct?
Qwen2.5 7B Instruct supports a 33K token context window.
Can I run Qwen2.5 7B Instruct locally?
No — Qwen2.5 7B Instruct is hosted only and accessed via the Qwen API. An open-weights equivalent is available to self-host — see the cross-link above.
What is Qwen2.5 7B Instruct best at?
Qwen2.5 7B Instruct is well-suited to low-latency chat and routing, request routing and triage, text classification.
How do I use Qwen2.5 7B Instruct in osFoundry?
Paste your Qwen API key in the key dialog (or deploy the open weights for self-hostable models), assign Qwen2.5 7B Instruct to a Maestro role in the Pipeline tab, then use it in chat, Room Apps via invokeAI, or your own apps.
Published by Qwen on October 16, 2024. Source: https://openrouter.ai/qwen/qwen-2.5-7b-instruct