WizardLM-2 8x22B
Released by microsoft in 2024, WizardLM-2 8x22B is an chat model. WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...
by microsoft · 66K token context window
Best for
- low-latency chat and routing
- request routing and triage
- text classification
Ways to use WizardLM-2 8x22B in osFoundry
Connect with your own key (BYOK)
Open the key dialog and paste your microsoft API key. osFoundry discovers WizardLM-2 8x22B automatically — assign it to a Maestro role (router, direct, orchestrator, or fallback) in the Pipeline tab and it is live in every chat. Your key, your provider account — no token markup.
Use it in a Room App
Room Apps declare AI features in their manifest, then call them with invokeAI:
import { invokeAI } from '@osfoundry/app-sdk'
// 'summarize' is an AI feature declared in your app manifest.
const result = await invokeAI('summarize', userText)
Call it from your own apps
Once a model is wired into your workspace you can host it as an API and reach it from your own services, scripts, or CI — outside osFoundry.
WizardLM-2 8x22B vs similar models
Licence
Hosted — usage subject to provider terms — Hosted-only model — usage governed by the provider's API terms. Bring your own provider key.
No weights distributed; usage subject to provider terms.
Frequently asked about WizardLM-2 8x22B
How much does WizardLM-2 8x22B cost?
WizardLM-2 8x22B is metered at $ 0.620 /1M for input, and $ 0.620 /1M for output. Bring your own microsoft API key — osFoundry passes through provider pricing without markup.
Can I use WizardLM-2 8x22B commercially?
Commercial use is allowed with conditions. Hosted-only model — usage governed by the provider's API terms. Bring your own provider key. No weights distributed; usage subject to provider terms.
What is the context window of WizardLM-2 8x22B?
WizardLM-2 8x22B supports a 66K token context window.
Can I run WizardLM-2 8x22B locally?
No — WizardLM-2 8x22B is hosted only and accessed via the microsoft API.
What is WizardLM-2 8x22B best at?
WizardLM-2 8x22B is well-suited to low-latency chat and routing, request routing and triage, text classification.
How do I use WizardLM-2 8x22B in osFoundry?
Paste your microsoft API key in the key dialog (or deploy the open weights for self-hostable models), assign WizardLM-2 8x22B to a Maestro role in the Pipeline tab, then use it in chat, Room Apps via invokeAI, or your own apps.
Published by microsoft on April 16, 2024. Source: https://openrouter.ai/microsoft/wizardlm-2-8x22b