Llama 3 8B Instruct
Released by Meta in 2024, Llama 3 8B Instruct is an chat model. Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong...
by Meta · 8K token context window
Best for
- low-latency chat and routing
- request routing and triage
- text classification
Ways to use Llama 3 8B Instruct in osFoundry
Connect with your own key (BYOK)
Open the key dialog and paste your Meta API key. osFoundry discovers Llama 3 8B Instruct automatically — assign it to a Maestro role (router, direct, orchestrator, or fallback) in the Pipeline tab and it is live in every chat. Your key, your provider account — no token markup.
Use it in a Room App
Room Apps declare AI features in their manifest, then call them with invokeAI:
import { invokeAI } from '@osfoundry/app-sdk'
// 'summarize' is an AI feature declared in your app manifest.
const result = await invokeAI('summarize', userText)
Call it from your own apps
Once a model is wired into your workspace you can host it as an API and reach it from your own services, scripts, or CI — outside osFoundry.
Run Llama 3 8B Instruct yourself
Llama 3 8B Instruct is also available as open weights — self-host it for full data control and no per-token cost. See that page for GPU requirements and a cost comparison against API pricing.
Llama 3 8B Instruct vs similar models
Licence
Hosted — usage subject to provider terms — Hosted-only model — usage governed by the provider's API terms. Bring your own provider key.
No weights distributed; usage subject to provider terms.
Frequently asked about Llama 3 8B Instruct
How much does Llama 3 8B Instruct cost?
Llama 3 8B Instruct is metered at $ 0.040 /1M for input, and $ 0.040 /1M for output. Bring your own Meta API key — osFoundry passes through provider pricing without markup.
Can I use Llama 3 8B Instruct commercially?
Commercial use is allowed with conditions. Hosted-only model — usage governed by the provider's API terms. Bring your own provider key. No weights distributed; usage subject to provider terms.
What is the context window of Llama 3 8B Instruct?
Llama 3 8B Instruct supports a 8K token context window.
Can I run Llama 3 8B Instruct locally?
No — Llama 3 8B Instruct is hosted only and accessed via the Meta API. An open-weights equivalent is available to self-host — see the cross-link above.
What is Llama 3 8B Instruct best at?
Llama 3 8B Instruct is well-suited to low-latency chat and routing, request routing and triage, text classification.
How do I use Llama 3 8B Instruct in osFoundry?
Paste your Meta API key in the key dialog (or deploy the open weights for self-hostable models), assign Llama 3 8B Instruct to a Maestro role in the Pipeline tab, then use it in chat, Room Apps via invokeAI, or your own apps.
Published by Meta on April 18, 2024. Source: https://openrouter.ai/meta-llama/llama-3-8b-instruct