Llama 3.1 8B Instant
Llama 3.1 8B Instant is a multilingual, instruction-tuned model with a context window of 131.1K tokens and tool-use capability. It suits cost-effective production deployments that need multilingual coverage and trained tool use.
Implicit CachingTool Use
index.ts
import { streamText } from 'ai'
const result = streamText({ model: 'meta/llama-3.1-8b', prompt: 'Why is the sky blue?'})More models by Meta
| Model |
|---|
| 1M | 4.4s | 176tps | $1.25/M | $4.25/M | Read:$0.15/M Write:— | — | +2 |  | 07/09/2026 | |||
| 131K | 0.2s | 51tps | $0.17/M | $0.66/M | — |    | 04/05/2025 | |||||
| 131K | 0.2s | 38tps | $0.24/M | $0.97/M | — | | 04/05/2025 | |||||
| 128K | 0.3s | 132tps | $0.59/M | $0.72/M | — | | 12/06/2024 | |||||
| 131K | 0.2s | 116tps | $0.72/M | $0.72/M | — | | 07/23/2024 |