Compositev12
← All models Model directory

AI model

Meta: Llama 3.1 8B Instruct

meta-llama/llama-3.1-8b-instruct

Meta: Llama 3.1 8B Instruct is a 131,072-token model served on Composite at $0.0250 per million tokens in and $0.0500 per million tokens out.

Try in Playground

Community rating

— No community ratings yet.

Sign in to rate this model. Ratings come from accounts that have run requests through Composite.

Specifications

Specifications and pricing as served by Composite
Model IDmeta-llama/llama-3.1-8b-instruct
Providercv11
Context window131,072 tokens
Acceptstext
Returnstext
Input price$0.0250 per million tokens
Output price$0.0500 per million tokens
Prompt cachingSupported — cached input is billed at the provider's cache rate, on credits and plans alike
ModeratedNo
Cost on a monthly planAbout 0.2 plan credits per typical call (8k in, 1k out)
Routing endpoints10 (base plus 9 routing variants)

Measured on Composite

This model has not carried enough traffic on Composite yet to publish a success rate, a latency figure or a traffic rank. The numbers appear here once it has.

Routing variants

The same model behind 9 alternative endpoints. Call the id directly to pin a route; the base id above picks for you.

RouteModel IDProviderPrice
Normal meta-llama/llama-3.1-8b-instruct-normal cv11 $0.0625 per million tokens input · $0.100 per million tokens output
Normal + cheapThink meta-llama/llama-3.1-8b-instruct-normal:cheapThink cv11 $0.0625 per million tokens input · $0.100 per million tokens output
Cheapest provider meta-llama/llama-3.1-8b-instruct:cheapest-provider DeepInfra $0.0250 per million tokens input · $0.0500 per million tokens output
Cheapest provider + cheapThink meta-llama/llama-3.1-8b-instruct:cheapest-provider:cheapThink DeepInfra $0.0250 per million tokens input · $0.0500 per million tokens output
cheapThink meta-llama/llama-3.1-8b-instruct:cheapThink cv11 $0.0250 per million tokens input · $0.0500 per million tokens output
Fast meta-llama/llama-3.1-8b-instruct:fast DeepInfra $0.0250 per million tokens input · $0.0500 per million tokens output
Fast + cheapThink meta-llama/llama-3.1-8b-instruct:fast:cheapThink DeepInfra $0.0250 per million tokens input · $0.0500 per million tokens output
Quality meta-llama/llama-3.1-8b-instruct:quality CoreWeave $0.275 per million tokens input · $0.275 per million tokens output
Quality + cheapThink meta-llama/llama-3.1-8b-instruct:quality:cheapThink CoreWeave $0.275 per million tokens input · $0.275 per million tokens output

Pricing

$0.0250 per million tokens input · $0.0500 per million tokens output

Credits pay the provider’s price plus 25%; cache hits cost less.

On a monthly plan, a typical call (8k tokens in, 1k out) uses about 0.2 plan credits, at the provider's own price.

Provider

cv11

Roleplay fit

Llama models are a widely-supported open baseline, useful when you want predictable, well-documented behavior.

Context behavior

With a 131,072-token context window, it can hold a long-running roleplay or a full lorebook in memory without losing earlier plot details, so it suits multi-session campaigns and character cards with heavy backstory.

Cost for regular use

It is priced low enough for high-volume daily roleplay without the per-message cost adding up quickly.

From the provider

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Supplied by cv11, not written by Composite.