Compositev12
← All models Model directory

AI model

Meta: Llama 3.1 70B Instruct

meta-llama/llama-3.1-70b-instruct

Meta: Llama 3.1 70B Instruct is a 131,072-token model served on Composite at $0.500 per million tokens in and $0.500 per million tokens out. Ranked #152 of 194 models by traffic on Composite over the last 30 days, taking 0% of tokens and 0% of requests.

Try in Playground

Community rating

— No community ratings yet.

Sign in to rate this model. Ratings come from accounts that have run requests through Composite.

Specifications

Specifications and pricing as served by Composite
Model IDmeta-llama/llama-3.1-70b-instruct
Providercv11
Context window131,072 tokens
Acceptstext
Returnstext
Input price$0.500 per million tokens
Output price$0.500 per million tokens
Prompt cachingNot offered for this model
ModeratedNo
Cost on a monthly planAbout 3.6 plan credits per typical call (8k in, 1k out)
Routing endpoints2 (base plus 1 routing variant)

Traffic rank on Composite

#152 of 194

0% of tokens and 0% of requests over 30 days.

Routing variants

The same model behind 1 alternative endpoint. Call the id directly to pin a route; the base id above picks for you.

RouteModel IDProviderPrice
cheapThink meta-llama/llama-3.1-70b-instruct:cheapThink cv11 $0.500 per million tokens input · $0.500 per million tokens output

Pricing

$0.500 per million tokens input · $0.500 per million tokens output

Credits pay the provider’s price plus 25%; cache hits cost less.

On a monthly plan, a typical call (8k tokens in, 1k out) uses about 3.6 plan credits, at the provider's own price.

Provider

cv11

Roleplay fit

Llama models are a widely-supported open baseline, useful when you want predictable, well-documented behavior.

Context behavior

With a 131,072-token context window, it can hold a long-running roleplay or a full lorebook in memory without losing earlier plot details, so it suits multi-session campaigns and character cards with heavy backstory.

Cost for regular use

It sits in the mid-range on price, a reasonable pick for regular roleplay use without going for the cheapest option available.

From the provider

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Supplied by cv11, not written by Composite.