AI model
meta-llama/llama-3.1-70b-instruct
Meta: Llama 3.1 70B Instruct is a 131,072-token model served on Composite at $0.900 per million tokens in and $0.900 per million tokens out. Ranked #141 of 179 models by traffic on Composite over the last 30 days, taking 0% of tokens and 0% of requests.
Try in Playground| Model ID | meta-llama/llama-3.1-70b-instruct |
|---|---|
| Provider | cv11 |
| Context window | 131,072 tokens |
| Accepts | text |
| Returns | text |
| Input price | $0.900 per million tokens |
| Output price | $0.900 per million tokens |
| Prompt caching | Not offered for this model |
| Moderated | Yes - by the provider |
| Cost on a monthly plan | About 6.5 plan credits per typical call (8k in, 1k out) |
| Routing endpoints | 2 (base plus 1 routing variant) |
Make a Composite API key and type meta-llama/llama-3.1-70b-instruct as the model name. JanitorAI takes the full URL https://composite.lucidity.sh/v1/chat/completions; SillyTavern, ChubAI, Agnai and RisuAI take https://composite.lucidity.sh/v1. It runs on credits, a plan, or your own provider key.
JanitorAI setup · SillyTavern setup · Best Janitor AI proxies compared
#141 of 179
0% of tokens and 0% of requests over 30 days.
The same model behind 1 alternative endpoint. Call the id directly to pin a route; the base id above picks for you.
| Route | Model ID | Provider | Price |
|---|---|---|---|
| cheapThink | meta-llama/llama-3.1-70b-instruct:cheapThink |
cv11 | $0.900 per million tokens input · $0.900 per million tokens output |
$0.900 per million tokens input · $0.900 per million tokens output
Credits pay the provider’s price plus 25%; cache hits cost less.
On a monthly plan, a typical call (8k tokens in, 1k out) uses about 6.5 plan credits, at the provider's own price.
cv11
Llama models are a widely-supported open baseline, useful when you want predictable, well-documented behavior.
With a 131,072-token context window, it can hold a long-running roleplay or a full lorebook in memory without losing earlier plot details, so it suits multi-session campaigns and character cards with heavy backstory.
It sits in the mid-range on price, a reasonable pick for regular roleplay use without going for the cheapest option available.
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Supplied by cv11, not written by Composite.
Meta: Muse Ember · Meta: Muse Spark Open · Meta: Muse Wonder