Skip to content

Llama 3.2 3B Instruct (Deep Infra) vs Llama 3.1 8B Instruct

Llama 3.2 3B Instruct (Deep Infra) is cheaper on output tokens. Choose Llama 3.2 3B Instruct (Deep Infra) or Llama 3.1 8B Instruct based on the trade-off between cost, context, and the benchmarks that matter for your use case.

SpecLlama 3.2 3B Instruct (Deep Infra)Llama 3.1 8B Instruct
ProviderEden AIMeta
Input / 1M tokens$0.02$0.05
Output / 1M tokens$0.02$0.08
Context window131K131K
Parameters——
Open weightsYes—
ReleasedSep 2024—
GPQA Diamond score—27.0
LMArena (Chatbot Arena) Elo score—1187

FAQ

Is Llama 3.2 3B Instruct (Deep Infra) or Llama 3.1 8B Instruct cheaper?

Llama 3.2 3B Instruct (Deep Infra) is cheaper on output tokens ($0.02 vs $0.08 per 1M).

Which has the larger context window, Llama 3.2 3B Instruct (Deep Infra) or Llama 3.1 8B Instruct?

Both models offer a similar context window.

Pricing is indicative — confirm with the provider before production use. Highlighted values indicate the better figure for that row.