Llama 3.1 8B pricing

Llama 3.1 8B, Small-tier from Together AI, costs $0.18 per 1M input tokens and $0.18 per 1M output tokens.

verified at the provider's own pricing page

Input$0.18per 1M tokens
Output$0.18per 1M tokens
Context window128Ktokens
TierSmallTogether AI

Price your own workload against Llama 3.1 8B in the calculator →

Specs and pricing

ProviderTogether AI
TierSmall
Context window128K tokens
Max output—
Input price$0.18 / 1M tokens
Output price$0.18 / 1M tokens
Modalitiestext
Released2024-07

Note. Flat rate — input and output cost the same. Priced on its own model page rather than in the main serverless table.

What it costs at realistic volumes

Assuming a 4:1 input:output token ratio, a common shape for chat and RAG-style workloads:

Volume (4:1 in:out ratio)Input costOutput costTotal / month
1,000,000 in / 250,000 out$0.18$0.04$0.22
10,000,000 in / 2,500,000 out$1.80$0.45$2.25
100,000,000 in / 25,000,000 out$18.00$4.50$22.50

Cheaper alternatives

Same tier (Small), a different provider, and a lower blended cost at the 4:1 ratio used above:

ModelProvider$/1M in$/1M outAt the 4:1 ratio
Meta-Llama-3.1-8B-Instruct-TurboDeepInfra$0.02$0.0486.7% cheaper blended
Solar Pro 4OpenRouter$0.03$0.1273.3% cheaper blended
GPT-OSS 20BOpenRouter$0.03$0.1372.2% cheaper blended
schematron-v2-turboinference.net$0.03$0.1570% cheaper blended
Amazon Nova MicroAmazon (Nova)$0.035$0.1468.9% cheaper blended