Cost guide

Output vs Input LLM API Pricing — Why Generation Costs 3–4× More

Published 2026-07-10 · Estimated read: 5 min

Output tokens cost 3.7× more than input tokens on average across 2,092 chat API models. That means your bill is dominated by generation cost even when your input volume looks larger. This guide breaks down the multiplier by provider, model type, and real workload examples.

1. The output/input pricing multiplier

Every LLM provider charges different rates for input and output tokens. While many developers focus on the headline input price, output tokens are typically 2–5× more expensive — and for reasoning models, the gap can reach 10× or more.

  • All chat models: 3.65× average output/input ratio
  • Non-reasoning models: 3.12× average
  • Reasoning models: 4.81× average
  • Total models analyzed: 2,092

The implication is straightforward: output cost drives the bill. Even when input volume is 2–3× larger, the higher output rate means generation accounts for most of the total. A model with cheap input but expensive output can cost more overall than a balanced alternative.

2. Per-provider breakdown

The output/input ratio varies dramatically by provider. Open-weight inference platforms like Fireworks AI typically offer near-1:1 ratios, while frontier providers like Anthropic and OpenAI consistently charge 4–5× for output.

Provider Avg output/input ratio Models
anyscale 1.00× 12
fireworks_ai 1.41× 243
nscale 1.62× 14
ovhcloud 1.72× 15
hyperbolic 1.84× 16
watsonx 1.85× 28
lambda_ai 2.01× 20
DeepSeek 2.12× 12
llamagate 2.19× 14
Groq 2.61× 11
oci 2.77× 29
Mistral 2.84× 51
wandb 3.00× 16
nebius 3.08× 27
gradient_ai 3.20× 10
vertex_ai-mistral_models 3.21× 19
Bedrock 3.27× 187
novita 3.28× 80
Scaleway 3.29× 14
deepinfra 3.30× 67
perplexity 3.50× 16
vercel_ai_gateway 3.54× 91
Fireworks AI 3.56× 33
baseten 3.59× 11
zai 3.60× 10
azure_ai 3.76× 65
Together AI 3.92× 32
xai 4.13× 38
OpenRouter 4.38× 93
Cloudflare 4.44× 22
Tensormesh 4.53× 10
Libertai 4.61× 11
bedrock_converse 4.62× 121
OpenAI 4.63× 103
replicate 4.63× 40
databricks 4.84× 25
moonshot 4.85× 22
Azure 4.91× 132
Snowflake 4.91× 11
gmi 4.93× 17
Bedrock Converse 5.00× 16
Anthropic 5.00× 23
vertex_ai-anthropic_models 5.00× 29
dashscope 5.41× 17
vertex_ai-language-models 5.95× 22
Google 6.38× 37
sambanova 13.69× 17

Fireworks AI leads with the lowest average ratio at 1.00×, making it a strong candidate for output-heavy workloads. At the other end, providers like Anthropic and OpenAI charge output at 4–5× input, reflecting the higher compute cost of generation.

3. Reasoning vs non-reasoning models

Reasoning (chain-of-thought) models amplify the output multiplier. These models generate internal reasoning tokens before producing the final answer, effectively increasing the output-to-input cost ratio.

  • Non-reasoning models: 3.12× average ratio (1,435 models)
  • Reasoning models: 4.81× average ratio (657 models)
  • Additional hidden tokens: Reasoning models often consume 30–40% more tokens internally through thinking chains, making the effective cost even higher than the ratio suggests

Our reasoning LLM pricing guide covers the full breakdown of thinking model costs.

4. Models with the cheapest output ratios

A few models buck the trend, charging near-1:1 or even cheaper output than input. These are worth considering for output-heavy workloads:

Model Provider Ratio Input / 1M Output / 1M
llama-guard-3-8b Cloudflare 0.06× $0.48 $0.03
Llama-4-Maverick-17B-128E-Instruct-FP8 azure_ai 0.25× $1.41 $0.35
Meta-Llama-3-70B-Instruct azure_ai 0.34× $1.10 $0.37
ai21.j2-mid-v1 Bedrock 1.00× $12.50 $12.50
ai21.j2-ultra-v1 Bedrock 1.00× $18.80 $18.80

At the other end of the spectrum, models with the highest output ratios (often specialized audio or multimodal routes) can reach 20–200×. Always check the ratio before committing to a model for generation-heavy workloads.

5. Real workload cost comparison

To see the multiplier in action, consider a standard production workload: 2,000 input tokens + 1,000 output token per request, 100,000 requests/month.

Scenario Input cost Output cost Total monthly Output share
Budget (2x ratio) $15.00 $15.00 $30.00 50%
Average (3.64x ratio) $100.00 $182.00 $282.00 65%
Premium (5x ratio) $600.00 $1500.00 $2100.00 71%

Even at the average 3.64× ratio, output cost accounts for 65% of the total bill. At the budget 2× ratio, it's still 50%. For premium 5× models, output dominates at 71%.

Use the calculator with your own token counts and the compare tool to see the real ratio for your shortlisted models.

6. Summary

  • Output tokens cost 3.7× more than input tokens on average
  • Non-reasoning models: 3.1×; reasoning models: 4.8×
  • Open-weight providers like Fireworks offer near-1:1 ratios; frontier providers charge 4–5×
  • Even with 2:1 input-to-output token volume, output drives 50–70%+ of the total cost

What to do next: Open the compare tool to check the output/input ratio for your shortlisted models, or use the calculator to estimate your workload's true output cost. The lowest-ratio models compare preset is a good starting point for output-heavy applications.