LLMs By Max Output Token - Feb 2025

February 8, 2025 ยท View on GitHub

Hugging Face Spaces

This analysis shows the evolution of maximum output tokens across different AI language models and companies. The visualization uses a logarithmic scale to better display the wide range of token values (4,000 to 100,000) and includes trend lines to show each company's progression over time. Models with 32K+ tokens are labeled directly on the plot for easy reference.

Visualization

Max Output Tokens / Time

alt text

Chart 1 With Connections To Show Per-Company Evolution

This chart really highlights how OpenAI, with their recently released o1 series, have brought the first significant advances to the max output tokens parameter.

While models like the Gemini series have amazing context sizes of 1M+ tokens, their max single output remains a very diminuitive 8,192 tokens (0.008%!).

The maximum output size is highly relevant when debugging or creating long code projects in which even with agentic coding capabilities that only update part of a long file at a time, the constraint can make write-to-file type commands non-functional due to continuous output constraints:

alt text

Repository Structure

  • data/: Contains the primary dataset and source data
    • data-sources/: Original data collected from each company's documentation
      • anthropic/: Anthropic model data
      • cohere/: Cohere model data
      • google/: Google model data
      • openai/: OpenAI model data
  • plots/: Contains visualization outputs
  • 080225/: Contains the latest analysis and findings

Data Table (Sorted by Maximum Output Tokens)

Model NameMax Output TokensCompanyLaunch DateMax Input TokensMax Output as % of Max InputRelease Type
o1100000OpenAI2024-11-06100000010.00Fixed
o1-mini65536OpenAI2024-11-0610000006.55Fixed
Deep Seek Reasoner32768Deep Seek2025-01-2032768100.00Rolling
o1-preview32768OpenAI2024-11-0610000003.28Fixed
chatgpt-4o-latest16384OpenAI2024-11-0612800012.80Fixed
gpt-4o-mini16384OpenAI2024-11-0612800012.80Fixed
gpt-4o16384OpenAI2024-11-0612800012.80Fixed
Gemini 2.0 Flash8192Google2025-02-0510000000.82Fixed
Gemini 2.0 Flash-Lite Preview8192Google2025-02-0510000000.82Fixed
gpt-4-03148192OpenAI2023-03-148192100.00Fixed
gpt-4-06138192OpenAI2023-06-138192100.00Fixed
gpt-48192OpenAI2023-03-148192100.00Fixed
Claude 3.5 Sonnet8192Anthropic2024-06-202000004.10Fixed
Claude 3.5 Haiku8192Anthropic2024-10-222000004.10Fixed
Gemini 1.5 Pro8192Google2024-05-2310000000.82Fixed
Gemini 1.5 Flash 8B8192Google2024-10-0810000000.82Fixed
Gemini 1.5 Flash8192Google2024-05-1410000000.82Fixed
Deep Seek V38000Deep Seek2025-01-203276824.41Rolling
Claude 3 Haiku4096Anthropic2024-03-072000002.05Fixed
Claude 3 Opus4096Anthropic2024-03-142000002.05Fixed
gpt-4-turbo4096OpenAI2023-11-061280003.20Fixed
gpt-4-turbo-preview4096OpenAI2023-11-061280003.20Fixed
Claude 3 Sonnet4096Anthropic2024-03-142000002.05Fixed
command-r-plus-08-20244000Cohere2024-08-011280003.13Fixed
command-r7b-12-20244000Cohere2024-12-011280003.13Fixed

Author

Daniel Rosehill
(public at danielrosehill dot com)

Licensing

This repository is licensed under CC-BY-4.0 (Attribution 4.0 International) License

Summary of the License

The Creative Commons Attribution 4.0 International (CC BY 4.0) license allows others to:

  • Share: Copy and redistribute the material in any medium or format.
  • Adapt: Remix, transform, and build upon the material for any purpose, even commercially.

The licensor cannot revoke these freedoms as long as you follow the license terms.

License Terms

  • Attribution: You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • No additional restrictions: You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

For the full legal code, please visit the Creative Commons website.