OpenAI's documentation suggests a theoretical maximum speed of 280 tokens per second for GPT-6.1 Sol in its fast mode

Artificial intelligence research, products, and impact across society.

Large language models (LLMs) are advanced AI systems trained on massive text datasets to understand, generate, and reason about human language, powering applications such as chatbots, code generation, summarization, and scientific discovery.