Axolotl4 min read
The RTX 5090 Is Here: Serve 65,000+ Tokens Per Second on Runpod
Launch benchmarks from April 2025: the NVIDIA RTX 5090 served Qwen2-0.5B at 65,000+ tokens/sec and 250+ requests/sec with vLLM at 1024 concurrent prompts.
By Alyssa MazzinaRunPod
Read the full story
Originally published by RunPod on Oct 15, 2026.
Comments
Sign in to join the discussion.