Cline5 min read
11,840 TPS on a single GPU
NVIDIA released Nemotron 3.5 Super VL on October 15, and we reached 11,840 aggregate output tokens/sec on one GB300 with 256 concurrent requests. This blog post is a walkthrough of all the tricks we used to get there. For context, this model is specifically designed to be
By Ara KhanCline

Read the full story
Originally published by Cline on Oct 27, 2026.
Comments
Sign in to join the discussion.