Know a great AI tool or AI news source? Submit it to AiByts
SGLang17 min read

With software alone, one B200 beats the LPU and gets close to Cerebras

Stock SGLang served gpt-oss-120b at 411 tokens per second on one rented B200. Four settings took the same card and the same weights to 1,366, and single prompts to 2,215. No kernel written, nothing recompiled.

By Jaber JaberRunInfra Blog
With software alone, one B200 beats the LPU and gets close to Cerebras

Read the full story

Originally published by RunInfra Blog on Aug 6, 2026.

Read on RunInfra Blog(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.