How Did I Write My First FlashAttention Kernel in CUDA ?
From demystifying the online softmax trick to hitting a 41.6x speedup on an NVIDIA RTX 4050 GPU — a beginner’s hands-on journey into hardware-aware deep learning.
Towards AI11 min read
FlashAttention
2 stories
Lossless Inference
How to make LLM serving faster without touching the model. Exact kernels, speculative decoding, lossless compression, KV reuse and scheduling, with the math and how to verify it with logit parity.
RunInfra Blog8 min read
Showing 2 of 2 stories
You're all caught up.
AiByts Weekly Brief
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts