Janas: Run LLMs larger than RAM by streaming experts from SSD
Article URL: https://github.com/prabanta-dev/janas Comments URL: https://news.ycombinator.com/item?id=50063717 Points: 22 # Comments: 8
Hacker News15 min read
Unsloth
2 stories
Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s
Article URL: https://github.com/Niko1221/Strata Comments URL: https://news.ycombinator.com/item?id=49953495 Points: 146 # Comments: 54
Hacker News9 min read
Showing 2 of 2 stories
You're all caught up.
AiByts Weekly Brief
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news from Hacker News
Join 15,000+ AI enthusiasts