Know a great AI tool or AI news source? Submit it to AiByts

Hugging Face Transformers

43 stories

Stories

  • Run fast, private agents on-device with LFM2.5-24B-A2B

    LFM2.5-24B-A2B is a 24B-parameter reasoning model with just 2B active parameters, built for fast, private agents on-device. It thinks before it answers, calls tools, and works through multi-step tasks inside popular agent harnesses.

    Hugging Face Blog5 min read
  • Build your own decision model

    Article URL: https://nishtahir.com/build-your-own-decision-model/ Comments URL: https://news.ycombinator.com/item?id=50037949 Points: 266 # Comments: 61

    Hacker News6 min read
  • Why Temperature 0 Isn't Deterministic

    A one-line formula for how often an LLM's top token flips, and why identical completions fall apart after about a hundred tokens The post Why Temperature 0 Isn't Deterministic appeared first on Towards Data Science.

    Towards Data Science11 min read
  • How to become an AI research scientist

    If you’re more interested in asking why a model works than just using it off the shelf, a career as an AI research scientist might be the right fit for you.

    AI and Machine Learning Roadmaps Blog7 min read
  • Build Your Own Post-training Pipeline

    This is the final post in a four-part series about post-training. If you missed them, check out part 1, part 2, and part 3. Time to get your hands dirty! I’ll take you through implementing the key pieces of the classic ChatGPT pipeline: SFT, then reward model training, then PPO.

    O'Reilly Radar - AI/ML11 min read
  • Introduction to vLLM and PagedAttention

    Learn how vLLM achieves higher throughput than Hugging Face Transformers by using PagedAttention to eliminate memory waste, boost inference.

    RunPod12 min read
  • Why GPT Ditched Half the Transformer

    How OpenAI stripped down the original encoder-decoder architecture — and why removing half of it made language models better, not worse.Continue reading on Towards AI »

    Towards AI1 min read
  • Release v5.19.0

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. - Release Release v5.19.0 · huggingface/transformers

    Transformers6 min read
  • Release 5.18.0

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training. - Release Release 5.18.0 · huggingface/transformers

    Transformers17 min read

Showing 18 of 43 stories

Load more stories
AiByts Weekly Brief

Get the top AI news and tools straight to your inbox every week.

Weekly · AI news

Join 15,000+ AI enthusiasts