v0.7.0
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
llama.cpp11 min read
Eugene Yan
Stay updated with the latest developments in Artificial Intelligence
Agents on live hardware: reason where you must, engineer everywhere else
CoreWeave Blog10 min read
b11669
llama.cpp1 min read
Patterns for Building Cybersecurity Evals
A sandboxed target, inputs that influence task difficulty, tools, and a grader.
Eugene Yan18 min readUsing LLMs to Secure Source Code
Build a threat model, discover vulnerabilities, verify, triage, and patch.
Eugene Yan1 min readHow to Work and Compound with AI
Context as infra, taste as config, verification for autonomy, scale via delegation, closing the loop.
Eugene Yan12 min read2025 Year in Review
An eventful year of progress in health and career, while making time for travel and reflection.
Eugene Yan5 min readProduct Evals in Three Simple Steps
Label some data, align LLM-evaluators, and run the eval harness with each change.
Eugene Yan9 min readAdvice for New Principal Tech ICs (i.e., Notes to Myself)
Based on what I've learned from role models and mentors in Amazon
Eugene Yan13 min readTraining an LLM-RecSys Hybrid for Steerable Recs with Semantic IDs
An LLM that can converse in English & item IDs, and make recommendations w/o retrieval or tools.
Eugene Yan22 min readEvaluating Long-Context Question & Answer Systems
Evaluation metrics, how to build eval datasets, eval methodology, and a review of several benchmarks.
Eugene Yan26 min readAI Engineer 2025 - Improving RecSys & Search with LLM techniques
Recsys & search are converging with LLMs via semantic IDs, data augmentation, and unified foundation models.
Eugene Yan1 min readExceptional Leadership: Some Qualities, Behaviors, and Styles
What makes a good leader? What do good leaders do? And commando, soldier, and police leadership.
Eugene Yan4 min readBuilding News Agents for Daily News Recaps with MCP, Q, and tmux
Learning to automate simple agentic workflows with Amazon Q CLI, Anthropic MCP, and tmux.
Eugene Yan7 min readAn LLM-as-Judge Won't Save The Product—Fixing Your Process Will
Applying the scientific method, building via eval-driven development, and monitoring AI output.
Eugene Yan5 min readFrequently Asked Questions about My Writing Process
How I started, why I write, who I write for, how I write, and more.
Eugene Yan11 min readNVIDIA GTC 2025 - Building LLM-Powered Applications
Chip Huyen and I share what we've learned, best practices, and insights at NVIDIA GTC 2025.
Eugene Yan1 min readImproving Recommendation Systems & Search in the Age of LLMs
Model architectures, data generation, training paradigms, and unified frameworks inspired by LLMs.
Eugene Yan39 min readBuilding AI Reading Club: Features & Behind the Scenes
Exploring how an AI-powered reading experience could look like.
Eugene Yan9 min read2024 Year in Review
2024 was a peaceful year of steady progress. With regard to my craft, the prototypes of 2023 were scaled and put into production, and I rediscovered the joy of building in public.
Eugene Yan6 min readSeemingly Paradoxical Rules of Writing
With regard to writing, there are many rules and also no rules at all.
Eugene Yan2 min read
Showing 18 of 30 stories
Load more storiesAiByts Weekly Brief
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news from Eugene Yan
Join 15,000+ AI enthusiasts