Evaluating Long-Context Question & Answer Systems
Evaluation metrics, how to build eval datasets, eval methodology, and a review of several benchmarks.
109 stories
Evaluation metrics, how to build eval datasets, eval methodology, and a review of several benchmarks.
What makes a good leader? What do good leaders do? And commando, soldier, and police leadership.
Learning to automate simple agentic workflows with Amazon Q CLI, Anthropic MCP, and tmux.
Special thanks to John Schulman for a lot of super valuable feedback and direct edits on this post. Test time compute (Graves et al. 2016, Ling, et al. 2017, Cobbe et al. 2021) and Chain-of-thought (CoT) (Wei et al. 2022, Nye et al.
Applying the scientific method, building via eval-driven development, and monitoring AI output.
How I started, why I write, who I write for, how I write, and more.
Discover our latest AI improvements including text-based image editing, AI-driven storytelling agents, personalized text-to-video generation, the powerful Imgen 3 model, toggleable prompt augmentation, and enhanced video colorization.
Model architectures, data generation, training paradigms, and unified frameworks inspired by LLMs.
Discover our latest AI improvements including enhanced colorization with prompt support, new art styles, automatic sound generation for videos, and more powerful image processing features.
Exploring how an AI-powered reading experience could look like.
2024 was a peaceful year of steady progress. With regard to my craft, the prototypes of 2023 were scaled and put into production, and I rediscovered the joy of building in public.
Experience the our most advanced AI colorization model, offering unprecedented quality and historical context awareness. Now available for free at neural.love!
With regard to writing, there are many rules and also no rules at all.
Reward hacking occurs when a reinforcement learning (RL) agent exploits flaws or ambiguities in the reward function to achieve high rewards, without genuinely learning or completing the intended task.
Benefits of running a weekly paper club, how to start one, and how to read and facilitate papers.
I just upgraded my personal laptop from a 2019 Intel MacBook Pro to an M4 MacBook Pro. Like all my new devices, instead of restoring from a backup, I try to Marie Kondo my digital life and start from a clean slate. This also lets me reexamine my existing tools and explore new options.
Experience state-of-the-art video generation powered by MiniMax Video 01. Convert static images to videos or create videos from scratch with unprecedented ease and quality.
ML systems, production & scaling, execution & collaboration, building for users, conference etiquette.
Showing 54 of 109 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts