Don’t Build One Mega AI Agent. Build a Small Team of Specialists.
The “one god‑agent that does everything” sounds cool but fails in production. A small team of focused assistants—powered by Clawdi—works much better.
93 stories
The “one god‑agent that does everything” sounds cool but fails in production. A small team of focused assistants—powered by Clawdi—works much better.
Every tool in web automation runs on a browser engine. There are only two real options: Chromium and Lightpanda. Here's how the entire stack fits together.
The LP domain grows with LP.getSemanticTree, LP.getInteractiveElements, and LP.getStructuredData alongside a native MCP server built into the browser binary that exposes the same engine capabilities without CDP.
Lightpanda can now handle multiple CDP connections simultaneously. Here's what it took to get there and what it means for running concurrent browser sessions at scale.
Why we added robots.txt support, how the singleflight cache works, and why the feature is opt-in.
How we built request interception in Lightpanda and why the async coordination between your HTTP client and CDP WebSocket is the part that really matters.
We replaced LibDOM with a custom Zig implementation for better cohesion across events, Custom Elements, and ShadowDOM. Here's how we built it and what we learned along the way.
We chose Zig over C++ and Rust because we wanted a simple, modern systems language. Here's what we learned building a browser with it.
Modern web architecture has made traditional HTTP crawling obsolete. JavaScript execution is now mandatory for most sites and that changes everything about infrastructure costs and scale.
We explore the difference between a consumer browser in headless mode versus a true headless browser built for machines.
A high-level explanation into Sim realtime collaborative workflow builder - from operation queues to conflict resolution.
How we built a DAG-based execution engine with native parallel processing, intelligent edge routing, and stateful pause/resume capabilities
Web automation tools like Playwright and Puppeteer run on top of CDP. Understanding CDP helps developers choose the right level of abstraction.
How Dropstone uses Tree-sitter for Abstract Syntax Tree parsing to achieve deep semantic understanding of code across 40+ programming languages, enabling accurate analysis and intelligent suggestions.
We've switched all Lightpanda browser HTTP requests from our home made Zig HTTP client + zig.tls) to libcurl
Three years ago when we started Lightpanda, we asked ourselves a seemingly simple question what would a browser look like if it were built specifically for automation?
Many new Transformer architecture improvements have been proposed since my last post on “The Transformer Family” about three years ago. Here I did a big refactoring and enrichment of that 2020 post — restructure the hierarchy of sections and improve many sections with more recent papers.
[Updated on 2023-01-24: add a small section on Distillation.] Large transformer models are mainstream nowadays, creating SoTA results for a variety of tasks. They are powerful but very expensive to train and use.
Showing 90 of 93 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts