Why open source always wins
Most tools we use on a daily basis are built in the open. The core team works for a company, while a bunch of people from the internet donate their time and effort to a project they like.
10 stories
Most tools we use on a daily basis are built in the open. The core team works for a company, while a bunch of people from the internet donate their time and effort to a project they like.
PgDog is a proxy for scaling PostgreSQL. It’s one among many, so we’re starting this series of posts to compare us with the competition.
PgDog is a proxy for scaling Postgres. One of its features is connection pooling, which allows many client applications to use the same database without exceeding its connection limit.
The reason DBs like Mongo or Dynamo exist is because Postgres has a scaling problem. If you could make it just work, with 100 TB+ tables and 1M queries per second, we don’t think you would use anything else.
Forking pg_query.rs to replace Protobuf with bindgen-generated direct C-to-Rust struct mappings, yielding 5x faster query parsing and 10x faster deparsing in PgDog.
An on-call story about a 300 GB sequential scan, what default_statistics_target really controls, and why tuning autovacuum eventually loses to horizontal sharding.
Lessons from a week of writing PgDog's documentation: validating TOML examples with configcheck, parsing SQL snippets with pglast in CI, and why LLMs can't write the why.
Guaranteeing globally unique BIGSERIAL primary keys across shards using Postgres's satisfies_hash_partition function, with no UUIDs and no external ID generation services.
How PgDog exposes parsed SQL ASTs to dynamically loaded Rust plugins via the C ABI, letting you customize sharding and load-balancing logic without serialization overhead.
Scaling Postgres pub/sub past max_connections by terminating LISTEN/NOTIFY in PgDog, fanning out messages over Tokio broadcast channels, and using Postgres only as the broker.
Showing 10 of 10 stories
You're all caught up.
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts