backpressure

How to add LLM request queuing in Node.js 2026: no Redis

An in-process LLM request queue for Node.js: concurrency cap, per-user fairness, and backpressure under 60 lines. No Redis or BullMQ needed in 2026.