Know a great AI tool or AI news source? Submit it to AiByts
DigitalOcean5 min read

Prompt Caching is GA on DigitalOcean Serverless Inference: Up to 90% Off the Context Your Agents Resend

Prompt caching is now generally available on DigitalOcean Serverless Inference, across supported models in our open model catalog, with no changes to your request code required. Cached Input is billed at up to 90% off and time to first token drops by up to 80%.

By DigitalOceanDigitalOcean Blog
Prompt Caching is GA on DigitalOcean Serverless Inference: Up to 90% Off the Context Your Agents Resend

Read the full story

Originally published by DigitalOcean Blog on Oct 23, 2026.

Read on DigitalOcean Blog(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.