#prompt caching

Five LLM Gateways, Five Failures: Researchers Read Across Customers Through the Prompt Cache

A measurement paper finds every open-source relay tested leaks cross-customer cache reads by default — and the fix costs under 2.5%.

2h ago