Prompt caching restored for LLM gateways and custom base URLs
Prompt caching is now fully functional for sessions using an LLM gateway or custom base URL. Previously, routing your traffic through an intermediate gateway or custom endpoint broke prompt cache reuse, forcing subsequent API turns to re-process identical prompt prefixes from scratch. That cache invalidation issue has now been resolved, allowing sessions using an LLM gateway or custom base URL to save tokens and latency on repeated context.