Skip to content
Open CastalyConsole

Platform features

Cache hit guarantee

Protected OpenAI groups carry a minimum daily cache hit rate, and a shortfall is credited back.

Prompt caching lowers the price of repeated input tokens, but the hit rate depends on the upstream route rather than on your client. Three OpenAI routing groups therefore carry a published minimum daily cache hit rate:

Group Daily target
openai-award 65%
openai-stable 75%
openai-premium 85%

If the measured rate for a UTC day stays below the target, the tokens missing from the target are credited back at the price difference between a cache miss and a cache read on those requests.

  • Send prompt_cache_key on the request. Chat Completions and Responses both accept it. A request without it is not counted.
  • Keep a stable prefix for that key, as you would for any prompt cache.
  • Use one of the groups above.
  • Ordinary text input only. Requests that bill image tokens, audio tokens, or cache writes are excluded, because their pricing cannot share one text-token comparison.

A series — one account, one prompt_cache_key, one model — starts counting only after at least one real cache read has proved the prefix is cacheable, and its eligible input is capped at the largest prefix actually read from cache in that series.

Each window is the UTC day [00:00, 24:00). Calculation for the closed day starts at 00:10 UTC. Approved compensation is credited to your balance, and to the remaining quota of the key that made the requests.

The Cache Hit Guarantee card in Usage shows, per group, the daily target, the measured hit rate, and the amount credited for the selected range.

Only a keyed hash of prompt_cache_key is kept with the usage evidence. The raw value is never written to the database, and the guarantee is not advertised at all when that protection is unavailable.