Skip to content
Finitizer

Cache Hit Rate

Usage OptimizationAnomaly ManagementReporting & AnalyticsKPIs & BenchmarkingAI

Definition

Measures the percentage of tokens used from cache. Cached tokens are significantly cheaper. A low cache hit rate signals an optimization opportunity for FinOps Practitioner and Engineering Personas .

Formula, as published

Cache Hit Rate = Cached Input Tokens / (Cached + Non-Cached Input Tokens) x 100

Calculate it

Example values to start with; replace them with yours.

Cache hit rate
30.0%

How to measure it

Watch the input-token convention. OpenAI counts cached tokens inside input tokens; Anthropic counts cache reads on top. Divide cached tokens by all input tokens, cached and not.

On models that charge to write to the cache, a low hit rate can cost more than no caching at all.

Compute it from your OpenAI or Claude export

Drop in your OpenAI or Claude usage export and see where the AI spend goes.

From the FinOps Foundation

All 88 FinOps KPIs, and a scorecard for your billing file

Definition and formula: Cache Hit Rate, FinOps KPI library, FinOps Foundation, licensed CC BY 4.0, read 16 Oct 2026. Changed: HTML removed, dashes and British spellings changed, formula split from its data sources and examples. The calculator and the notes are Finitizer’s.

Measured once, a KPI is a number. Tracked daily, it is a practice.

Finitizer computes the KPIs your billing data supports every day, by team and product, across AWS and Google Cloud.

See how Finitizer works