TECH RADAR / SYSTEMS & CACHING
LMCache
KV cache storage, transfer, and reuse.
What it covers
Cache reuse across serving and storage tiers.
What we would check
Measure retrieval and transfer time alongside avoided prefill work. Cache-hit rate alone does not establish a latency benefit.
Go to the source
A curated ecosystem entry. The evaluation guidance is our interpretation, not a report of a completed test or a performance ranking.