Tasks
Step-by-step guides for common inference-cache operations.
These guides walk through the operations you perform against a running inference-cache
install — from the first CacheBackend to tuning, isolation, and monitoring.
- Deploy a CacheBackend — the five-minute
quickstart: the minimum
CacheBackend, what it wires up, and how to read its readiness. - Bind an engine — the selector → webhook → injection lifecycle, the reserved args/env you cannot override, and its failure modes.
- Tune lookup and eviction — worked
CachePolicyexamples for match floors, score floors, timeouts, and eviction. - Isolate tenants — identity, entry-count quota, and the recommended pattern for true per-tenant byte isolation.
- Monitor the cache plane —
kubectlsurfaces, metrics, and thedoctorpre-flight check.