A Small Caching Layer for a Slow API
One upstream call was taking 900ms and getting hit on every page load. Forty lines of cache took p95 latency from 910ms to 4ms.
1 post.
One upstream call was taking 900ms and getting hit on every page load. Forty lines of cache took p95 latency from 910ms to 4ms.