runtime-api subsystem lru cache (#2309)

* Add memory-lru cache to runtime-api

* Add cache.rs

* Adds MallocSizeOf

* Review nits

* Add a cached requests metric

* More review nits

* Some more review nits
10 jobs for master in 17 minutes and 35 seconds (queued for 12 minutes and 58 seconds)