Proxy Package Refactor / Optimizations

[crandles]

Using this as a catch all ticket to discuss improvements to the pkg/proxy package.

Goals:

• Improve performance
• Improve testability
• Reduce duplication / increase code reuse

---

Related PRs:

• cache client refactor #819
• perf: [cache] use singleflight to de-duplicate cache lookups #834