[RFC] v0.5.0 Unified Cache Backend

[DefTruth]

v0.5.0 Features Trace

• Design a Unified Cache Backend Abstract: Cache Indicator (When to cache) + Cache calibrator (How to cache)
• New algorithms support: FoCa, CG-Taylor (PaddlePaddle), Group Block Cache & token-wise TaylorSeer (from cache-dit), HiCache, DiCache, etc.
• More new models support
• Official readthedocs.io
• Tests CI
• compatible with cpu offload
• ...

[vibe-viscot]

Hi! Are there any plans to support DiCache?
I came across it by chance, and according to the paper's introduction, it outperforms Teacache and TaylorSeer.

code：https://github.com/Bujiazi/DiCache

[DefTruth]

Hi! Are there any plans to support DiCache? I came across it by chance, and according to the paper's introduction, it outperforms Teacache and TaylorSeer.

code：https://github.com/Bujiazi/DiCache

I'm not quite sure, but maybe I will have a try. Thank you for your recommendation ~

[DefTruth]

Hi! Are there any plans to support DiCache? I came across it by chance, and according to the paper's introduction, it outperforms Teacache and TaylorSeer.

code：https://github.com/Bujiazi/DiCache

DiCache similar with DBCache in cache-dit.