8bit CAME optimizer #1229
Description
Feature request
I would really love a 8bit version of CAME optimizer being supported.
Motivation
If the implementation is possible.
Your contribution
Pixart Sigma model was trained with CAME instead of Adam, so its a really good optim