Integrate HarmoniCa into Pruna AI

[sharpenb]

Hi @XHPlus @Harahan 🤗

I'm Bertrand from Pruna AI. I came across "HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration" and was really impressed by your work! I believe it would be a great fit for the AI efficiency community, and I wanted to reach out to see if you'd be open to collaborating with us :)

We’ve developed the open-source pruna package, which makes it easier for researchers and engineers to combine various compression methods in their work. Integrating your research could significantly enhance the package’s utility, enabling others to take advantage of your findings seamlessly.

Here’s what we’re hoping to do:

• Integrate your research: We’d love to bring your methods into pruna to make them easily accessible to the community.

• Showcase your work: This will allow others to find your research through our project, and you can also link to any models or datasets that are relevant.

• Enhance visibility: Your research will be visible to a broader community of AI engineers and researchers. We can especially include it in AI efficiency materials, courses, tutorials, and blogs :)

If you're open to this, here are the detailed contributions guidelines with steps to integrate a new algorithm, dataset, or metric. The end goal would be that anyone can compress and evaluate their model with your research with:

Apply Compression Algorithm to ML Models

model = ...

smash_config = SmashConfig()
smash_config["algo_group_1"] = "algo_1"
smash_config["algo_group_2"] = "algo_2"
smashed_model = smash(model=model, smash_config=smash_config)

Evaluate ML Models

metrics = ["latency", "disk_memory", "energy_consumed", ...]
datamodule = PrunaDataModule(datasets=["dataset1", "dataset2"], collate_fn="image_generation_collate")

task = Task(metrics, datamodule=datamodule)
eval_agent = EvaluationAgent(task)
model_results = eval_agent.evaluate(smashed_model)

Let me know if you're interested/need any help regarding this!

Have a great day,
Bertrand - Cofounder, President, Chief Scientist @ Pruna AI
Twitter|LinkedIn|Scholar|Website