Missing `flexgen.py` in `baseline` Folder

[xpq-tech]

Hi, great work on this project!

I noticed that the flexgen.py file appears to be missing from the baseline folder. I also couldn’t find this file in the FlexLLMGen project repository. It would be very helpful if you could provide it or let us know how to obtain it.

Thank you very much!

[eraser333]

flexgen.py is an adaptation of the Mixtral model based on the FlexLLMGen repository. We will open source this code after we have finished organizing it.

[xpq-tech]

Thank you for your response. I have one more question: SpecOffload includes two key components — Adaptive Tensor Placement and ParaSpec Planner. I found the implementation of the former in your codebase, but I couldn’t locate the latter. Could you provide some hints or guidance on where to find the implementation of ParaSpec Planner? I would greatly appreciate it.

[eraser333]

The planner is a separate .py implemented with z3 solver, which we'll upload when we organize it.