Skip to content

Enable llama3_1-8b reference to run on CPU - #2407

Closed
cfRod wants to merge 1 commit into
mlcommons:masterfrom
cfRod:update_llama3_18b
Closed

cfRod wants to merge 1 commit into
mlcommons:masterfrom
cfRod:update_llama3_18b

Conversation

@cfRod

@cfRod cfRod commented Dec 8, 2025

Copy link
Copy Markdown
Contributor

Also updates vllm to 0.11.0

@cfRod
cfRod requested a review from a team as a code owner December 8, 2025 13:11
@github-actions

github-actions Bot commented Dec 8, 2025 •

Copy link
Copy Markdown
Contributor

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@cfRod

cfRod commented Dec 9, 2025

Copy link
Copy Markdown
Contributor Author

@pgmpablo157321

Also updates vllm to 0.11.0

Signed-off-by: Crefeda Rodrigues <crefeda.rodrigues@arm.com>
@hanyunfan

Copy link
Copy Markdown
Contributor

We discussed this in our regular workgroup meeting, and @mrmhodak will provide comments here.

@cfRod

cfRod commented Feb 10, 2026

Copy link
Copy Markdown
Contributor Author

Happy to close this as discussed. I can separate out the CPU enablement change from the package upgrade.

@cfRod cfRod closed this Feb 10, 2026
@github-actions github-actions Bot locked and limited conversation to collaborators Feb 10, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants