Skip to content

[codex] Add cactus CQ packaging workflow - #1

Draft
kar-m wants to merge 1 commit into
mainfrom
codex/cactus-cq-packaging
Draft

[codex] Add cactus CQ packaging workflow#1
kar-m wants to merge 1 commit into
mainfrom
codex/cactus-cq-packaging

Conversation

@kar-m

@kar-m kar-m commented May 11, 2026

Copy link
Copy Markdown
Collaborator

Summary

Adds the cleaned cactus CQ packaging workflow:

  • pack native TQH-GPTQ/CQ artifacts into cactus mmap .weights packages
  • emit token embeddings as orthogonal CQ4 during packaging
  • add production presets for A4V4L1 and A4V4L2
  • document an audio-only quantization recipe using the sanitized fixed AV quantizer

Validation

  • python -m py_compile on the changed/new export scripts
  • local package validation confirmed CQ4 token embedding headers for Qwen3-VL, LFM-VL, and LFM-350M packages

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant