CI: add QAIC Eager mode CI for v0.28 - #110
Draft
Loay Rashid (loayrash) wants to merge 21 commits into
Draft
Loay Rashid (loayrash) wants to merge 21 commits into
Loay Rashid (loayrash) wants to merge 21 commits into
Conversation
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Signed-off-by: Sanidhya Singal <sanising@qti.qualcomm.com>
Loay Rashid (loayrash)
marked this pull request as draft
September 2, 2026 17:27
Signed-off-by: Loay Rashid <loayrash@qti.qualcomm.com>
Signed-off-by: Loay Rashid <loayrash@qti.qualcomm.com>
Add a dedicated PyTorch eager fasttest path and make shared E2E tests select configuration appropriate to the active QAIC inference mode. - Add a PyTorch eager fasttest script and --mode aot|pyt|all pipeline selection to install the requested mode, collect eligible E2E jobs, select QIDs, build source-tree QAIC kernels, and dispatch jobs through the scheduler. - Add an opt-in --set-qaic-visible-devices scheduler flag that copies the parent environment and sets QAIC_VISIBLE_DEVICES to each job's assigned physical QIDs before its pytest subprocess starts. - Ensure local QAIC ordinals resolve within the job's assigned device group, preventing torch_qaic's early device-map initialization from binding eager workers to physical QID 0. - Extend qaic_test_config to support mode-specific AOT and eager settings, so eager tests do not inherit AOT quantization and KV-cache configuration. - Allow test launchers and benchmark commands to omit --quantization when eager mode does not require one. - Update E2E, API, benchmark, sampler, output-consistency, and LoRA tests with mode-specific configurations; exclude test_qaic_lora.py from the initial PyTorch fasttest. - Keep dual-QPC multimodal coverage AoT-only because independent runners in one process still need separate local-ordinal binding work. - Document mode-specific marker usage and ignore the generated ShareGPT test dataset file. Signed-off-by: Loay Rashid <loayrash@qti.qualcomm.com>
Skip the Whisper OpenAI multimodal test in eager mode, where hybrid KV-cache handling is unsupported. Signed-off-by: Loay Rashid <loayrash@qti.qualcomm.com>
Assign 8080 + job_id in the scheduler when a job does not explicitly provide --port, preventing parallel API-server jobs from racing for 8080. Signed-off-by: Loay Rashid <loayrash@qti.qualcomm.com>
Signed-off-by: Loay Rashid <loayrash@qti.qualcomm.com>
Stop deriving ports from scheduler job IDs. CI leaves --port unset by default so the e2e fixture selects an ephemeral port at test runtime, while preserving explicit caller-supplied ports for manual runs. Signed-off-by: Loay Rashid <loayrash@qti.qualcomm.com>
Loay Rashid (loayrash)
force-pushed
the
eager-ci-rebased-v028
branch
from
September 2, 2026 17:43
db6a566 to
24e329e
Compare
Loay Rashid (loayrash)
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds the QAIC eager CI. After #98 and #104, all the tests pass as-is.
Merge in this order: #98 -> #104 -> #110. This PR is stacked directly on #104 and #98. After both merge, this PR reduces to the CI-only changes.