Skip to content

[zephyr] zephyr twister test report for easy comparison - #556

Open
pranav4330 wants to merge 1 commit into
qualcomm:qualcomm-softwarefrom
pranav4330:pr/zephyr-reports
Open

[zephyr] zephyr twister test report for easy comparison#556
pranav4330 wants to merge 1 commit into
qualcomm:qualcomm-softwarefrom
pranav4330:pr/zephyr-reports

Conversation

@pranav4330

@pranav4330 pranav4330 commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Updated zephyr-twister-tests.yml to compare the previous and latest test runs and generate a consolidated report for easier analysis.
Added generate_twister_report.py to generate a detailed Excel (.xlsx) report.

Signed-off-by: Pranav Patil pranpati@qti.qualcomm.com

made changes to zephyr-twister-tests.yml to compare the previous run and latest run
and generate a latest report for easy comparison

added generate_twister_report.py this script will genrate a detailed .xlxs report

Signed-off-by: Pranav Patil <pranpati@qti.qualcomm.com>
@apazos

Copy link
Copy Markdown
Contributor

Please follow English grammar when writing PR description which will become the commit message of the merged PR. You can use co-pilot for that.

Suggestions:
Updated zephyr-twister-tests.yml to compare the previous and latest test runs and generate a consolidated report for easier analysis.
Added generate_twister_report.py to generate a detailed Excel (.xlsx) report.

If the code generated with the help of AI tooling, you need to add a statement following LLVM code standards: Assisted-by: commit trailer or a brief note in the PR description. And make sure you understand all that the code is doing.

@jonathonpenix

Copy link
Copy Markdown
Contributor

A few high level comments (in addition to Ana's), I'll try to take a closer look at this later in the week:

  • Zephyr tests should be running again (successfully finding a toolchain)--please update your branch so we can see this running/look at what the generated sheet looks like.
  • I don't know if others have strong preferences, but, just skimming this, the vast majority of this PR seems to be dealing with creating the spreedsheet itself rather than doing any processing of the xml files. Do we actually need this as a spreadsheet/does this format buy us anything for having to maintain it?

    If we can dramatically simplify things by reducing what we're outputting (even just dumping to a text file) it seems like that might be worthwhile

    Two thoughts along these lines:
    • Information about what is passing doesn't seem useful to me, my expectation is that people would mostly want to look at what is failing, which is/should be a relatively small number of things.
    • Right now, Zephyr tests are a bit messy but in theory they should be getting cleaner over time. As that happens, it seems like very simple summary information might be more helpful than a more elaborate setup. See ex: Zephyr's test summaries.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants