Run Summary doesn't match Test Results - Mocha Multi Reporter

[midleman]

What am I missing here? There clearly are 2 failures, yet at the summary level it says 0. The slack notification even states there are 2 errors.

[ASaiAnudeep]

Hello @midleman , can you please share us the config and results file used to generate the report.

[midleman]

The results would have a completely different format for xunit reports

I'm not sure I understand... are you saying that the output from this reporter is not standard Xunit?

Can use mocha-junit-reporter to generate the JUnit report

Sadly, I cannot. It does not support parallel execution. michaelleeallen/mocha-junit-reporter#140

[ASaiAnudeep]

are you saying that the output from this reporter is not standard Xunit?

Could you please specify the exact package you’re using to generate the report? Additionally, do you have any custom logic that alters the generated result file?

[midleman]

Yep, this is the pkg: https://www.npmjs.com/package/mocha-xunit-reporter
I'm sorry, I was incorrect, we are actually using: mocha-multi
I am not modifying the xunit XML generated, however, I do have custom logic to go from xunit -> junit, but if that step wasn't necessary that would be ideal. I'd be open to other report generators as well as long as it supports parallel runs.

[ASaiAnudeep]

I remember that the mocha-multi reporter generates a JUnit-style report. For now, could you update the error count to zero and move the actual error count to the failures in your custom logic?

Actual
<testsuite name="Mocha Tests" tests="38" failures="0" errors="2" skipped="4" timestamp="x" time="261.029">

Expected
<testsuite name="Mocha Tests" tests="38" failures="2" errors="0" skipped="4" timestamp="x" time="261.029">

Also, I've noticed that the mocha-multi reporter was last published two years ago, and I'm unsure if the maintainer is accepting new PRs.

[midleman]

I didn't see support for junit in mocha-multi but I'll double check. I do know that mocha-multi-reporters (I know, very similar names) does support junit, but I was unable to get it to work with parallel execution. But yes, to your point, I can update my custom logic to move the error count over to the failure count at the very least. Thank you for all your timely responses, much appreciated!