Tests fail under Cygwin Perl 5.14.2 #27
Description
I had tried installing this with cpanm first (as a dependency of something else...) which failed with several errors in the build.log:
...
# Failed test 'tee_merged|perl|both|multiline - tee STDOUT (STDOUT)'
# at t/lib/Cases.pm line 240.
# 'STDERR:First line
# Second line
# '
# doesn't match '(?^:STDOUT\:First\ line\
# Second\ line\
# )'
# Looks like you failed 1 test of 872.
t/07-stderr-closed.t .......
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/872 subtests
# Failed test 'tee_merged|perl|both|multiline - tee STDOUT (STDOUT)'
# at t/lib/Cases.pm line 240.
# 'STDERR:First line
# Second line
# '
# doesn't match '(?^:STDOUT\:First\ line\
# Second\ line\
# )'
# Looks like you failed 1 test of 872.
t/08-stdin-closed.t ........
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/872 subtests
t/09-preserve-exit-code.t .. ok
t/10-stdout-string.t ....... ok
t/11-stderr-string.t ....... ok
t/12-stdin-string.t ........ ok
# Failed test 'tee_merged|perl|both|short - tee STDOUT (STDERR)'
# at t/lib/Cases.pm line 241.
# 'STDOUT:Hello World'
# doesn't match '(?^:STDERR\:Hello\ World)'
# Looks like you failed 1 test of 873.
t/13-stdout-tied.t .........
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/873 subtests
t/14-stderr-tied.t ......... ok
t/15-stdin-tied.t .......... ok
t/16-catch-errors.t ........ ok
t/17-pass-results.t ........ ok
t/18-custom-capture.t ...... ok
t/19-inline-c.t ............ skipped: Inline::C module required
# Failed test 'tee_merged|perl|both|multiline - tee STDOUT (STDERR)'
# at t/lib/Cases.pm line 241.
# 'STDOUT:First line
# Second line
# '
# doesn't match '(?^:STDERR\:First\ line\
# Second\ line\
# )'
# Looks like you failed 1 test of 583.
t/20-stdout-badtie.t .......
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/583 subtests
t/21-stderr-badtie.t ....... ok
t/22-stdin-badtie.t ........ ok
t/23-all-tied.t ............ ok
t/24-all-badtied.t ......... ok
Test Summary Report
-------------------
t/07-stderr-closed.t (Wstat: 256 Tests: 872 Failed: 1)
Failed test: 759
Non-zero exit status: 1
t/08-stdin-closed.t (Wstat: 256 Tests: 872 Failed: 1)
Failed test: 759
Non-zero exit status: 1
t/13-stdout-tied.t (Wstat: 256 Tests: 873 Failed: 1)
Failed test: 755
Non-zero exit status: 1
t/20-stdout-badtie.t (Wstat: 256 Tests: 583 Failed: 1)
Failed test: 510
Non-zero exit status: 1
Files=23, Tests=11996, 144 wallclock secs ( 0.02 usr 0.03 sys + 50.93 cusr 92.69 csys = 143.67 CPU)
Result: FAIL
Failed 4/23 test programs. 4/11996 subtests failed.
Makefile:861: recipe for target `test_dynamic' failed
make: *** [test_dynamic] Error 255
I then retried with plain cpan as I hoped to submit a report about the failure using CPAN::Reporter but this didn't work neither (see cpan-testers/CPAN-Reporter#3), however
cpan output was actually different, with only a single error:
...
# Failed test 'tee_merged|perl|both|short - tee STDOUT (STDERR)'
# at t/lib/Cases.pm line 241.
# 'STDOUT:Hello World'
# doesn't match '(?^:STDERR\:Hello\ World)'
# Looks like you failed 1 test of 873.
t/10-stdout-string.t .......
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/873 subtests
t/11-stderr-string.t ....... ok
t/12-stdin-string.t ........ ok
t/13-stdout-tied.t ......... ok
t/14-stderr-tied.t ......... ok
t/15-stdin-tied.t .......... ok
t/16-catch-errors.t ........ ok
t/17-pass-results.t ........ ok
t/18-custom-capture.t ...... ok
t/19-inline-c.t ............ skipped: Inline::C module required
t/20-stdout-badtie.t ....... ok
t/21-stderr-badtie.t ....... ok
t/22-stdin-badtie.t ........ ok
t/23-all-tied.t ............ ok
t/24-all-badtied.t ......... ok
Test Summary Report
-------------------
t/10-stdout-string.t (Wstat: 256 Tests: 873 Failed: 1)
Failed test: 756
Non-zero exit status: 1
Files=23, Tests=11996, 146 wallclock secs ( 0.00 usr 0.02 sys + 47.47 cusr 94.92 csys = 142.41 CPU)
Result: FAIL
Failed 1/23 test programs. 1/11996 subtests failed.
Makefile:861: recipe for target `test_dynamic' failed
make: *** [test_dynamic] Error 255
I don't know why do the failures differ between cpanm and cpan but at least this is consistent, i.e. I reran each of them a couple of times and the results are always the same.