./validate --slow results
Simon Peyton Jones
simonpj at microsoft.com
Thu Sep 14 13:19:30 UTC 2017
Wow... 97 unexpected failures is bad.
Ben/David/someone else: might you investigate/characterise them?
Simon
| -----Original Message-----
| From: ghc-devs [mailto:ghc-devs-bounces at haskell.org] On Behalf Of Bartosz
| Nitka
| Sent: 14 September 2017 13:57
| To: ghc-devs Devs <ghc-devs at haskell.org>
| Subject: ./validate --slow results
|
| Hi all,
|
| I happened to run ./validate --slow on my linux machine and I thought it
| would be useful to share the results.
|
| Results:
|
| Unexpected results from:
| TEST="EtaExpandLevPoly PatternSplice StrictPats T10508_api T11627b
| T12809 T12870a T12870b T12870c T12870d T12870e T12870f T12870g T12870h
| T12903 T12962 T13366 T13543 T13688 T13780c T13822 T13949 T14137 T2552
| T2783 T3001-2 T4114c T4114d T4188 T4334 T5129 T5363 T5559 T5611 T680
| T7411 T7837 T7944 T8025 T8089 T8542 TH_spliceE5_prof_ext UnsafeReenter
| compact_gc compact_share dsrun014 dynamic-paper haddock.Cabal hpc_fork prof-
| doc-fib prof-doc-last profinline001 read029 return_mem_to_os
| rn041 scc001 scc002 scc003 scc005 space_leak_001 tc165 tryReadMVar2"
|
| SUMMARY for test run started at Thu Sep 14 04:57:20 2017 PDT
| 0:12:27 spent to go through
| 6091 total tests, which gave rise to
| 24105 test cases, of which
| 4531 were skipped
|
| 143 had missing libraries
| 19120 expected passes
| 203 expected failures
|
| 0 caused framework failures
| 0 caused framework warnings
| 6 unexpected passes
| 97 unexpected failures
| 5 unexpected stat failures
|
| Unexpected passes:
| /tmp/ghctest-e17wqi8b/test
| spaces/./dependent/should_compile/dynamic-paper.run dynamic-paper
| [unexpected] (optasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./indexed-types/should_compile/T7837.run T7837
| [unexpected] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./parser/should_compile/read029.run read029
| [unexpected] (optasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./rename/should_compile/rn041.run rn041
| [unexpected] (optasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./simplCore/should_fail/T7411.run T7411
| [unexpected] (hpc)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_compile/tc165.run tc165
| [unexpected] (optasm)
|
| Unexpected failures:
| /tmp/ghctest-e17wqi8b/test spaces/./codeGen/should_run/T5129.run
| T5129 [bad exit code] (hpc)
| /tmp/ghctest-e17wqi8b/test spaces/./codeGen/should_run/T5129.run
| T5129 [bad exit code] (optasm)
| /tmp/ghctest-e17wqi8b/test spaces/./codeGen/should_run/T5129.run
| T5129 [bad exit code] (threaded2)
| /tmp/ghctest-e17wqi8b/test spaces/./codeGen/should_run/T5129.run
| T5129 [bad exit code] (dyn)
| /tmp/ghctest-e17wqi8b/test
| spaces/./concurrent/should_run/T5611.run T5611 [bad
| stdout] (ghci)
| /tmp/ghctest-e17wqi8b/test
| spaces/./concurrent/should_run/tryReadMVar2.run
| tryReadMVar2 [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./deSugar/should_run/dsrun014.run dsrun014
| [bad stderr] (hpc)
| /tmp/ghctest-e17wqi8b/test
| spaces/./deSugar/should_run/dsrun014.run dsrun014
| [bad stderr] (optasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./deSugar/should_run/dsrun014.run dsrun014
| [bad stderr] (threaded2)
| /tmp/ghctest-e17wqi8b/test
| spaces/./deSugar/should_run/dsrun014.run dsrun014
| [bad stderr] (dyn)
| /tmp/ghctest-e17wqi8b/test
| spaces/./dependent/should_fail/T13780c.run T13780c
| [stderr mismatch] (normal)
| /tmp/ghctest-e17wqi8b/test
| spaces/./dependent/should_compile/dynamic-paper.run
| dynamic-paper [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./driver/T4114d.run
| T4114d [bad exit code] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./driver/T4114c.run
| T4114c [bad exit code] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./ghc-api/T10508_api.run
| T10508_api [bad exit code] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./numeric/should_compile/T8542.run T8542
| [stderr mismatch] (hpc)
| /tmp/ghctest-e17wqi8b/test spaces/./ghc-api/T10508_api.run
| T10508_api [bad exit code] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
| spaces/./partial-sigs/should_compile/PatternSplice.run
| PatternSplice [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./patsyn/should_run/T13688.run
| T13688 [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./patsyn/should_run/T13688.run
| T13688 [exit code non-0] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T3001-2.run T3001-2
| [exit code non-0] (prof_hb)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/scc003.run scc003
| [bad profile] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T11627b.run T11627b
| [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T12962.run T12962
| [bad profile] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/scc003.run scc003
| [bad profile] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T12962.run T12962
| [bad profile] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/scc003.run scc003
| [bad profile] (prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T12962.run T12962
| [bad profile] (prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/scc001.run scc001
| [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/scc005.run scc005
| [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/profinline001.run
| profinline001 [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T5559.run T5559 [bad
| exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T11627b.run T11627b
| [bad heap profile] (prof_hc_hb)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/scc003.run scc003
| [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test spaces/./profiling/should_run/T680.run
| T680 [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/scc002.run scc002
| [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T12962.run T12962
| [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/prof-doc-fib.run
| prof-doc-fib [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T11627b.run T11627b
| [bad heap profile] (prof_hb)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T2552.run T2552 [bad
| exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/prof-doc-last.run
| prof-doc-last [bad exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T11627b.run T11627b
| [bad heap profile] (prof_hd)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T5363.run T5363 [bad
| exit code] (ghci-ext-prof)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T11627b.run T11627b
| [bad heap profile] (prof_hy)
| /tmp/ghctest-e17wqi8b/test
| spaces/./profiling/should_run/T11627b.run T11627b
| [bad heap profile] (prof_hr)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/T2783.run
| T2783 [bad exit code] (threaded1)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/return_mem_to_os.run
| return_mem_to_os [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/T12903.run
| T12903 [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870a.run
| T12870a [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870f.run
| T12870f [bad stdout] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870b.run
| T12870b [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870c.run
| T12870c [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870e.run
| T12870e [bad stdout] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870d.run
| T12870d [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870b.run
| T12870b [bad exit code] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870f.run
| T12870f [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870c.run
| T12870c [bad exit code] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870e.run
| T12870e [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870g.run
| T12870g [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870h.run
| T12870h [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870h.run
| T12870h [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870f.run
| T12870f [bad stdout] (threaded2)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870e.run
| T12870e [bad stdout] (threaded2)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870f.run
| T12870f [bad stdout] (profthreaded)
| /tmp/ghctest-e17wqi8b/test spaces/./rts/flags/T12870e.run
| T12870e [bad stdout] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
| spaces/./simplCore/should_compile/T7944.run T7944
| [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./simplCore/should_compile/T13543.run T13543
| [stderr mismatch] (hpc)
| /tmp/ghctest-e17wqi8b/test
| spaces/./simplCore/should_compile/T13543.run T13543
| [stderr mismatch] (optasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./simplCore/should_compile/T13543.run T13543
| [stderr mismatch] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./simplCore/should_compile/T14137.run T14137
| [stderr mismatch] (profasm)
| /tmp/ghctest-e17wqi8b/test spaces/./th/TH_spliceE5_prof_ext.run
| TH_spliceE5_prof_ext [bad exit code] (normal)
| /tmp/ghctest-e17wqi8b/test spaces/./th/T4188.run
| T4188 [exit code non-0] (normal)
| /tmp/ghctest-e17wqi8b/test spaces/./th/T4188.run
| T4188 [exit code non-0] (ext-interp)
| /tmp/ghctest-e17wqi8b/test spaces/./th/T13366.run
| T13366 [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test
| spaces/./th/should_compile/T8025/T8025.run T8025
| [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./th/should_compile/T13949/T13949.run T13949
| [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_compile/T13822.run T13822
| [exit code non-0] (normal)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_compile/T13822.run T13822
| [exit code non-0] (hpc)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_compile/T13822.run T13822
| [exit code non-0] (optasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_compile/T13822.run T13822
| [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_run/EtaExpandLevPoly.run
| EtaExpandLevPoly [exit code non-0] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_run/EtaExpandLevPoly.run
| EtaExpandLevPoly [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_run/T12809.run T12809
| [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_run/StrictPats.run StrictPats
| [bad stderr] (ghci)
| /tmp/ghctest-e17wqi8b/test
| spaces/./typecheck/should_run/EtaExpandLevPoly.run
| EtaExpandLevPoly [exit code non-0] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/base/tests/T8089.run T8089 [bad
| exit code] (ghci)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/base/tests/T8089.run T8089 [bad
| exit code] (threaded1)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/base/tests/T8089.run T8089 [bad
| exit code] (threaded2)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/base/tests/T8089.run T8089 [bad
| exit code] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/hpc/tests/fork/hpc_fork.run hpc_fork
| [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/ghc-compact/tests/compact_share.run
| compact_share [bad stdout] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/ghc-compact/tests/compact_share.run
| compact_share [bad stdout] (ghci)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/ghc-compact/tests/compact_gc.run compact_gc
| [bad heap profile] (profasm)
| /tmp/ghctest-e17wqi8b/test
| spaces/../../libraries/ghc-compact/tests/compact_share.run
| compact_share [bad stdout] (profthreaded)
| /tmp/ghctest-e17wqi8b/test
| spaces/./ffi/should_fail/UnsafeReenter.run
| UnsafeReenter [bad exit code] (threaded1)
| /tmp/ghctest-e17wqi8b/test
| spaces/./ffi/should_fail/UnsafeReenter.run
| UnsafeReenter [bad exit code] (threaded2)
| /tmp/ghctest-e17wqi8b/test
| spaces/./ffi/should_fail/UnsafeReenter.run
| UnsafeReenter [bad exit code] (profthreaded)
|
| Unexpected stat failures:
| /tmp/ghctest-e17wqi8b/test
| spaces/./perf/haddock/haddock.Cabal.run haddock.Cabal [stat not
| good enough] (normal)
| /tmp/ghctest-e17wqi8b/test
| spaces/./perf/space_leaks/space_leak_001.run space_leak_001 [stat too good]
| (hpc)
| /tmp/ghctest-e17wqi8b/test
| spaces/./perf/space_leaks/space_leak_001.run space_leak_001 [stat too good]
| (optasm)
| /tmp/ghctest-e17wqi8b/test spaces/./perf/space_leaks/T4334.run
| T4334 [stat not good enough] (threaded2)
| /tmp/ghctest-e17wqi8b/test
| spaces/./perf/space_leaks/space_leak_001.run space_leak_001 [stat too good]
| (dyn)
|
|
|
| From my point of view, with this amount of failures it's difficult to tell
| if a new change introduces problems. Shall we mark them as broken and open
| tickets for follow ups?
|
| Cheers,
| Bartosz
| _______________________________________________
| ghc-devs mailing list
| ghc-devs at haskell.org
| https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail.haskell
| .org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fghc-
| devs&data=02%7C01%7Csimonpj%40microsoft.com%7C7101e74b491e414c118f08d4fb7051
| 72%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636409907213307133&sdata=Jfy
| 606rPp0S0wb7lwh5ttspRXSE7sB8KPkXPynCYGe4%3D&reserved=0
More information about the ghc-devs
mailing list