[GHC] #15736: Testsuite failures from validate --slow

GHC ghc-devs at haskell.org
Mon Nov 5 21:24:41 UTC 2018


#15736: Testsuite failures from validate --slow
-------------------------------------+-------------------------------------
        Reporter:  jrp               |                Owner:  (none)
            Type:  bug               |               Status:  new
        Priority:  normal            |            Milestone:
       Component:  Test Suite        |              Version:  8.6.1
      Resolution:                    |             Keywords:
Operating System:  Linux             |         Architecture:  x86_64
                                     |  (amd64)
 Type of failure:  Incorrect result  |            Test Case:
  at runtime                         |  EtaExpandLevPoly T14936 T15349
                                     |  T2783 T4334 T7919 haddock.Cabal
                                     |  haddock.base haddock.compiler
                                     |  hpc_fork plugin-recomp-change
                                     |  plugin-recomp-change-prof recomp007
                                     |  space_leak_001
      Blocked By:                    |             Blocking:
 Related Tickets:                    |  Differential Rev(s):
       Wiki Page:                    |
-------------------------------------+-------------------------------------

Comment (by jrp):

 I've applied the  Phab:D5298 patch, and now get a bit further.  The tests
 below fail on `validate -slow` but most of them run OK if I just `make
 TEST="..."`  I'll leave the full trace of the latter below:

 {{{
 ====> T15859(normal) 1 of 27 [0, 0, 0]
 cd "dependent/should_fail/T15859.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -c T15859.hs
 -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-
 specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-
 diagnostics-show-caret -Werror=compat -dno-debug-output
 Actual stderr output differs from expected:
 diff -uw "dependent/should_fail/T15859.run/T15859.stderr.normalised"
 "dependent/should_fail/T15859.run/T15859.comp.stderr.normalised"
 --- dependent/should_fail/T15859.run/T15859.stderr.normalised   2018-11-05
 21:16:05.108636964 +0000
 +++ dependent/should_fail/T15859.run/T15859.comp.stderr.normalised
 2018-11-05 21:16:05.108636964 +0000
 @@ -1,6 +1 @@
 -
 -T15859.hs:13:5:
 -     Cannot apply expression of type ‘forall k -> k -> *’
 -      to a visible type argument ‘Int’
 -     In the expression: (undefined :: KindOf A) @Int
 -      In an equation for ‘a’: a = (undefined :: KindOf A) @Int
 +<command line>: does not exist: T15859.hs
 *** unexpected failure for T15859(normal)
 =====> PrimFFIInt8(normal) 2 of 27 [0, 1, 0]
 cd "ffi/should_run/PrimFFIInt8.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o PrimFFIInt8
 PrimFFIInt8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-
 warn-missed-specialisations -fshow-warning-groups -fdiagnostics-
 color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output
 PrimFFIInt8_c.c
 cd "ffi/should_run/PrimFFIInt8.run" && ./PrimFFIInt8
 =====> PrimFFIWord8(normal) 3 of 27 [0, 1, 0]
 cd "ffi/should_run/PrimFFIWord8.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o PrimFFIWord8
 PrimFFIWord8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-
 warn-missed-specialisations -fshow-warning-groups -fdiagnostics-
 color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output
 PrimFFIWord8_c.c
 cd "ffi/should_run/PrimFFIWord8.run" && ./PrimFFIWord8
 =====> T12707(normal) 4 of 27 [0, 1, 0]
 cd "perf/compiler/T12707.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" -c T12707.hs -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output   +RTS -V0
 -tT12707.comp.stats --machine-readable -RTS
 =====> T13379(normal) 5 of 27 [0, 1, 0]
 cd "perf/compiler/T13379.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" -c T13379.hs -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output   +RTS -V0
 -tT13379.comp.stats --machine-readable -RTS
 =====> MultiLayerModules(normal) 6 of 27 [0, 1, 0]
 cd "perf/compiler/MultiLayerModules.run" && ./genMultiLayerModules
 cd "perf/compiler/MultiLayerModules.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" --make
 MultiLayerModules -no-user-package-db -rtsopts -fno-warn-missed-
 specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-
 diagnostics-show-caret -Werror=compat -dno-debug-output  -v0 +RTS -V0
 -tMultiLayerModules.comp.stats --machine-readable -RTS
 =====> ManyConstructors(normal) 7 of 27 [0, 1, 0]
 cd "perf/compiler/ManyConstructors.run" && ./genManyConstructors
 cd "perf/compiler/ManyConstructors.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" --make
 ManyConstructors -no-user-package-db -rtsopts -fno-warn-missed-
 specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-
 diagnostics-show-caret -Werror=compat -dno-debug-output  -v0 +RTS -V0
 -tManyConstructors.comp.stats --machine-readable -RTS
 =====> ManyAlternatives(normal) 8 of 27 [0, 1, 0]
 cd "perf/compiler/ManyAlternatives.run" && ./genManyAlternatives
 cd "perf/compiler/ManyAlternatives.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" --make
 ManyAlternatives -no-user-package-db -rtsopts -fno-warn-missed-
 specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-
 diagnostics-show-caret -Werror=compat -dno-debug-output  -v0 +RTS -V0
 -tManyAlternatives.comp.stats --machine-readable -RTS
 =====> T13701(normal) 9 of 27 [0, 1, 0]
 cd "perf/compiler/T13701.run" && ./genT13701
 cd "perf/compiler/T13701.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" --make  T13701 -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output  -v0 +RTS -V0
 -tT13701.comp.stats --machine-readable -RTS
 =====> T13719(normal) 10 of 27 [0, 1, 0]
 cd "perf/compiler/T13719.run" && ./genT13719
 cd "perf/compiler/T13719.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" --make  T13719 -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output  -v0 +RTS -V0
 -tT13719.comp.stats --machine-readable -RTS
 =====> T14697(normal) 11 of 27 [0, 1, 0]
 cd "perf/compiler/T14697.run" && ./genT14697
 cd "perf/compiler/T14697.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" --make  T14697 -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output $(cat
 T14697-flags) -v0 +RTS -V0 -tT14697.comp.stats --machine-readable -RTS
 =====> T14683(normal) 12 of 27 [0, 1, 0]
 cd "perf/compiler/T14683.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" --make  T14683 -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output  -v0 +RTS -V0
 -tT14683.comp.stats --machine-readable -RTS
 =====> T9630(normal) 13 of 27 [0, 1, 0]
 cd "perf/compiler/T9630.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" --make  T9630 -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output  -v0 -O +RTS
 -V0 -tT9630.comp.stats --machine-readable -RTS
 =====> T15164(normal) 14 of 27 [0, 1, 0]
 cd "perf/compiler/T15164.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" -c T15164.hs -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output  -v0 -O +RTS
 -V0 -tT15164.comp.stats --machine-readable -RTS
 =====> T14936(normal) 15 of 27 [0, 1, 0]
 cd "perf/should_run/T14936.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" -o T14936 T14936.hs -dcore-lint -dcmm-lint -no-user-
 package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups
 -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-
 debug-output  -O2
 cd "perf/should_run/T14936.run" && ./T14936 +RTS -V0 -tT14936.stats
 --machine-readable -RTS
 =====> space_leak_001(normal) 16 of 27 [0, 1, 0]
 cd "perf/space_leaks/space_leak_001.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o
 space_leak_001 space_leak_001.hs -dcore-lint -dcmm-lint -no-user-package-
 db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups
 -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-
 debug-output
 cd "perf/space_leaks/space_leak_001.run" && ./space_leak_001 +RTS -V0
 -tspace_leak_001.stats --machine-readable -RTS
 =====> T4334(normal) 17 of 27 [0, 1, 0]
 cd "perf/space_leaks/T4334.run" &&  "/home/jrp/Projects/ghc/inplace/test
 spaces/ghc-stage2" -o T4334 T4334.hs -dcore-lint -dcmm-lint -no-user-
 package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups
 -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-
 debug-output
 cd "perf/space_leaks/T4334.run" && ./T4334 +RTS -V0 -tT4334.stats
 --machine-readable -RTS  1000000 2 t
 =====> ArithInt8(normal) 18 of 27 [0, 1, 0]
 cd "primops/should_run/ArithInt8.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o ArithInt8
 ArithInt8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-
 warn-missed-specialisations -fshow-warning-groups -fdiagnostics-
 color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output
 cd "primops/should_run/ArithInt8.run" && ./ArithInt8
 =====> ArithWord8(normal) 19 of 27 [0, 1, 0]
 cd "primops/should_run/ArithWord8.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o ArithWord8
 ArithWord8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-
 warn-missed-specialisations -fshow-warning-groups -fdiagnostics-
 color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output
 cd "primops/should_run/ArithWord8.run" && ./ArithWord8
 =====> CmpInt8(normal) 20 of 27 [0, 1, 0]
 cd "primops/should_run/CmpInt8.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o CmpInt8
 CmpInt8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output
 cd "primops/should_run/CmpInt8.run" && ./CmpInt8
 =====> CmpWord8(normal) 21 of 27 [0, 1, 0]
 cd "primops/should_run/CmpWord8.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o CmpWord8
 CmpWord8.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output
 cd "primops/should_run/CmpWord8.run" && ./CmpWord8
 =====> ShowPrim(normal) 22 of 27 [0, 1, 0]
 cd "primops/should_run/ShowPrim.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o ShowPrim
 ShowPrim.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output
 cd "primops/should_run/ShowPrim.run" && ./ShowPrim
 =====> T2783(normal) 23 of 27 [0, 1, 0]
 cd "rts/T2783.run" &&  "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-
 stage2" -o T2783 T2783.hs -dcore-lint -dcmm-lint -no-user-package-db
 -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups
 -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-
 debug-output
 cd "rts/T2783.run" && ./T2783
 =====> T7919(normal) 24 of 27 [0, 1, 0]
 cd "rts/T7919.run" &&  "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-
 stage2" -o T7919 T7919.hs -dcore-lint -dcmm-lint -no-user-package-db
 -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups
 -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-
 debug-output  -dynamic
 cd "rts/T7919.run" && ./T7919
 =====> T14761c(normal) 25 of 27 [0, 1, 0]
 cd "typecheck/should_compile/T14761c.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -c T14761c.hs
 -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-
 specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-
 diagnostics-show-caret -Werror=compat -dno-debug-output -fno-warn-
 incomplete-patterns
 =====> user001(normal) 26 of 27 [0, 1, 0]
 cd "libraries/unix/tests/user001.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o user001
 user001.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output  -package
 unix
 cd "libraries/unix/tests/user001.run" && ./user001
 Actual stdout output differs from expected:
 diff -uw "libraries/unix/tests/user001.run/user001.stdout.normalised"
 "libraries/unix/tests/user001.run/user001.run.stdout.normalised"
 --- libraries/unix/tests/user001.run/user001.stdout.normalised  2018-11-05
 21:18:01.037442648 +0000
 +++ libraries/unix/tests/user001.run/user001.run.stdout.normalised
 2018-11-05 21:18:01.037442648 +0000
 @@ -6,6 +6,6 @@
  getEffectiveUserName: OK
  getGroupEntryForID: OK
  getGroupEntryForName: OK
 -getAllGroupEntries: OK
 +getAllGroupEntries: ERROR: getAllGroupEntries: does not exist (No such
 file or directory)
  getUserEntryForID: OK
 -getAllUserEntries: OK
 +getAllUserEntries: ERROR: getAllUserEntries: does not exist (No such file
 or directory)
 *** unexpected failure for user001(normal)
 =====> T3816(normal) 27 of 27 [0, 2, 0]
 cd "libraries/unix/tests/T3816.run" &&
 "/home/jrp/Projects/ghc/inplace/test   spaces/ghc-stage2" -o T3816
 T3816.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-
 missed-specialisations -fshow-warning-groups -fdiagnostics-color=never
 -fno-diagnostics-show-caret -Werror=compat -dno-debug-output  -package
 unix
 cd "libraries/unix/tests/T3816.run" && ./T3816
 Wrong exit code for T3816(normal)(expected 0 , actual 1 )
 Stderr ( T3816 ):
 T3816: getAllGroupEntries: does not exist (No such file or directory)
 *** unexpected failure for T3816(normal)

 Unexpected results from:
 TEST="T15859 T3816 user001"

 SUMMARY for test run started at Mon Nov  5 21:16:04 2018 GMT
  0:01:58 spent to go through
       27 total tests, which gave rise to
      161 test cases, of which
      134 were skipped

        0 had missing libraries
       24 expected passes
        0 expected failures

        0 caused framework failures
        0 caused framework warnings
        0 unexpected passes
        3 unexpected failures
        0 unexpected stat failures

 Unexpected failures:
    dependent/should_fail/T15859.run  T15859 [stderr mismatch] (normal)
    libraries/unix/tests/user001.run  user001 [bad stdout] (normal)
    libraries/unix/tests/T3816.run    T3816 [bad exit code] (normal)

 make[1]: *** [../mk/test.mk:330: test] Error 1
 make[1]: Leaving directory '/home/jrp/Projects/ghc/testsuite/tests'
 make: *** [Makefile:224: test] Error 2
 }}}

-- 
Ticket URL: <http://ghc.haskell.org/trac/ghc/ticket/15736#comment:10>
GHC <http://www.haskell.org/ghc/>
The Glasgow Haskell Compiler


More information about the ghc-tickets mailing list