Testsuite failures

[Simon Peyton Jones]

Ben
I'm getting these unexpected failures on my Linux box (64 bit)

Unexpected failures:

   /tmp/ghctest-g01j3x6z/test   spaces/./cabal/ghcpkg05.run   ghcpkg05 [bad stderr] (normal)



Unexpected stat failures:

   /tmp/ghctest-g01j3x6z/test   spaces/./perf/compiler/T5837.run    T5837 [stat too good] (normal)

   /tmp/ghctest-g01j3x6z/test   spaces/./perf/compiler/T5321FD.run  T5321FD [stat too good] (normal)
I would LOVE it if the testsuite framework didn't print those long prefix paths!  I'd prefer

Unexpected failures:

   cabal/ghcpkg05.run   ghcpkg05 [bad stderr] (normal)



Unexpected stat failures:

   perf/compiler/T5837.run    T5837 [stat too good] (normal)

   perf/compiler/T5321FD.run  T5321FD [stat too good] (normal)
The stat failures look like this:

=====> T5321FD(normal) 1 of 1 [0, 0, 0]

cd "./T5321FD.run" &&  "/5playpen/simonpj/HEAD-1/inplace/test   spaces/ghc-stage2" -c T5321FD.hs -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -dno-debug-output   +RTS -V0 -tT5321FD.comp.stats --machine-readable -RTS

bytes allocated value is too low:

(If this is because you have improved GHC, please

update the test so that GHC doesn't regress again)

    Expected    T5321FD(normal) bytes allocated: 415136648 +/-10%

    Lower bound T5321FD(normal) bytes allocated: 373622983

    Upper bound T5321FD(normal) bytes allocated: 456650313

    Actual      T5321FD(normal) bytes allocated: 373272448

    Deviation   T5321FD(normal) bytes allocated:     -10.1 %

*** unexpected stat test failure for T5321FD(normal)



=====> T5837(normal) 1 of 1 [0, 0, 0]

cd "./T5837.run" &&  "/5playpen/simonpj/HEAD-1/inplace/test   spaces/ghc-stage2" -c T5837.hs -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -dno-debug-output  -freduction-depth=50 +RTS -V0 -tT5837.comp.stats --machine-readable -RTS

bytes allocated value is too low:

(If this is because you have improved GHC, please

update the test so that GHC doesn't regress again)

    Expected    T5837(normal) bytes allocated: 55813608 +/-7%

    Lower bound T5837(normal) bytes allocated: 51906655

    Upper bound T5837(normal) bytes allocated: 59720561

    Actual      T5837(normal) bytes allocated: 51558808

    Deviation   T5837(normal) bytes allocated:     -7.6 %

*** unexpected stat test failure for T5837(normal)
In both cases, just a bit past the threshold.  What is odd is that the latter doesn't fail on our CI system (I asked you this before).  The former is new, maybe to do with Richard's recent patches.
Question: are the numbers 'centred' for the CI infrastructure.  Maybe they are just under 10% and 7% resp, and something local pushes them a tiny bit lower?

The ghcpkg05 failure is quite consistent, despite from-clean rebuild.

=====> ghcpkg05(normal) 1 of 1 [0, 0, 0]

cd "./ghcpkg05.run" && $MAKE -s --no-print-directory ghcpkg05

Actual stderr output differs from expected:

diff -uw "./ghcpkg05.run/ghcpkg05.stderr.normalised" "./ghcpkg05.run/ghcpkg05.run.stderr.normalised"

--- ./ghcpkg05.run/ghcpkg05.stderr.normalised  2018-04-02 11:52:51.407023104 +0100

+++ ./ghcpkg05.run/ghcpkg05.run.stderr.normalised    2018-04-02 11:52:51.407023104 +0100

@@ -10,6 +10,13 @@

   cannot find any of ["C/D.hi","C/D.p_hi","C/D.dyn_hi"]

   cannot find any of ["C/E.hi","C/E.p_hi","C/E.dyn_hi"]

   cannot find any of ["libtestpkg-2.0-XXX.a","libtestpkg-2.0-XXX.p_a","libtestpkg-2.0-XXX-ghc<VERSION>.so","libtestpkg-2.0-XXX-ghc<VERSION>.dylib","testpkg-2.0-XXX-ghc<VERSION>.dll"] on library path

+Warning: include-dirs: /5playpen/simonpj/HEAD-1/compiler/stage2/build/utils doesn't exist or isn't a directory

+Warning: include-dirs: /5playpen/simonpj/HEAD-1/compiler/stage2/build/../rts/dist/build doesn't exist or isn't a directory

+Warning: include-dirs: /5playpen/simonpj/HEAD-1/compiler/stage2/build/stage2 doesn't exist or isn't a directory

+Warning: include-dirs: /5playpen/simonpj/HEAD-1/libraries/haskeline/dist-install/build/includes doesn't exist or isn't a directory

+Warning: include-dirs: /5playpen/simonpj/HEAD-1/libraries/text/dist-install/build/include doesn't exist or isn't a directory

+Warning: include-dirs: /5playpen/simonpj/HEAD-1/libraries/containers/dist-install/build/include doesn't exist or isn't a directory

+Warning: include-dirs: /5playpen/simonpj/HEAD-1/libraries/bytestring/dist-install/build/include doesn't exist or isn't a directory

 The following packages are broken, either because they have a problem

listed above, or because they depend on a broken package.

*** unexpected failure for ghcpkg05(normal)

Any ideas?
Thanks
SImon
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/ghc-devs/attachments/20180402/6d8597eb/attachment.html>