Windows test failures

Simon Peyton Jones simonpj at microsoft.com
Thu Dec 6 14:17:52 UTC 2018


Hi Tamar

Thanks for working on this.

if it's an msys2 shell, what does "locale" return?

It’s a shell running inside emacs.  Here’s what locale returns

/c/tmp$ locale

LANG=en_GB

LC_CTYPE="en_GB"

LC_NUMERIC="en_GB"

LC_TIME="en_GB"

LC_COLLATE="en_GB"

LC_MONETARY="en_GB"

LC_MESSAGES="en_GB"

LC_ALL=

Does that help at all?

I can try your “export LANG=en_GB.UTF-8” … shall I do that? Can I test its efficacy by running one test rather than 6,000 of them?  In which case, which one?

Thanks

Simon


From: Phyx <lonetiger at gmail.com>
Sent: 02 December 2018 20:43
To: Simon Peyton Jones <simonpj at microsoft.com>
Cc: ghc-devs at haskell.org Devs <ghc-devs at haskell.org>
Subject: Re: Windows test failures

Hi Simon,

That's a bit better (still need to figure out why the recent threading issues, but one problem at a time :) )

From that list T10672_x64 is one I'm looking at already, seems to have something to do with the libstdc++ destructors.
Plugins 09 and 10 are the other two I know about, but haven't had time to look at them yet. Frankly I know too little about plugins to make an accurate determination here, but the input files are empty
yet it expects output, so I don't know what it's supposed to do here.  If someone who knows more about plugins can chime in that would save some time.

The segfaulting plugin I haven't triaged yet. Now the remaining failures aside from T14452 that Roland is taking care of, seem to have to do with your locale in your console.  You seem to be running the
tests in a console that has latin-1 locale? So some unicode characters fail encoding/decoding.

If it's a Windows shell you can change it to utf-8 using "chcp 65001", if it's an msys2 shell, what does "locale" return?

For reference mine is

$ locale
LANG=en_GB.UTF-8
LC_CTYPE="en_GB.UTF-8"
LC_NUMERIC="en_GB.UTF-8"
LC_TIME="en_GB.UTF-8"
LC_COLLATE="en_GB.UTF-8"
LC_MONETARY="en_GB.UTF-8"
LC_MESSAGES="en_GB.UTF-8"
LC_ALL=

If it does say latin1 you can change it with

export LANG=en_GB.UTF-8

This should fix more of the tests.

The reason I don't mark the remaining tests as expect fail yet is because I haven't had the time to triage them, so I don't know their severity and
last time there were a few nasty issues hidden in them.

Unfortunately I won't have time to look at them till next weekend.

Thanks,
Tamar

On Fri, Nov 30, 2018 at 9:49 PM Simon Peyton Jones <simonpj at microsoft.com<mailto:simonpj at microsoft.com>> wrote:
At the end of the first test run it would have given a list of tests that failed and a line saying TEST=".... List of tests..."

Copy that line and at the root of the checkout do

make TEST=".... List of tests..."  test -C testsuite/tests

(that's uppercase C). This will run everything using one thread. :)

OK, done.  Results below.

Simon



/c/code/HEAD$ make TEST="T10420 T10672_x64 T13385 T14452 T15815 T3307 T3319 T4006 TH_scopedTvs environment001 plugin-recomp-change plugin-recomp-flags plugin-recomp-impure plugin-recomp-pure plugins07 plugins09 plugins10 plugins11 plugins13 plugins14 print017"  test -C testsuite/tests

make: Entering directory '/c/code/HEAD/testsuite/tests'

PYTHON="python3" "python3" ../driver/runtests.py  -e "ghc_compiler_always_flags='-dcore-lint -dcmm-lint -no-user-package-db -rtsopts  -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output'" -e config.compiler_debugged=False -e ghc_with_native_codegen=True -e config.have_vanilla=True -e config.have_dynamic=False -e config.have_profiling=False -e ghc_with_threaded_rts=True -e ghc_with_dynamic_rts=False -e config.have_interp=True -e config.unregisterised=False -e config.have_gdb=False -e config.have_readelf=True -e config.ghc_dynamic_by_default=False -e config.ghc_dynamic=False -e ghc_with_smp=True -e ghc_with_llvm=False -e windows=True -e darwin=False -e config.in_tree_compiler=True -e config.cleanup=True -e config.local=True --rootdir=. --config-file=../config/ghc -e 'config.platform="x86_64-unknown-mingw32"' -e 'config.os="mingw32"' -e 'config.arch="x86_64"' -e 'config.wordsize="64"' -e 'config.timeout=int() or config.timeout' -e 'config.exeext=".exe"' -e 'config.top="/c/code/HEAD/testsuite"' --config 'compiler="/c/code/HEAD/inplace/bin/ghc-stage2.exe"' --config 'ghc_pkg="/c/code/HEAD/inplace/bin/ghc-pkg.exe"' --config 'haddock=' --config 'hp2ps="/c/code/HEAD/inplace/bin/hp2ps.exe"' --config 'hpc="/c/code/HEAD/inplace/bin/hpc.exe"' --config 'gs="gs"' --config 'timeout_prog="../timeout/install-inplace/bin/timeout.exe"' -e "config.stage=2"   --rootdir=../../libraries/Win32/tests  --rootdir=../../libraries/array/tests  --rootdir=../../libraries/base/tests  --rootdir=../../libraries/binary/tests  --rootdir=../../libraries/bytestring/tests  --rootdir=../../libraries/containers/tests  --rootdir=../../libraries/deepseq/tests  --rootdir=../../libraries/directory/tests  --rootdir=../../libraries/filepath/tests  --rootdir=../../libraries/ghc-compact/tests  --rootdir=../../libraries/ghc-heap/tests  --rootdir=../../libraries/ghc-prim/tests  --rootdir=../../libraries/haskeline/tests  --rootdir=../../libraries/hpc/tests  --rootdir=../../libraries/pretty/tests  --rootdir=../../libraries/process/tests  --rootdir=../../libraries/stm/tests  --rootdir=../../libraries/template-haskell/tests  --rootdir=../../libraries/text/tests \

       --only=T10420  --only=T10672_x64  --only=T13385  --only=T14452  --only=T15815  --only=T3307  --only=T3319  --only=T4006  --only=TH_scopedTvs  --only=environment001  --only=plugin-recomp-change  --only=plugin-recomp-flags  --only=plugin-recomp-impure  --only=plugin-recomp-pure  --only=plugins07  --only=plugins09  --only=plugins10  --only=plugins11  --only=plugins13  --only=plugins14  --only=print017 \

       \

       \

       \

       \

       \



Timeout is 300

0

Found 398 .T files...

Beginning test run at Fri Nov 30 21:07:17 2018 GMTST

====> Scanning ./ado/all.T

====> Scanning ./annotations/should_compile/all.T

====> Scanning ./annotations/should_compile/T13818/all.T

…lots more “Scanning” lines…

====> Scanning ../../libraries/ghc-heap/tests/all.T

====> Scanning ../../libraries/hpc/tests/fork/test.T--- driver/T14452.run/T14452.stdout.normalised       2018-11-30 21:07:36.565566000 +0000

+++ driver/T14452.run/T14452.run.stdout.normalised       2018-11-30 21:07:36.567569500 +0000

@@ -1 +1 @@

--O3

+"-O3"

--- libraries/base/tests/T4006.run/T4006.stdout.normalised       2018-11-30 21:15:19.867313900 +0000

+++ libraries/base/tests/T4006.run/T4006.run.stdout.normalised       2018-11-30 21:15:19.870787900 +0000

@@ -1,2 +1,2 @@

It works here

-

+

--- libraries/base/tests/IO/environment001.run/environment001.stdout.normalised       2018-11-30 21:16:00.645817500 +0000

+++ libraries/base/tests/IO/environment001.run/environment001.run.stdout.normalised       2018-11-30 21:16:00.654738900 +0000

@@ -1,7 +1,8 @@

-

-Test 1: 3

-

-Test 2: 1

+

+

+Test 1: 9

+

+Test 2: 3

       !

Test 3: 3

["a","b"]



====> Scanning ../../libraries/hpc/tests/function/test.T

====> Scanning ../../libraries/hpc/tests/function2/test.T

====> Scanning ../../libraries/hpc/tests/ghc_ghci/test.T

====> Scanning ../../libraries/hpc/tests/raytrace/test.T

====> Scanning ../../libraries/hpc/tests/raytrace/tixs/test.T

====> Scanning ../../libraries/hpc/tests/simple/test.T

====> Scanning ../../libraries/hpc/tests/simple/tixs/test.T

====> Scanning ../../libraries/process/tests/all.T

====> Scanning ../../libraries/process/tests/T9775/all.T

====> Scanning ../../libraries/stm/tests/all.T

====> Scanning ../../libraries/template-haskell/tests/all.T

=====> T14452(normal) 1 of 21 [0, 0, 0]

cd "driver/T14452.run" && $MAKE -s --no-print-directory T14452

Actual stdout output differs from expected:

diff -uw "driver/T14452.run/T14452.stdout.normalised" "driver/T14452.run/T14452.run.stdout.normalised"

*** unexpected failure for T14452(normal)

=====> T13385(ghci) 2 of 21 [0, 1, 0]

cd "ghci/scripts/T13385.run" && HC="/c/code/HEAD/inplace/bin/ghc-stage2.exe" HC_OPTS="-dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XRebindableSyntax" "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --interactive -v0 -ignore-dot-ghci -fno-ghci-history +RTS -I0.1 -RTS -fghci-leak-check -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XRebindableSyntax  < T13385.script

=====> print017(ghci) 3 of 21 [0, 1, 0]

cd "ghci.debugger/scripts/print017.run" && HC="/c/code/HEAD/inplace/bin/ghc-stage2.exe" HC_OPTS="-dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output " "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --interactive -v0 -ignore-dot-ghci -fno-ghci-history +RTS -I0.1 -RTS -fghci-leak-check -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output   -ignore-dot-ghci< print017.script

=====> print017(ghci-ext) 3 of 21 [0, 1, 0]

cd "ghci.debugger/scripts/print017.run" && HC="/c/code/HEAD/inplace/bin/ghc-stage2.exe" HC_OPTS="-dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output " "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --interactive -v0 -ignore-dot-ghci -fno-ghci-history -fexternal-interpreter +RTS -I0.1 -RTS -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output   -ignore-dot-ghci< print017.script

=====> plugin-recomp-change(normal) 4 of 21 [0, 1, 0]

cd "plugins/plugin-recomp-change.run" && $MAKE -s --no-print-directory -C plugin-recomp package.plugins01 TOP=/c/code/HEAD/testsuite

cd "plugins/plugin-recomp-change.run" && $MAKE -s --no-print-directory plugin-recomp-change

=====> T10672_x64(normal) 5 of 21 [0, 1, 0]

cd "rts/T10672/T10672_x64.run" && $MAKE -s --no-print-directory T10672_x64

Timeout happened...killed process "cd "rts/T10672/T10672_x64.run" && $MAKE -s --no-print-directory T10672_x64  "...



Wrong exit code for T10672_x64()(expected 0 , actual 99 )

*** unexpected failure for T10672_x64(normal)

=====> TH_scopedTvs(normal) 6 of 21 [0, 2, 0]

cd "th/TH_scopedTvs.run" &&  "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -c TH_scopedTvs.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -v0

=====> TH_scopedTvs(ext-interp) 6 of 21 [0, 2, 0]

cd "th/TH_scopedTvs.run" &&  "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -c TH_scopedTvs.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -fexternal-interpreter -v0

=====> T3319(normal) 7 of 21 [0, 2, 0]

cd "th/T3319.run" &&  "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -c T3319.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -ddump-splices -v0

=====> T3319(ext-interp) 7 of 21 [0, 2, 0]

cd "th/T3319.run" &&  "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -c T3319.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -fexternal-interpreter -ddump-splices -v0

=====> T15815(normal) 8 of 21 [0, 2, 0]

cd "th/T15815.run" &&  "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --make  T15815B -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -v0 -static

=====> T15815(ext-interp) 8 of 21 [0, 2, 0]

cd "th/T15815.run" &&  "/c/code/HEAD/inplace/bin/ghc-stage2.exe" --make  T15815B -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output -XTemplateHaskell -package template-haskell -fexternal-interpreter -v0 -static

=====> T4006(normal) 9 of 21 [0, 2, 0]

cd "libraries/base/tests/T4006.run" &&  "/c/code/HEAD/inplace/bin/ghc-stage2.exe" -o T4006 T4006.hs -dcore-lint -dcmm-lint -no-user-package-db -rtsopts -fno-warn-missed-specialisations -fshow-warning-groups -fdiagnostics-color=never -fno-diagnostics-show-caret -Werror=compat -dno-debug-output

cd "libraries/base/tests/T4006.run" && ./T4006

Actual stdout output differs from expected:

diff -uw "libraries/base/tests/T4006.run/T4006.stdout.normalised" "libraries/base/tests/T4006.run/T4006.run.stdout.normalised"

*** unexpected failure for T4006(normal)

=====> T3307(normal) 10 of 21 [0, 3, 0]

cd "libraries/base/tests/IO/T3307.run" && $MAKE -s --no-print-directory T3307-test

Wrong exit code for T3307()(expected 0 , actual 2 )

Stdout ( T3307 ):

Test 1

[99,104,105,110,101,115,101,45,102,105,108,101,45,229,176,143,232,175,180]

Ni hao

Test 2

[99,104,105,110,101,115,101,45,102,105,108,101,45,229,176,143,232,175,180]

Ni hao

Test 3

[99,104,105,110,101,115,101,45,102,105,108,101,45,23567,35828]

Stderr ( T3307 ):

*** framework failure for T3307(normal) 'latin-1' codec can't encode characters in position 24-25: ordinal not in range(256)

=====> environment001(normal) 11 of 21 [0, 3, 1]

cd "libraries/base/tests/IO/environment001.run" && $MAKE -s --no-print-directory environment001-test

Actual stdout output differs from expected:

diff -uw "libraries/base/tests/IO/environment001.run/environment001.stdout.normalised" "libraries/base/tests/IO/environment001.run/environment001.run.stdout.normalised"

*** unexpected failure for environment001(normal)

=====> plugins07(normal) 12 of 21 [0, 4, 1]

cd "plugins/plugins07.run" && $MAKE -s --no-print-directory -C rule-defining-plugin package.plugins07 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins07.run" && $MAKE -s --no-print-directory plugins07

=====> plugins09(normal) 13 of 21 [0, 4, 1]

cd "plugins/plugins09.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins09 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins09.run" && $MAKE -s --no-print-directory plugins09

Actual stdout output differs from expected:

diff -uw "plugins/plugins09.run/plugins09.stdout.normalised" "plugins/plugins09.run/plugins09.run.stdout.normalised"--- plugins/plugins09.run/plugins09.stdout.normalised       2018-11-30 21:17:20.709370700 +0000

+++ plugins/plugins09.run/plugins09.run.stdout.normalised       2018-11-30 21:17:20.711314000 +0000

@@ -1,9 +0,0 @@

-parsePlugin(a,b)

-interfacePlugin: Prelude

-interfacePlugin: GHC.Float

-interfacePlugin: GHC.Base

-typeCheckPlugin (rn)

-interfacePlugin: GHC.Types

-typeCheckPlugin (tc)

-interfacePlugin: GHC.Integer.Type

-interfacePlugin: GHC.Natural

--- plugins/plugins10.run/plugins10.stdout.normalised       2018-11-30 21:17:57.644357800 +0000

+++ plugins/plugins10.run/plugins10.run.stdout.normalised       2018-11-30 21:17:57.646078700 +0000

@@ -1,21 +0,0 @@

-parsePlugin()

-interfacePlugin: Prelude

-interfacePlugin: Language.Haskell.TH<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2FLanguage.Haskell.TH&data=02%7C01%7Csimonpj%40microsoft.com%7Cd64a7fd8596547542e5a08d65896b7f0%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636793801698303860&sdata=GkdQXc5wqAPeYpWJWkv1LS9W22Oz30rZmGGHl8Y9OhE%3D&reserved=0>

-interfacePlugin: Language.Haskell.TH.Quote

-interfacePlugin: GHC.Float

-interfacePlugin: GHC.Base

-interfacePlugin: Language.Haskell.TH.Syntax

-typeCheckPlugin (rn)

-interfacePlugin: GHC.Types

-typeCheckPlugin (tc)

-interfacePlugin: GHC.Integer.Type

-interfacePlugin: GHC.Natural

-parsePlugin(a)

-typeCheckPlugin (rn)

-interfacePlugin: Language.Haskell.TH.Lib.Internal

-metaPlugin: return []

-metaPlugin: quoteExp stringify "x"

-interfacePlugin: GHC.CString

-typeCheckPlugin (rn)

-typeCheckPlugin (rn)

-typeCheckPlugin (tc)



*** unexpected failure for plugins09(normal)

=====> plugins10(normal) 14 of 21 [0, 5, 1]

cd "plugins/plugins10.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins10 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins10.run" && $MAKE -s --no-print-directory plugins10

Actual stdout output differs from expected:

diff -uw "plugins/plugins10.run/plugins10.stdout.normalised" "plugins/plugins10.run/plugins10.run.stdout.normalised"

*** unexpected failure for plugins10(normal)

=====> plugins11(normal) 15 of 21 [0, 6, 1]

cd "plugins/plugins11.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins11 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins11.run" && $MAKE -s --no-print-directory plugins11

Timeout happened...killed process "cd "plugins/plugins11.run" && $MAKE -s --no-print-directory plugins11  "...



Wrong exit code for plugins11()(expected 0 , actual 99 )

*** unexpected failure for plugins11(normal)

=====> plugins13(normal) 16 of 21 [0, 7, 1]

cd "plugins/plugins13.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins13 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins13.run" && $MAKE -s --no-print-directory plugins13

=====> plugins14(normal) 17 of 21 [0, 7, 1]

cd "plugins/plugins14.run" && $MAKE -s --no-print-directory -C simple-plugin package.plugins14 TOP=/c/code/HEAD/testsuite

cd "plugins/plugins14.run" && $MAKE -s --no-print-directory plugins14

=====> T10420(normal) 18 of 21 [0, 7, 1]

cd "plugins/T10420.run" && $MAKE -s --no-print-directory -C rule-defining-plugin package.T10420 TOP=/c/code/HEAD/testsuite

cd "plugins/T10420.run" && $MAKE -s --no-print-directory T10420

=====> plugin-recomp-pure(normal) 19 of 21 [0, 7, 1]

cd "plugins/plugin-recomp-pure.run" && $MAKE -s --no-print-directory -C plugin-recomp package.plugins01 TOP=/c/code/HEAD/testsuite

cd "plugins/plugin-recomp-pure.run" && $MAKE -s --no-print-directory plugin-recomp-pure

Timeout happened...killed process "cd "plugins/plugin-recomp-pure.run" && $MAKE -s --no-print-directory plugin-recomp-pure  "...



Wrong exit code for plugin-recomp-pure()(expected 0 , actual 99 )

Stdout ( plugin-recomp-pure ):

[1 of 1] Compiling Main             ( plugin-recomp-test.hs, plugin-recomp-test.o )

Stderr ( plugin-recomp-pure ):

Simple Plugin Passes Queried

Got options:

Simple Plugin Pass Run

*** unexpected failure for plugin-recomp-pure(normal)

=====> plugin-recomp-impure(normal) 20 of 21 [0, 8, 1]

cd "plugins/plugin-recomp-impure.run" && $MAKE -s --no-print-directory -C plugin-recomp package.plugins01 TOP=/c/code/HEAD/testsuite

cd "plugins/plugin-recomp-impure.run" && $MAKE -s --no-print-directory plugin-recomp-impure

Wrong exit code for plugin-recomp-impure()(expected 0 , actual 2 )

Stdout ( plugin-recomp-impure ):

[1 of 1] Compiling Main             ( plugin-recomp-test.hs, plugin-recomp-test.o )

Linking plugin-recomp-test.exe ...

[1 of 1] Compiling Main             ( plugin-recomp-test.hs, plugin-recomp-test.o ) [Plugin forced recompilation]

Stderr ( plugin-recomp-impure ):

Simple Plugin Passes Queried

Got options:

Simple Plugin Pass Run

Simple Plugin Passes Queried

Access violation in generated code when reading 0xa824



Attempting to reconstruct a stack trace...



   Frame     Code address

* 0x49adab0 0x1eb49ec C:\code\HEAD\inplace\bin\ghc-stage2.exe+0x1ab49ec



make[1]: *** [Makefile:99: plugin-recomp-impure] Error 11

*** unexpected failure for plugin-recomp-impure(normal)

=====> plugin-recomp-flags(normal) 21 of 21 [0, 9, 1]

cd "plugins/plugin-recomp-flags.run" && $MAKE -s --no-print-directory -C plugin-recomp package.plugins01 TOP=/c/code/HEAD/testsuite

cd "plugins/plugin-recomp-flags.run" && $MAKE -s --no-print-directory plugin-recomp-flags

Traceback (most recent call last):

  File "/c/code/HEAD/testsuite/driver/testlib.py", line 824, in test_common_work

    do_test(name, way, func, args, files)

  File "/c/code/HEAD/testsuite/driver/testlib.py", line 910, in do_test

    result = func(*[name,way] + args)

  File "/c/code/HEAD/testsuite/driver/testlib.py", line 993, in run_command

    return simple_run( name, '', override_options(cmd), '' )

  File "/c/code/HEAD/testsuite/driver/testlib.py", line 1338, in simple_run

    dump_stderr(name)

  File "/c/code/HEAD/testsuite/driver/testlib.py", line 1501, in dump_stderr

    print(str)

UnicodeEncodeError: 'latin-1' codec can't encode characters in position 24-25: ordinal not in range(256)



Unexpected results from:

TEST="T10672_x64 T14452 T3307 T4006 environment001 plugin-recomp-impure plugin-recomp-pure plugins09 plugins10 plugins11"



SUMMARY for test run started at Fri Nov 30 21:07:17 2018 GMTST

0:26:45 spent to go through

      21 total tests, which gave rise to

      36 test cases, of which

      11 were skipped



       0 had missing libraries

      15 expected passes

       0 expected failures



       1 caused framework failures

       0 caused framework warnings

       0 unexpected passes

       9 unexpected failures

       0 unexpected stat failures



Unexpected failures:

   driver/T14452.run                           T14452 [bad stdout] (normal)

   rts/T10672/T10672_x64.run                   T10672_x64 [bad exit code] (normal)

   libraries/base/tests/T4006.run              T4006 [bad stdout] (normal)

   libraries/base/tests/IO/environment001.run  environment001 [bad stdout] (normal)

   plugins/plugins09.run                       plugins09 [bad stdout] (normal)

   plugins/plugins10.run                       plugins10 [bad stdout] (normal)

   plugins/plugins11.run                       plugins11 [bad exit code] (normal)

   plugins/plugin-recomp-pure.run              plugin-recomp-pure [bad exit code] (normal)

   plugins/plugin-recomp-impure.run            plugin-recomp-impure [bad exit code] (normal)



Framework failures:

   libraries/base/tests/IO/T3307.run  T3307 [normal] ('latin-1' codec can't encode characters in position 24-25: ordinal not in range(256))



Appending 0 stats to git notes.

make: *** [../mk/test.mk:342<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ftest.mk%3A342&data=02%7C01%7Csimonpj%40microsoft.com%7Cd64a7fd8596547542e5a08d65896b7f0%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636793801698313865&sdata=fpsUk2FbkGpxEd0hWf4BKa%2FllsfpMf0DrppYeVVMo50%3D&reserved=0>: test] Error 1

make: Leaving directory '/c/code/HEAD/testsuite/tests'

/c/code/HEAD$




From: Phyx <lonetiger at gmail.com<mailto:lonetiger at gmail.com>>
Sent: 30 November 2018 11:58
To: Simon Peyton Jones <simonpj at microsoft.com<mailto:simonpj at microsoft.com>>
Subject: Re: Windows test failures

At the end of the first test run it would have given a list of tests that failed and a line saying TEST=".... List of tests..."

Copy that line and at the root of the checkout do

make TEST=".... List of tests..."  test -C testsuite/tests

(that's uppercase C). This will run everything using one thread. :)

Should give a good starting point as to what's wrong.

Kind regards,
Tamar
On Fri, Nov 30, 2018, 10:30 Simon Peyton Jones <simonpj at microsoft.com<mailto:simonpj at microsoft.com>> wrote:
So I just say
               make TEST
is that right?

Or is it
               make THREADS=1

or what?  Sorry to be dim

From: Phyx <lonetiger at gmail.com<mailto:lonetiger at gmail.com>>
Sent: 30 November 2018 08:05
To: Simon Peyton Jones <simonpj at microsoft.com<mailto:simonpj at microsoft.com>>
Cc: ghc-devs <ghc-devs at haskell.org<mailto:ghc-devs at haskell.org>>
Subject: Re: Windows test failures

Hi Simon,

Could you try rerunning those failing tests with make TEST? No threads? I have been trying to clean up the testsuite and there should be only 3 failing tests, two plugin tests with bad stdout and T10672_x64 which I am looking into.

I have however noticed that the testsuite has become increasingly unstable under threads for some reason.

I also haven't run trunk yet since last week so they could be new..

But rerunning the fails with no threads should give a better idea.

Regards,
Tamar
On Fri, Nov 30, 2018, 07:46 Simon Peyton Jones via ghc-devs <ghc-devs at haskell.org<mailto:ghc-devs at haskell.org>> wrote:
Ben, Phyx, and other CI folk
‘sh validate –fast’ still gives a lot of failures on Window.  The output is below. I would be so good to get this to zero!
(another minor thing is that it would be great to eliminate the long path at the beginning – this is platform independent – I have to delete manually many times each day.
Thanks
Simon

Unexpected passes:

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/rts/T9405.run  T9405 [unexpected] (normal)



Unexpected failures:

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/driver/T14452.run                           T14452 [bad stdout] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci/linking/ghcilink001.run                ghcilink001 [bad exit code] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci/prog010/ghci.prog010.run               ghci.prog010 [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci/scripts/ghci050.run                    ghci050 [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci/should_run/T14963a.run                 T14963a [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci.debugger/scripts/print012.run          print012 [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci.debugger/scripts/print016.run          print016 [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci.debugger/scripts/break019.run          break019 [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci.debugger/scripts/break028.run          break028 [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci.debugger/scripts/dynbrk002.run         dynbrk002 [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci.debugger/scripts/T2740.run             T2740 [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/indexed-types/should_fail/T7102a.run        T7102a [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/plugin-recomp-change.run            plugin-recomp-change [bad exit code] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/rts/T10672/T10672_x64.run                   T10672_x64 [bad exit code] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/th/TH_spliceGuard.run                       TH_spliceGuard [exit code non-0] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/th/TH_overlaps.run                          TH_overlaps [exit code non-0] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/th/T5886.run                                T5886 [exit code non-0] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/th/T10697_decided_3.run                     T10697_decided_3 [exit code non-0] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/th/T11629.run                               T11629 [exit code non-0] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/libraries/base/tests/T4006.run              T4006 [bad stdout] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/libraries/base/tests/IO/environment001.run  environment001 [bad stdout] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/ghci/should_run/T15633b.run                 T15633b [bad exit code] (ghci)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/plugins07.run                       plugins07 [bad exit code] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/plugins09.run                       plugins09 [bad stdout] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/plugins10.run                       plugins10 [bad stdout] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/plugins11.run                       plugins11 [bad stdout] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/T10420.run                          T10420 [bad exit code] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/plugin-recomp-pure.run              plugin-recomp-pure [bad exit code] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/plugin-recomp-impure.run            plugin-recomp-impure [bad exit code] (normal)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/plugins/plugin-recomp-flags.run             plugin-recomp-flags [bad exit code] (normal)



Framework failures:

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/perf/compiler/MultiLayerModules.run  MultiLayerModules [runTest] (Unhandled exception during cleanup: Unable to remove folder '/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/perf/compiler/MultiLayerModules.run': [Errno 13] Permission denied: '/c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/perf/compiler/MultiLayerModules.run'

Unable to start current test.)

   /c/Users/simonpj/AppData/Local/Temp/ghctest-i30xogs3/test   spaces/libraries/base/tests/IO/T3307.run    T3307 [normal] ('latin-1' codec can't encode characters in position 24-25: ordinal not in range(256))

_______________________________________________
ghc-devs mailing list
ghc-devs at haskell.org<mailto:ghc-devs at haskell.org>
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail.haskell.org%2Fcgi-bin%2Fmailman%2Flistinfo%2Fghc-devs&data=02%7C01%7Csimonpj%40microsoft.com%7Cd64a7fd8596547542e5a08d65896b7f0%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636793801698313865&sdata=kci%2FfV%2FOswY7qq9ir8pYASfn%2FvflYR25UuEf71rRHyI%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/ghc-devs/attachments/20181206/076dcf58/attachment-0001.html>


More information about the ghc-devs mailing list