Hi Simon, <div><br></div><div>Thanks for the email. I haven't been building head much as I'm working on top of some older commits. From a quick look it seems like the plugin ones are probably testisms, the plugins aren't found so likely a missing path entry somewhere. </div><div><br></div><div>The linker ones are are weird, I'll need to take a closer look at those, likely culprit is my recent patch, I had been testing in the 32 bit build and didn't notice these. </div><div><br></div><div>There are a few worrying segfault that shouldn't be there on some random tests so I'll take a closer look at those too.</div><div><br></div><div>And the stat changes need to be updated.</div><div><br></div><div>The framework failures I don't see on harbormaster, so think they are again a threading artifact. Need to figure out a more effective way to debug these to find a permanent fix. The ones that harbormaster does see are encoding related. touch is failing on non-ascii names. </div><div><br></div><div>I will take a look this weekend. </div><div><br></div><div>Kind regards, </div><div>Tamar </div><div><br><div class="gmail_quote"><div dir="ltr">On Thu, Sep 20, 2018, 11:33 Simon Peyton Jones <<a href="mailto:simonpj@microsoft.com">simonpj@microsoft.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-GB" link="#0563C1" vlink="#954F72">
<div class="m_3135077884050701491WordSection1">
<p class="MsoNormal">Hi Tamar<u></u><u></u></p>
<p class="MsoNormal">The list of testsuite failure on Windows has grown quite long – see below. Most seem to concern plugins or linking.<u></u><u></u></p>
<p class="MsoNormal">Do you know what is going on here? If they can’t be fixed, can we mark them as expect_broken on Windows, so that it’s easier (when developing) to know when I’ve introduced a regression. Currently I have to do a manual diff against a rather
long list.<u></u><u></u></p>
<p class="MsoNormal">Thanks!<u></u><u></u></p>
<p class="MsoNormal">Simon<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="m_3135077884050701491Code"><b>SUMMARY for test run started at Thu Sep 20 00:13:20 2018 GMTST<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b>1:03:11 spent to go through<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 6530 total tests, which gave rise to<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 18728 test cases, of which<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 12206 were skipped<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b><u></u> <u></u></b></p>
<p class="m_3135077884050701491Code"><b> 33 had missing libraries<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 6278 expected passes<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 173 expected failures<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b><u></u> <u></u></b></p>
<p class="m_3135077884050701491Code"><b> 9 caused framework failures<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 1 caused framework warnings<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 0 unexpected passes<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 31 unexpected failures<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> 7 unexpected stat failures<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b><u></u> <u></u></b></p>
<p class="m_3135077884050701491Code"><b>Unexpected failures:<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> ghci/linking/dyn/T10955dyn.run T10955dyn [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> ghci/linking/dyn/T10955.run T10955 [bad stderr] (ghci)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> ghci/linking/dyn/T11072gcc.run T11072gcc [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> numeric/should_run/FloatFnInverses.run FloatFnInverses [bad stdout] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/T11244.run T11244 [bad stderr] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugin-recomp-change.run plugin-recomp-change [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> rts/T7040_ghci.run T7040_ghci [bad stdout] (ghci)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> rts/linker_unload.run linker_unload [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> rts/linker_error1.run linker_error1 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> rts/linker_error2.run linker_error2 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> rts/T12771/T12771.run T12771 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> rts/T13082/T13082_good.run T13082_good [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> rts/T14611/T14611.run T14611 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> simplCore/should_compile/T7702.run T7702 [exit code non-0] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> rts/T10672/T10672_x64.run T10672_x64 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> libraries/Win32/tests/T4452.run T4452 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins01.run plugins01 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins07.run plugins07 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins09.run plugins09 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins11.run plugins11 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins12.run plugins12 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins13.run plugins13 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins14.run plugins14 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins15.run plugins15 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/T10420.run T10420 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/T10294.run T10294 [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/T10294a.run T10294a [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/T12567a.run T12567a [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugin-recomp-pure.run plugin-recomp-pure [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugin-recomp-impure.run plugin-recomp-impure [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugin-recomp-flags.run plugin-recomp-flags [bad exit code] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b><u></u> <u></u></b></p>
<p class="m_3135077884050701491Code"><b>Unexpected stat failures:<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> perf/compiler/T9872d.run T9872d [stat not good enough] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> perf/compiler/T12425.run T12425 [stat not good enough] (optasm)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> perf/compiler/T12234.run T12234 [stat not good enough] (optasm)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> perf/compiler/T12150.run T12150 [stat not good enough] (optasm)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> perf/should_run/T15226.run T15226 [stat too good] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> perf/should_run/T15226a.run T15226a [stat too good] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> perf/compiler/MultiLayerModules.run MultiLayerModules [stat not good enough] (normal)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b><u></u> <u></u></b></p>
<p class="m_3135077884050701491Code"><b>Framework failures:<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> ghci/linking/dyn/T10955.run T10955 [ghci] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/T11244.run T11244 [normal] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugin-recomp-change.run plugin-recomp-change [normal] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugins07.run plugins07 [normal] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/T10420.run T10420 [normal] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/T10294a.run T10294a [normal] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugin-recomp-pure.run plugin-recomp-pure [normal] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugin-recomp-impure.run plugin-recomp-impure [normal] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> plugins/plugin-recomp-flags.run plugin-recomp-flags [normal] (pre_cmd failed: 2)<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b><u></u> <u></u></b></p>
<p class="m_3135077884050701491Code"><b>Framework warnings:<u></u><u></u></b></p>
<p class="m_3135077884050701491Code"><b> . T13701 [numfield-no-expected] (No expected value found for bytes allocated in num_field check)</b><u></u><u></u></p>
<p class="m_3135077884050701491Code"><u></u> <u></u></p>
</div>
</div>
</blockquote></div></div>