[GHC DevOps Group] CircleCI job accounting question

[Ben Gamari]

Manuel M T Chakravarty <manuel.chakravarty at tweag.io> writes:

>> 15.12.2017 09:25 Ben Gamari <ben at well-typed.com>:
>>
>> Well, I think it's a bit premature to call it "working". It runs and
>> reliably finishes, but there is still quite some work to be done to make
>> it pass the testsuite. The only reason it "passes" currently is that the
>> testsuite driver exits with exit code 0 even when tests fail (this is
>> #14411; I just posted a patch for this as D4268).
>> 
>> If you look at any of the recent "passing" builds you will see that the
>> testsuite fails with around a dozen failures (around half being stat
>> failures). I fixed a whole slew of these in the OS X build a few weeks
>> ago but I haven't had a chance to dig into those that remain. At first
>> glance they resemble #10037, but there is at least one segmentation
>> fault (on Darwin) which is a bit concerning.
>
> Please correct me if I am wrong, but aren’t these problems with the compiler/testsuite and not problems with CircleCI?
>
Very likely, yes. That being said, they do need to be fixed before we can
move to CircleCI as our primary CI scheme. Otherwise the build will go
red the moment that I fix #10037.

Cheers,

- Ben
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 487 bytes
Desc: not available
URL: <http://mail.haskell.org/pipermail/ghc-devops-group/attachments/20171215/5a1cc2d2/attachment.sig>