[GHC DevOps Group] CircleCI job accounting question

[Manuel M T Chakravarty]

Hi Ben,

Firstly re

  https://github.com/ghc/ghc/commit/5f158bc1a7eedf8680f4a1e612ca34daa05e0029 <https://github.com/ghc/ghc/commit/5f158bc1a7eedf8680f4a1e612ca34daa05e0029>

CircleCI seems to now use an 8CPU (xlarge) instance to run the GHC builds. This is after Jonas asked them to activate it. You can see that, e.g., by looking at the ”Resource” value on the last few <https://circleci.com/gh/ghc <https://circleci.com/gh/ghc>> builds.

Secondly, I am not sure what is happening with your fork, but forks cannot all count against the main repo. For example, Tweag’s GHC fork has been running for a long time independently and also has already been using the xlarge instances (which weren’t even enabled for the main GHC repo).

However, re your question to Jonas,

> Will all users who test using their fork need to ask for this
> to be enabled?

Yes, my understanding is that individual GitHub accounts forking GHC who want the additional resources (for xlarge and for macOS) will have to individually request the additional resources from CircleCI. That is the ”price” for it not to be charged against the same account. (We need to document that.)

Re Darwin, isn’t that a different issue now? I just looked at the last Darwin build ”ghc / ghc / master #272” and the build seems to be fine, but it chokes on uploading the build artefacts.

Mateusz, what do you think?

Cheers,
Manuel

PS: If one of the Tweag’ers could be added to the GitHub GHC org, we could take care of things like activating xlarge more easily…

> Ben Gamari <ben at well-typed.com>:
> 
> Hi Manuel,
> 
> I seem to recall you earlier mentioning that CircleCI jobs associated
> with forks of a repository do not count towards the job limit of the
> forked repository. How certain are you that this is the case?
> 
> I ask because I have done a bit of work on the CircleCI infrastructure
> which I pushed to my GitHub fork earlier today. However, the build [1]
> has inexplicably still not been started. Given that the ghc/ghc
> repository is still catching up on its own builds, I suspect that both
> repositories are drawing against the same resource limit. Unfortunately
> I have been unable to find compelling evidence one way or the other in
> the CircleCI documentation.
> 
> If it is true that builds of forks count against the forked repository's
> resource limit then we will need to make the appropriate accomodations
> in our resource planning.
> 
> In other news, I have opened another support ticket about the hanging Darwin
> build issue, which still appears to be occurring. I'll update you and
> Mateusz when I hear back.
> 
> Thanks again for everything you and Mateusz have done on this.
> 
> Cheers,
> 
> - Ben
> 
> 
> [1] https://circleci.com/gh/bgamari/ghc/15

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/ghc-devops-group/attachments/20171113/e35731b8/attachment.html>