[Git][ghc/ghc][wip/ghc-9.4.5-backports] 63 commits: Allow LLVM 14
Zubin (@wz1000)
gitlab at gitlab.haskell.org
Thu Apr 13 13:03:38 UTC 2023
Zubin pushed to branch wip/ghc-9.4.5-backports at Glasgow Haskell Compiler / GHC
Commits:
35aedf29 by Zubin Duggal at 2023-04-13T18:32:11+05:30
Allow LLVM 14
- - - - -
1fe02d69 by Ben Gamari at 2023-04-13T18:32:11+05:30
rts: Always use atomics for context_switch and interrupt
Since these are modified by the timer handler.
(cherry picked from commit 605d954722a314c0da59ea07efc26d8a7cb59296)
- - - - -
074243ad by Ben Gamari at 2023-04-13T18:32:11+05:30
rts/Timer: Always use atomic operations
As noted in #22447, the existence of the pthread-based ITimer
implementation means that we cannot assume that the program is
single-threaded.
(cherry picked from commit 86f20258ab7dbfb56e323ee811e9eaef80b077d3)
- - - - -
2bd2272f by Ben Gamari at 2023-04-13T18:32:11+05:30
rts: Encapsulate recent_activity access
This makes it easier to ensure that it is accessed using the necessary
atomic operations.
(cherry picked from commit f8e901dcc090ef81723fb9f3d8ea0a1baac4cbc3)
- - - - -
bc49e406 by Ben Gamari at 2023-04-13T18:32:11+05:30
rts: Encapsulate access to capabilities array
(cherry picked from commit e0affaa9fc3e6dc0e65808afa383426b7fe9420a)
- - - - -
2f2949cf by Ben Gamari at 2023-04-13T18:32:11+05:30
rts: Encapsulate sched_state
(cherry picked from commit 7ca683e44f9f7a9a7984bbed4f49712838638fc8)
- - - - -
dc0f6aed by Ben Gamari at 2023-04-13T18:32:11+05:30
nonmoving: Fix race in marking of blackholes
We must use an acquire-fence when marking to ensure that the indirectee
is visible.
(cherry picked from commit 2d71481ad481e6887e2ee342910b1495d53e6e4a)
- - - - -
7e5f322e by Ben Gamari at 2023-04-13T18:32:11+05:30
nonmoving: Fix segment list races
(cherry picked from commit d92b5bf5ca90fb126321224f28096224bce87539)
- - - - -
ea78129a by Ben Gamari at 2023-04-13T18:32:11+05:30
nonmoving: Use atomic when looking at bd->gen
Since it may have been mutated by a moving GC.
(cherry picked from commit 0b0d924edcf7631ed1afc88d614849558fa8fa7f)
- - - - -
333f6ba3 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Eliminate race in bump_static_flag
To ensure that we don't race with a mutator entering a new CAF we take
the SM mutex before touching static_flag. The other option here would be
to instead modify newCAF to use a CAS but the present approach is a bit
safer.
(cherry picked from commit 9a9874d2d96acdcd9daddb7aceaa7951153f6ac0)
- - - - -
f5e1ac14 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Ensure that mutable fields have acquire barrier
(cherry picked from commit d6990e6789efeb091c51c50580b68ea1bd997d00)
- - - - -
2b416775 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Fix races in collector status tracking
Mark a number of accesses to do with tracking of the status of the
concurrent collection thread as atomic. No interesting races here,
merely necessary to satisfy TSAN.
(cherry picked from commit 83c2876d3783ac2f4ea969c9e01d15198aea03a3)
- - - - -
91e3a4ca by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Make segment state updates atomic
(cherry picked from commit 377697ea4d44023e0c690d722e1e27f03629227f)
- - - - -
99ea20a2 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Refactor update remembered set initialization
This avoids a lock inversion between the storage manager mutex and
the stable pointer table mutex by not dropping the SM_MUTEX in
nonmovingCollect. This requires quite a bit of rejiggering but it
does seem like a better strategy.
(cherry picked from commit c96fc9d52e138b89a85f8df8f722140f874bcede)
- - - - -
0dd134a0 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Ensure that we aren't holding locks when closing them
TSAN complains about this sort of thing.
(cherry picked from commit 71aea6d3160e1389c38bb94c281bd7c30a030147)
- - - - -
28966f87 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Make bitmap accesses atomic
This is a benign race on any sensible hard since these are byte
accesses. Nevertheless, atomic accesses are necessary to satisfy
TSAN.
(cherry picked from commit 2d10d8dfdff1212286490c2c19b8f725ce501b10)
- - - - -
a88afd8e by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Fix benign race in update remembered set check
Relaxed load is fine here since we will take the lock before looking at
the list.
(cherry picked from commit 7570ae43218fbdee30f783af5a3f49fa3d8301e3)
- - - - -
d4ca3765 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Fix race in shortcutting
We must use an acquire load to read the info table pointer since if we
find an indirection we must be certain that we see the indirectee.
(cherry picked from commit b6a3ab00712ca40acd1d91ba910e18c972a345a8)
- - - - -
c698b9e8 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Make free list counter accesses atomic
Since these may race with the allocator(s).
(cherry picked from commit 5a40353566516d7ba8b1db6877f8c3aba06e64aa)
- - - - -
b5600dca by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Fix style
(cherry picked from commit 1ca730ce410007781489821188ea8c1ca85f78f9)
- - - - -
c8d66b9b by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Deduplicate assertion
(cherry picked from commit 1cc4bd7a169c6d813330d3613836889568515000)
- - - - -
9b64396f by Ben Gamari at 2023-04-13T18:32:12+05:30
rts: Fix type issues in Sparks.h
Adds explicit casts to satisfy a C++ compiler.
(cherry picked from commit 8623ab4bd7fb1326cebb3191fdee841af74bb345)
- - - - -
cc8f7b82 by Ben Gamari at 2023-04-13T18:32:12+05:30
rts/BlockAlloc: Allow disabling of internal assertions
These can be quite expensive and it is sometimes useful to compile a
DEBUG RTS without them.
(cherry picked from commit 3072bef55dc6e123e7eb84bb9154a13db4d043da)
- - - - -
022c7500 by Ben Gamari at 2023-04-13T18:32:12+05:30
rts/Sanity: Mark pinned_object_blocks
(cherry picked from commit 3223048a1ee73384010aa20be548bad95ef1744a)
- - - - -
074895f4 by Ben Gamari at 2023-04-13T18:32:12+05:30
rts/Sanity: Look at nonmoving saved_filled lists
(cherry picked from commit ce4cf9d59552b52ae3d4c1c1e71a83296f022c27)
- - - - -
8e707288 by Ben Gamari at 2023-04-13T18:32:12+05:30
Evac: Squash data race in eval_selector_chain
(cherry picked from commit 9ce9fba46bf3fe1af4ce39dba4276bb241f3ea29)
- - - - -
34f4fdb9 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Clarify implementation
This makes the intent of this implementation a bit clearer.
(cherry picked from commit ba3c7b67bd74906de63b3988b18a14b01861d3c9)
- - - - -
7bfa1b7a by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Clarify comment
(cherry picked from commit 883d00f9cfffe3bd451f7302116eb29ce836c600)
- - - - -
52972ea4 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Add missing no-op in busy-wait loop
(cherry picked from commit ed5443ec9195f27522abf4b2882dbc6b6a9f17f5)
- - - - -
d0a62880 by Ben Gamari at 2023-04-13T18:32:12+05:30
nonmoving: Don't push empty arrays to update remembered set
Previously the write barrier of resizeSmallArray# incorrectly handled
resizing of zero-sized arrays, pushing an invalid pointer to the update
remembered set.
Fixes #22931.
(cherry picked from commit 244640a067c0158db5f14f133212caa1a830030e)
- - - - -
ce559154 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Fix handling of weak pointers
This fixes an interaction between aging and weak pointer handling which
prevented the finalization of some weak pointers. In particular, weak
pointers could have their keys incorrectly marked by the preparatory
collector, preventing their finalization by the subsequent concurrent
collection.
While in the area, we also significantly improve the assertions
regarding weak pointers.
Fixes #22327.
(cherry picked from commit 683e0c7aef2bbfedbee02c8fa32789e32c89a4db)
- - - - -
9e459024 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Sanity check nonmoving large objects and compacts
(cherry picked from commit 90e240045c1ac5047f4038bbeed6d2b71b20bc77)
- - - - -
031fc563 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Sanity check mutable list
Assert that entries in the nonmoving generation's generational
remembered set (a.k.a. mutable list) live in nonmoving generation.
(cherry picked from commit 2f08265751c13f7bd0df1c46928fc09a064a8add)
- - - - -
5f6ba2c1 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Don't show occupancy if we didn't collect live words
(cherry picked from commit 3288e96d4ffe8c5f70929c4fedbfef918148def1)
- - - - -
701904d2 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Fix tracking of FILLED_SWEEPING segments
Previously we only updated the state of the segment at the head of each
allocator's filled list.
(cherry picked from commit 4392965d14920117db2cf4ce460dec6f094f6dfe)
- - - - -
89829497 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Assert state of swept segments
(cherry picked from commit d478ac18395962d33e14fc378ad9a424bdcd1496)
- - - - -
cd6d8d88 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Handle new closures in nonmovingIsNowAlive
We must conservatively assume that new closures are reachable since we
are not guaranteed to mark such blocks.
(cherry picked from commit 3e47be7887b2df48d2ad50791a98131634d7e8ec)
- - - - -
5880feb1 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Don't clobber update rem sets of old capabilities
Previously `storageAddCapabilities` (called by `setNumCapabilities`) would
clobber the update remembered sets of existing capabilities when
increasing the capability count. Fix this by only initializing the
update remembered sets of the newly-created capabilities.
Fixes #22927.
(cherry picked from commit 7dc1679b133672029dd7afae834a7fc67265035c)
- - - - -
c0b79141 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Add missing write barriers in selector optimisation
This fixes the selector optimisation, adding a few write barriers which
are necessary for soundness. See the inline comments for details.
Fixes #22930.
(cherry picked from commit bd80fcd18f7be5b9d445d80c828b1a734c0e5a3b)
- - - - -
0f5a95a3 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Post-sweep sanity checking
(cherry picked from commit e941801a267a3b9d898b48d90737924a7b7e4da2)
- - - - -
236c29fd by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Avoid n_caps race
(cherry picked from commit 68fa47f3f5d1c207bd9edd7206bcceb150377647)
- - - - -
43143654 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Don't push if nonmoving collector isn't enabled
(cherry picked from commit b15c813717ab9797df7733575904a7131bc4044c)
- - - - -
0c440ba6 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Be more paranoid in segment tracking
Previously we left various segment link pointers dangling. None of this
wrong per se, but it did make it harder than necessary to debug.
(cherry picked from commit ca3bc40255ffadfd0df31ec3a6ec5df7ca7f663e)
- - - - -
80d5adcc by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Sync-phase mark budgeting
Here we significantly improve the bound on sync phase pause times by
imposing a limit on the amount of work that we can perform during the
sync. If we find that we have exceeded our marking budget then we allow
the mutators to resume, return to concurrent marking, and try
synchronizing again later.
Fixes #22929.
(cherry picked from commit 023998885b16bea51c0c1cdceb3f0ef96dccd5e4)
- - - - -
6d790d46 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Allow pinned gen0 objects to be WEAK keys
(cherry picked from commit 0c6f15762d14ade2666d5ad7f665718b4a10f89e)
- - - - -
222c16ff by Ben Gamari at 2023-04-13T18:32:13+05:30
rts: Reenable assertion
(cherry picked from commit 5b60acba8d76ecc4d733043460972633b13eedb0)
- - - - -
c1c3983b by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Move current segment array into Capability
The current segments are conceptually owned by the mutator, not the
collector. Consequently, it was quite tricky to prove that the mutator
would not race with the collect due to this shared state. It turns out
that such races are possible: when resizing the current segment array
we may concurrently try to take a heap census. This will attempt to walk
the current segment array, causing a data race.
Fix this by moving the current segment array into `Capability`, where it
belongs.
Fixes #22926.
(cherry picked from commit f849374508432ce07c25db8848fbea0d71040038)
- - - - -
394f2667 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Fix Note references
Some references to Note [Deadlock detection under the non-moving
collector] were missing an article.
(cherry picked from commit 43fda6487f729f8c627dbb2abbfc027444d54e52)
- - - - -
057093df by Ben Gamari at 2023-04-13T18:32:13+05:30
rts/Sanity: Fix block count assertion with non-moving collector
The nonmoving collector does not use `oldest_gen->blocks` to track its
block list. However, it nevertheless updates `oldest_gen->n_blocks` to
ensure that its size is accounted for by the storage manager.
Consequently, we must not attempt to assert consistency between the two.
(cherry picked from commit a9062eaa577b3f1edf07908e57832524b5525d7d)
- - - - -
b84a33b2 by Ben Gamari at 2023-04-13T18:32:13+05:30
nonmoving: Don't call prepareUnloadCheck
When the nonmoving GC is in use we do not call `checkUnload` (since we
don't unload code) and therefore should not call `prepareUnloadCheck`,
lest we run into assertions.
(cherry picked from commit b284e1c1d1e8e2513a286e3bbc5f46d635b33dd8)
- - - - -
bf9d4ebc by Ben Gamari at 2023-04-13T18:32:13+05:30
rts: Encapsulate block allocator spinlock
This makes it a bit easier to add instrumentation on this spinlock
while debugging.
(cherry picked from commit 9c9899d5c99f09312a093b5cf99e5a0a9579bf3a)
- - - - -
77d67957 by Ben Gamari at 2023-04-13T18:32:14+05:30
nonmoving: Fix unregisterised build
(cherry picked from commit f2ef2f5e7a01cf5ec97b751f344233a6a8b781ca)
- - - - -
d292ffcb by Ben Gamari at 2023-04-13T18:32:14+05:30
nonmoving: Ensure that sanity checker accounts for saved_filled segments
(cherry picked from commit 7cc7461c74bf78aca0987c8e8e0ec48297c28f2c)
- - - - -
8ff50704 by Ben Gamari at 2023-04-13T18:32:14+05:30
nonmoving: Move allocator into new source file
(cherry picked from commit e6f7b809885609de9e647e7f96cc95929fde7a4a)
- - - - -
bb3d4605 by Ben Gamari at 2023-04-13T18:32:14+05:30
nonmoving: Split out nonmovingAllocateGC
(cherry picked from commit cfc68b5c9ee9000010ccb2b7f1d346542df3b79f)
- - - - -
b24b6f84 by Ben Gamari at 2023-04-13T18:32:14+05:30
testsuite: Mark ffi023 as broken due to #23089
(cherry picked from commit 600fdd58332e52ac1620178f4b4a296e131465a1)
- - - - -
3da2b1d2 by Ben Gamari at 2023-04-13T18:32:14+05:30
rts: Capture GC configuration in a struct
The number of distinct arguments passed to GarbageCollect was getting a
bit out of hand.
(cherry picked from commit ac0240af44026b9fcc08b62beef696ce7ea50e53)
- - - - -
1f3a993d by Ben Gamari at 2023-04-13T18:32:14+05:30
nonmoving: Non-concurrent collection
(cherry picked from commit be9b4ca4da78b10bc065957472ecf2c8ce7599a4)
- - - - -
a4700817 by Ben Gamari at 2023-04-13T18:32:14+05:30
hadrian: Add +boot_nonmoving_gc flavour transformer
For using GHC bootstrapping to validate the non-moving GC.
(cherry picked from commit ec382ccc087015db3d8782d3079c757ef8f10e9b)
- - - - -
005e6f32 by Ben Gamari at 2023-04-13T18:32:14+05:30
contextswitch
- - - - -
78d3f899 by Ben Gamari at 2023-04-13T18:32:14+05:30
rts: Fix incorrect format specifier warnings
- - - - -
c41c0fc0 by Zubin Duggal at 2023-04-13T18:32:14+05:30
compiler: Fix performance regression in backport of "Make FloatIn robust to shadowing" (6206cb9287f3f6e70c669660a646a65274870d2b)
In 9.4, we have
noFloatIntoArg :: CoreExprWithFVs' -> Type -> Bool
noFloatIntoArg expr expr_ty = ...
But in master when 6206cb92 landed, after "Drop the app invariant" (dcf30da8) we had
noFloatIntoArg :: CoreExprWithFVs' -> Bool
noFloatIntoArg expr = ...
When deciding whether to float things into the argument of a function, in 9.4 we
must know the type of the argument. This was previously done by extracting the
type of the argument from the function type, computed as we walked through all
the arguments.
However, this backport regressed compile time performance due to allocations by
`exprType` particularly in T16577 and T5642, where it turns out that computing
the type of the arguments to a function is quite expensive.
Instead, we can compute the type of the argument by looking at the argument
term directly, which turns out to be much faster and eliminates the performance
regression.
- - - - -
e34731c8 by Zubin Duggal at 2023-04-13T18:32:14+05:30
Prepare release 9.4.5
- - - - -
30 changed files:
- compiler/GHC/Core/Opt/FloatIn.hs
- configure.ac
- + docs/users_guide/9.4.5-notes.rst
- docs/users_guide/release-notes.rst
- hadrian/src/Flavour.hs
- libraries/base/changelog.md
- rts/Capability.c
- rts/Capability.h
- rts/HeapStackCheck.cmm
- rts/IOManager.c
- rts/PrimOps.cmm
- rts/Printer.c
- rts/Profiling.c
- rts/Proftimer.c
- rts/RetainerProfile.c
- rts/RtsAPI.c
- rts/RtsStartup.c
- rts/Schedule.c
- rts/Schedule.h
- rts/Sparks.h
- rts/Stats.c
- rts/Threads.c
- rts/Timer.c
- rts/TraverseHeap.c
- rts/eventlog/EventLog.c
- rts/include/rts/storage/ClosureMacros.h
- rts/include/rts/storage/GC.h
- rts/include/rts/storage/MBlock.h
- rts/include/stg/SMP.h
- rts/posix/Select.c
The diff was not included because it is too large.
View it on GitLab: https://gitlab.haskell.org/ghc/ghc/-/compare/f37378b34c34c193912760ef413ac72eb3457f2d...e34731c80cf08c6d31ab1dc8924525aace9b4990
--
View it on GitLab: https://gitlab.haskell.org/ghc/ghc/-/compare/f37378b34c34c193912760ef413ac72eb3457f2d...e34731c80cf08c6d31ab1dc8924525aace9b4990
You're receiving this email because of your account on gitlab.haskell.org.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.haskell.org/pipermail/ghc-commits/attachments/20230413/819924f6/attachment-0001.html>
More information about the ghc-commits
mailing list