David Sidler d8d0dfbffa Fix synchronization in allreduce8 kernel (#407) ...

Running kernel allreduce8 across 64 vGPUs (in CPX mode) revealed a
synchronization bug. The PR addresses it by ensuring that signals are
only issued after all threads in the block have issued their writes to
guarantee correct ordering between data writes and signal writes.

---------

Co-authored-by: Changho Hwang <changhohwang@microsoft.com>

2024-12-18 17:10:22 -08:00

..

nccl

Fix synchronization in allreduce8 kernel (#407)

2024-12-18 17:10:22 -08:00