Binyang Li 28a57b0610 NVLS support for msccl++ executor (#375) ...

- Support mote datatype for multicast operation
- Add new OP MULTI_LOAD_REDUCE_STORE to support NVLS
- Modify allocSharedPhysicalCuda, which return std::shared_ptr<T>
instead of std::shared_ptr<PhysicalCudaMemory>
- Add Python support for allocSharedPhysicalCuda

Test passed for `allreduce_nvls.json`

2024-11-20 06:43:28 +00:00

8.0 KiB

Raw Blame History

View Raw