microsoft/mscclpp
1
0
Fork 0
mirror of https://github.com/microsoft/mscclpp.git synced 2026-05-03 13:11:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Pytest (#162)

Browse Source 
Port python tests to mscclpp.
Please run
`mpirun -tag-output -np 8 pytest ./python/test/test_mscclpp.py -x` to start pytest

---------

Co-authored-by: Saeed Maleki <saemal@microsoft.com>
Co-authored-by: Changho Hwang <changhohwang@microsoft.com>
Co-authored-by: Saeed Maleki <30272783+saeedmaleki@users.noreply.github.com>
This commit is contained in:
Binyang2014
2023-09-01 21:22:11 +08:00
committed by GitHub
parent 3df18d20a3
commit 858e381829
39 changed files with 1186 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files

22
python/test/proxy_test.cu Normal file
View File

@@ -0,0 +1,22 @@
// Copyright (c) Microsoft Corporation.
// Licensed under the MIT license.
#include <mscclpp/fifo_device.hpp>
#include <mscclpp/semaphore_device.hpp>
extern "C" __global__ void __launch_bounds__(1024, 1) proxy(int my_rank, int nranks, mscclpp::FifoDeviceHandle fifo,
mscclpp::Host2DeviceSemaphoreDeviceHandle* semaphores) {
int tid = threadIdx.x;
if (tid == 0) {
mscclpp::ProxyTrigger trigger;
trigger.fst = 123;
trigger.snd = 0;
uint64_t currentFifoHead = fifo.push(trigger);
// wait for the work to be done in cpu side
fifo.sync(currentFifoHead);
}
__syncthreads();
if (tid < nranks && tid != my_rank) {
semaphores[tid].wait();
}
}