microsoft/mscclpp
1
0
Fork 0
mirror of https://github.com/microsoft/mscclpp.git synced 2026-07-15 19:54:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
495 Commits 125 Branches 17 Tags
a3cf48cc5d30cdf37bde82d089d0f5742101dd7d
Commit Graph

219 Commits

Author SHA1 Message Date
Binyang2014
a3cf48cc5d Rewrite mscclpp-test with cpp style API (#77) 
- Rewrite mscclpp-test with cpp style API
- Add SM copy
- add new sendRecv test
 2023-05-19 14:14:19 +08:00
Olli Saarikivi
4e4d1972e3 Cuda smart pointers 2023-05-16 16:16:00 -07:00
Olli Saarikivi
d83343ef4e Make getWc not return a void pointer 2023-05-16 22:52:38 +00:00
Olli Saarikivi
dee55997e9 Remove free and most reinterpret_casts in IB code 2023-05-16 22:48:16 +00:00
Saeed Maleki
6f7ca05305 Merge remote-tracking branch 'origin/api-extension' into saemal/offloading 2023-05-12 22:43:22 +00:00
Saeed Maleki
2a7b745972 fully working with double buffering 2023-05-12 22:42:22 +00:00
Saeed Maleki
2691784b88 working -- at least for single node 2023-05-12 20:21:58 +00:00
Saeed Maleki
62f96f316c Merge branch 'api-extension' into binyli/exception 2023-05-11 21:24:18 +00:00
Binyang Li
e63aae7142 Merge apt-extension 2023-05-11 09:20:41 +00:00
Binyang Li
785a973ace refine exception 2023-05-11 08:25:25 +00:00
Olli Saarikivi
9f6c48cbf9 Format all files 2023-05-11 00:23:14 +00:00
Olli Saarikivi
ccf45b33a2 Delete old init code and other C-style code 2023-05-10 22:03:42 +00:00
Olli Saarikivi
b2dfd8a8fe Merge branch 'api-extension' of https://github.com/microsoft/mscclpp into api-extension 2023-05-10 20:50:51 +00:00
Olli Saarikivi
beaf2aea39 Move public headers under include/ 2023-05-10 20:46:49 +00:00
Saeed Maleki
c05586f074 Merge branch 'api-extension' of https://github.com/microsoft/mscclpp into api-extension 2023-05-10 20:24:40 +00:00
Saeed Maleki
33eb4093ac timeout fix 2023-05-10 20:24:33 +00:00
Olli Saarikivi
75a2af8de2 Add GoogleTest with CTest integration + some tests 
Also rename addSetup to onSetup to unify naming.
 2023-05-10 18:46:55 +00:00
Saeed Maleki
1769138568 Host Epoch + Error code 2023-05-09 23:10:12 +00:00
Saeed Maleki
8b384600a9 host epoch works 2023-05-09 22:17:43 +00:00
Binyang Li
9c40d616d9 Merge main branch 2023-05-09 10:59:04 +00:00
Binyang2014
8650dbaff8 Add exception class for mscclpp (#67) 
Add exception class for mscclpp
 2023-05-06 16:27:25 +08:00
Saeed Maleki
9fb29f9dfc timeout for flush 2023-05-04 17:48:24 +00:00
Saeed Maleki
7af687954c removing old mscclppComm_t comm from communicator 2023-05-03 20:23:51 +00:00
Olli Saarikivi
4a41c19e72 Fix performance bug and base pointer offset 2023-05-03 19:40:23 +00:00
Olli Saarikivi
81e7d1b344 Channels work 2023-05-03 17:11:25 +00:00
Saeed Maleki
6002a520b6 solved merge conflict 2023-05-02 23:56:11 +00:00
Saeed Maleki
54d1e1872c testing writes with signal is passing 2023-05-02 23:53:31 +00:00
Olli Saarikivi
4ba8516832 allgather_test_cpp functional again 2023-05-02 23:14:13 +00:00
Saeed Maleki
a4e6ffe2bc epoch creation 2023-05-02 21:39:43 +00:00
Olli Saarikivi
c44b48b361 Epoch non-copyable 2023-05-02 21:38:26 +00:00
Olli Saarikivi
66ce01baf3 Make NonblockingFuture copyable 2023-05-02 20:46:30 +00:00
Olli Saarikivi
358c3d62b8 Generalize connectionSetup() into setup() 2023-05-02 20:06:30 +00:00
Saeed Maleki
88426ad83a bug fix for ib memory registeration 2023-05-01 21:07:12 +00:00
Olli Saarikivi
04e878489d Work on a channel service 2023-04-28 22:50:38 +00:00
Binyang Li
cbefe38fd4 aad conn write test 2023-04-28 09:12:21 +00:00
Olli Saarikivi
fa0fcb470e Lazy CUDA IPC handle opening 2023-04-28 00:30:07 +00:00
Saeed Maleki
82c27625e6 ipc uses a base ptr now 2023-04-27 21:33:15 +00:00
Saeed Maleki
e18e26dcc7 tests for host hash 2023-04-27 20:09:47 +00:00
Saeed Maleki
aaa3f0e945 host hashes in communicator 2023-04-27 19:17:19 +00:00
Olli Saarikivi
06c6df2350 Separate out Transport and TransportFlags 2023-04-27 19:06:35 +00:00
Saeed Maleki
8eda6369ee testing connection setup 2023-04-27 06:08:35 +00:00
Changho Hwang
b0c7e86909 Communicator owns IB contexts 2023-04-27 05:01:07 +00:00
Saeed Maleki
7913d90158 Merge branch 'olli/api-extension' of https://github.com/microsoft/mscclpp into olli/api-extension 2023-04-27 04:16:41 +00:00
Saeed Maleki
7641038246 wip 2023-04-27 04:15:24 +00:00
Changho Hwang
08e80f1754 IB: completely replaced with C++ interfaces 2023-04-27 04:01:46 +00:00
Olli Saarikivi
47d4606f13 Add registerMemory 2023-04-27 00:33:24 +00:00
Saeed Maleki
7a865d96d7 merged with saemal/api-extension 2023-04-26 23:24:31 +00:00
Olli Saarikivi
5443ed1ec2 ConnectionSetup stuff 2023-04-26 18:07:17 +00:00
Olli Saarikivi
d746201287 WIP builds, but doesn't link 2023-04-26 17:46:47 +00:00
Changho Hwang
c3cb81a906 Fix putDirect (#62) 
`ring_send_recv_test_perf` result (1 node 8 gpus):

```
# minBytes 1024 maxBytes 1024 step: 1048576(bytes) warmup iters: 10 iters: 100 validation: 1 graph: 1, kernel num: 0
#
# Using devices
#  Rank  0 Pid 365596 on costsim-dev-00000A device  0 [0001:00:00.0] NVIDIA A100-SXM4-80GB
#  Rank  1 Pid 365597 on costsim-dev-00000A device  1 [0002:00:00.0] NVIDIA A100-SXM4-80GB
#  Rank  2 Pid 365598 on costsim-dev-00000A device  2 [0003:00:00.0] NVIDIA A100-SXM4-80GB
#  Rank  3 Pid 365599 on costsim-dev-00000A device  3 [0004:00:00.0] NVIDIA A100-SXM4-80GB
#  Rank  4 Pid 365600 on costsim-dev-00000A device  4 [000B:00:00.0] NVIDIA A100-SXM4-80GB
#  Rank  5 Pid 365602 on costsim-dev-00000A device  5 [000C:00:00.0] NVIDIA A100-SXM4-80GB
#  Rank  6 Pid 365603 on costsim-dev-00000A device  6 [000D:00:00.0] NVIDIA A100-SXM4-80GB
#  Rank  7 Pid 365605 on costsim-dev-00000A device  7 [000E:00:00.0] NVIDIA A100-SXM4-80GB
#
# Initializing MSCCL++
# Setting up the connection in MSCCL++
# Launching MSCCL++ proxy threads
#
#                                    in-place                       out-of-place          
#       size         count     time   algbw   busbw  #wrong     time   algbw   busbw  #wrong
#        (B)    (elements)     (us)  (GB/s)  (GB/s)            (us)  (GB/s)  (GB/s)       
        1024           256    31.70    0.26    0.23      0
Stopping MSCCL++ proxy threads
# Out of bounds values : 0 OK
#
```
 2023-04-26 18:19:13 +08:00