Sunday, September 7, 2025

NCCL Logs analysis

###marvell-as-5126gs-tnrt2:469275:469441 [1] NCCL INFO Channel 00/0 : 1[1] -> 0[0] via P2P/CUMEM ---> GPU TO GPU with NVLINK ##-x NCCL_NET_GDR_LEVEL=5 ( Aumatically chooses dmabuf or gdrcopy) cavium-AS-5126GS-TNRT:513043:513095 [0] NCCL INFO Channel 00/0 : 0[0] -> 2[0] [receive] via NET/IB/0/GDRDMA---> GPUDirect ##-x NCCL_NET_GDR_LEVEL=0 ( Aumatically chooses dmabuf or gdrcopy) cavium-AS-5126GS-TNRT:517902:517951 [0] NCCL INFO Channel 00/0 : 0[0] -> 2[0] [receive] via NET/IB/0 ---> RDMA with GPUDirect

Featured Post

XDP - Getting Started with XDP (Linux)