"RuntimeError: Distributed package doesn't have NCCL built in" error when running PyTorch

When I am running PyTorch code from another server, this exception just happens.

1 Answer

You must install NVIDIA's NCCL on your machine. This will require CUDA to be installed also. Follow the steps on NVIDIA's website:

NCCL Installation Guide