https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#removing-cuda-tk-and-driver
RHEL/CentOS
To remove CUDA Toolkit:
$ sudo yum remove "*cublas*" "cuda*"To remove NVIDIA Drivers:
$ sudo yum remove "*nvidia*"
或者
sudo /usr/bin/nvidia-uninstall