在訓練Densefusion模型時報錯RuntimeError: cuDNN error:CUDNN_STATUS_MAPPING_ERROR
使用torch.backends.cudnn.enabled = False禁用cudnn后報錯:
RuntimeError: cublas runtime error : the GPU program failed to execute at /pytorch/aten/src/THC/THCBlas.cu:258
環境配置:
顯卡為RTX 3080
cuda:11.1
cudnn:8.0.5
pytorch:1.0.0
具體報錯信息:
Traceback (most recent call last): File "./tools/train.py", line 256, in <module> main() File "./tools/train.py", line 154, in main pred_r, pred_t, pred_c, emb = estimator(img, points, choose, idx) File "/home/xsy/anaconda3/envs/pytorch1.0/lib/python3.5/site-packages/torch/nn/modules/module.py", line 489, in __call__ result = self.forward(*input, **kwargs) File "/home/xsy/Object-RPE-master/DenseFusion/lib/network.py", line 98, in forward out_img = self.cnn(img) File "/home/xsy/anaconda3/envs/pytorch1.0/lib/python3.5/site-packages/torch/nn/modules/module.py", line 489, in __call__ result = self.forward(*input, **kwargs) File "/home/xsy/Object-RPE-master/DenseFusion/lib/network.py", line 38, in forward x = self.model(x) File "/home/xsy/anaconda3/envs/pytorch1.0/lib/python3.5/site-packages/torch/nn/modules/module.py", line 489, in __call__ result = self.forward(*input, **kwargs) File "/home/xsy/anaconda3/envs/pytorch1.0/lib/python3.5/site-packages/torch/nn/parallel/data_parallel.py", line 141, in forward return self.module(*inputs[0], **kwargs[0]) File "/home/xsy/anaconda3/envs/pytorch1.0/lib/python3.5/site-packages/torch/nn/modules/module.py", line 489, in __call__ result = self.forward(*input, **kwargs) File "/home/xsy/Object-RPE-master/DenseFusion/lib/pspnet.py", line 65, in forward f, class_f = self.feats(x) File "/home/xsy/anaconda3/envs/pytorch1.0/lib/python3.5/site-packages/torch/nn/modules/module.py", line 489, in __call__ result = self.forward(*input, **kwargs) File "/home/xsy/Object-RPE-master/DenseFusion/lib/extractors.py", line 115, in forward x = self.conv1(x) File "/home/xsy/anaconda3/envs/pytorch1.0/lib/python3.5/site-packages/torch/nn/modules/module.py", line 489, in __call__ result = self.forward(*input, **kwargs) File "/home/xsy/anaconda3/envs/pytorch1.0/lib/python3.5/site-packages/torch/nn/modules/conv.py", line 320, in forward self.padding, self.dilation, self.groups) RuntimeError: cuDNN error: CUDNN_STATUS_MAPPING_ERROR
請教一下大神們,這怎么解決?