CUDA Error: illegal error memory access 踩坑

笔者在实现一个transformer时,将nn.LayerNorm()层放到了Add_Norm模块的forward函数里,将模型搬到GPU上时一直报错,排查以后尝试将nn.LayerNorm替换为F.layer_norm,就没问题了!

猜你喜欢

转载自blog.csdn.net/kr2563/article/details/121587611