关于Bias的问题 Should the convolution layers have biases?

You can access to [https://github.com/KaimingHe/deep-residual-networks/issues/10#issuecomment-194037195]

在复现WRN网络时,发现Resnet部分没有使用bias

观点:
Biases are in the BN layers that follow.
BN层的作用相当于bias, 因此可以不使用bias

Recently, I am converting this caffe model to Tensorpack model and I found that the conv1 in resnet-50 has bias term, however the resnet-101 and resnet-152 do not have bias in conv1. I don’t think bias is necessary, since there are BN layers. Any reason?
在有BN层的情况下,bias变得不重要(有的地方有有的没有)

猜你喜欢

转载自blog.csdn.net/transMaple/article/details/79733418