爬虫的浏览器伪装技术代码实例

版权声明:未经同意窃取和转载我的内容,如果涉及到权益问题,后果自负! https://blog.csdn.net/weixin_41605937/article/details/84311941
"""浏览器伪装"""
url="https://blog.csdn.net/weixin_41605937"
urllib.request.urlopen(url)
#这个是报头
headers=("User-Agent","Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36 SE 2.X MetaSr 1.0")
opener=urllib.request.build_opener()#用来添加报头信息
opener.add_handlers=[headers]#添加报头
data=opener.open(url).read()
file=open("D:/PythonFile/数据挖掘/网页作业2.html","wb")
file.write(data)
file.close()

猜你喜欢

转载自blog.csdn.net/weixin_41605937/article/details/84311941