版权声明:转载请声明原文链接地址,谢谢! https://blog.csdn.net/weixin_42859280/article/details/84481289
执行:
>scrapy crawl demo
可能会出现这个错误:
import win32api
ModuleNotFoundError: No module named 'win32api'
下载依赖呗:https://pypi.org/project/pywin32/#files
我的3.7的:https://download.csdn.net/download/weixin_42859280/10805889
安装代码:
C:\>pip install C:\Users\HWP\Desktop\pywin32-224-cp37-cp37m-win_amd64.whl#这个是路径!
Processing c:\users\hwp\desktop\pywin32-224-cp37-cp37m-win_amd64.whl
Installing collected packages: pywin32
Successfully installed pywin32-224
C:\>
效果图:
(虽然Windows系统里面有好多这个文件,但是只有这个可以安装成功!)
上面那个就是失败的尝试!下面的是成功的!
安装之后再次执行:
(代码很长,我就挑个重要的吧)
{'downloader/request_bytes': 864,
'downloader/request_count': 4,
'downloader/request_method_count/GET': 4,
'downloader/response_bytes': 64432,
'downloader/response_count': 4,
'downloader/response_status_count/200': 1,
'downloader/response_status_count/301': 2,
'downloader/response_status_count/404': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2018, 11, 25, 4, 4, 18, 108527),
'log_count/DEBUG': 5,
'log_count/INFO': 7,
'response_received_count': 2,
'scheduler/dequeued': 2,
'scheduler/dequeued/memory': 2,
'scheduler/enqueued': 2,
'scheduler/enqueued/memory': 2,
'start_time': datetime.datetime(2018, 11, 25, 4, 4, 16, 336964)}
2018-11-25 12:04:18 [scrapy.core.engine] INFO: Spider closed (finished)
成功解决后:
已经可以看到scrapy爬取的网页啦!