1. Install scrapy
1. Linux environment
yum install python34-devel epel-release libxslt-devel libxml2-devel openssl-devel
pip install Scrapy -i http://pypi.douban.com/simple/ --trusted-host pypi.douban.com
There may be an error here:
Download error on https://pypi.python.org/simple/incremental/: [Errno 97] Address family not supported by protocol -- Some packages may not be found! Couldn't find index page for 'incremental' (maybe misspelled?) Download error on https://pypi.python.org/simple/: [Errno 97] Address family not supported by protocol -- Some packages may not be found! No local packages or working download links found for incremental>=16.10.1
......
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-bkql5v24/Twisted/
Solution:
Install incremental first pip install --upgrade incremental -i http: // pypi.douban.com/simple/ --trusted-host pypi.douban.com After installing scrapy, there will be no error!
2. Windows environment
pip install Scrapy
2. Use scrapy
To be continued. . .