Article directory
foreword
How a programmer who has just reached the threshold level of python uses crawlab to crawl the website, here is a graphic tutorial to record it.
提示：这里做一个简单的网站爬取完整示例图文教程
1. Create a project
- First, we will create a Scrapy project, let's start by installing Scrapy.
pip install scrapy
- Then, create a Scrapy project called scrapy_quotes.
scrapy startproject scrapy_quotes
现在您应该可以看到新创建爬虫的目录结构。
- Then execute the following command