Scratch command

One 、 Global command

1-startproject

Create a new Scrapy project ：

scrapy startproject <project_name> [project_dir]

for example ：scrapy startproject Crawler51job

【 Be careful 】 The project name cannot start with a number  

2-genspider

In the current folder or current project , Create a new crawler file

scrapy genspider [-t template] <name> <domain>

for example ：scrapy genspider -t basic spider51job 51job.com

other template See the help document for parameters

3-runspider

Run a crawler file

scrapy runspider <spider_file.py>

for example ;scrapy runspider test51job.py

4-fetch

Get the specified URL, And it can show the process of acquisition

scrapy fetch <url>

for example ：scrapy fetch https://www.baidu.com

5-view

Open the specified... In the browser URL

scrapy view <url>

scrapy view https://www.baidu.com

6-version

Print out Scrapy Version number

scrapy version [-v]

scrapy version -v

Two 、 Project Command

1-crawl

Run the crawler project

scrapy crawl <spider>

for example ：scrapy crawl spider51job [--nolog]

2-bench

Test local hardware performance

scrapy bench

3-list

List all crawler files under the current project

scrapy list