scrapy日常 常用命令

🧙 Questions

☄️ Ideas

初始化项目

Note: 项目名称不可以包含中划线

scrapy startproject leo_day_scrapy

查询爬虫程序

scrapy list

添加爬虫程序

# cd leo_day_scrapy/spiders
# scrapy genspider -t crawl scrapy_baidu https://www.baidu.com/ 
scrapy genspider -t crawl ${moudle} ${http}

运行你的爬虫

scrapy crawl baidu_spider

🔗 Links

• scrapy website
• scrapy docs website
• mysql