Please enable JavaScript.
Coggle requires JavaScript to display documents.
scrapy, core, http, crawler, item, middleware, spiders, setting, selector,…
scrapy
core
engine.py
logger
Slot
inprogress
set()
ExecutionEngine
...
crawl
schedule
download
scheduler.py
spidermw.py
scraper.py
http2
downloader
http
common
cookies
headers
request
response
crawler
Crawler
crawl
_create_spider
_create_engine
stop
CrawlerRunner
CrawlerPorcess(CrawlerRunner)
item
middleware
spiders
setting
selector
utils
pipeline