Scrapy middleware which allows to crawl only new content
Why do you think that https://github.com/rmax/scrapy-redis is a good alternative to scrapy-crawl-once
Scrapy middleware which allows to crawl only new content
Why do you think that https://github.com/rmax/scrapy-redis is a good alternative to scrapy-crawl-once