Scrapy middleware which allows to crawl only new content
Why do you think that https://github.com/my8100/scrapydweb is a good alternative to scrapy-crawl-once
Scrapy middleware which allows to crawl only new content
Why do you think that https://github.com/my8100/scrapydweb is a good alternative to scrapy-crawl-once