Scrapy middleware which allows to crawl only new content
Here you can share your experience with the project you are suggesting or its comparison with scrapy-crawl-once. Optional.
A valid email to send you a verification link when necessary or log in.