A multi threaded web crawler library that is generic enough to allow different engines to be swapped in.
Here you can share your experience with the project you are suggesting or its comparison with Spidey. Optional.
A valid email to send you a verification link when necessary or log in.