awesome-crawler
A collection of awesome web crawler,spider in different languages (by BruceDone)
awesome
🌟 My Awesome Repositories List. Automatically updates by GitHub Actions on UTC 00:00 & 16:00 (by erbanku)
awesome-crawler | awesome | |
---|---|---|
7 | 7 | |
6,122 | 51 | |
- | - | |
1.5 | 9.6 | |
about 1 month ago | 2 days ago | |
MIT License | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-crawler
Posts with mentions or reviews of awesome-crawler.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-04-11.
- More than 400 start.me OSINT websites! More than 10KB of sources!
- The new biggest OSINT list! 302+ pages worth of OSINT, SOCMINT and CSINT! The largest list of OSINT sources with thousands of sources! Better than the last one! Better than downtown_soup! Better than the last two! More than 10KB of OSINT sources!
- 225 LINE OSINT LIST BIGGEST OF THEM ALL!
- The new biggest OSINT list! 209 pages worth of OSINT, SOCMINT and CSINT! The truly largest OSINT list with thousands of sources! 8KB of SOCMINT sources
- LARGEST OSINT LIST PT 2
- 79 OSINT start.me, github, wayback etc pages (thousands of OSINT and CSINT sources). 5KB of start.me pages, OSINT sources, CSINT, SOCMINT etc... More than 10K sources & websites in the pages!
- Possibly Largest Osint List
awesome
Posts with mentions or reviews of awesome.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-04-11.
- More than 400 start.me OSINT websites! More than 10KB of sources!
- The new biggest OSINT list! 302+ pages worth of OSINT, SOCMINT and CSINT! The largest list of OSINT sources with thousands of sources! Better than the last one! Better than downtown_soup! Better than the last two! More than 10KB of OSINT sources!
- 225 LINE OSINT LIST BIGGEST OF THEM ALL!
- The new biggest OSINT list! 209 pages worth of OSINT, SOCMINT and CSINT! The truly largest OSINT list with thousands of sources! 8KB of SOCMINT sources
- LARGEST OSINT LIST PT 2
- 79 OSINT start.me, github, wayback etc pages (thousands of OSINT and CSINT sources). 5KB of start.me pages, OSINT sources, CSINT, SOCMINT etc... More than 10K sources & websites in the pages!
- Possibly Largest Osint List
What are some alternatives?
When comparing awesome-crawler and awesome you can also consider the following projects:
offensive-ai-compilation - A curated list of useful resources that cover Offensive AI.
Awesome-Geospatial - Long list of geospatial tools and resources
the-book-of-secret-knowledge - A collection of inspiring lists, manuals, cheatsheets, blogs, hacks, one-liners, cli/web tools and more.
awesome-threat-intelligence - A curated list of Awesome Threat Intelligence resources
awesome-list - Cybersecurity oriented awesome list
Awesome-Cybersecurity-Handbooks - A huge chunk of my personal notes since I started playing CTFs and working as a Red Teamer.
Super_Cool_Links_By_Sera - A collection of awesome links I've compiled that are related to cybersecurity.
OSINT_Inception-links - Current links from the OSINT Inception start-me project
awesome-crawler vs offensive-ai-compilation
awesome vs Awesome-Geospatial
awesome-crawler vs the-book-of-secret-knowledge
awesome vs awesome-threat-intelligence
awesome-crawler vs awesome-list
awesome vs the-book-of-secret-knowledge
awesome-crawler vs Awesome-Geospatial
awesome vs offensive-ai-compilation
awesome-crawler vs Awesome-Cybersecurity-Handbooks
awesome vs Super_Cool_Links_By_Sera
awesome-crawler vs Super_Cool_Links_By_Sera
awesome vs OSINT_Inception-links