xurlfind3r
gogetcrawl
xurlfind3r | gogetcrawl | |
---|---|---|
1 | 1 | |
524 | 126 | |
1.3% | - | |
8.0 | 5.2 | |
3 months ago | 11 months ago | |
Go | Go | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
xurlfind3r
gogetcrawl
-
A tool/package for Web Archive data extraction
I've developed yet another solution that can help you extract data from web archives :) You can use it as a separate tool, or import it into your Go project. Github: https://github.com/karust/gogetcrawl
What are some alternatives?
gau - Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.
ghost - Use ghost for passive recon: get the Wayback Machine history for a URL, search for term(s) or regular expression matches, save all archived links, save an archived robots.txt and sitemap.xml, run a whois lookup, and get IP addresses, all without touching the target.
uncover - Quickly discover exposed hosts on the internet using multiple search engines.
colly - Elegant Scraper and Crawler Framework for Golang
SatIntel - SatIntel is an OSINT tool for Satellites 🛰. Extract satellite telemetry, receive orbital predictions, and parse TLEs 🔭
Ferret - Declarative web scraping
TeamsUserEnum - User enumeration with Microsoft Teams API
lux - 👾 Fast and simple video download library and CLI tool written in Go
goSCF - Session Cookie Finder
Rendora - dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites
udon - A simple tool that helps to find assets/domains based on the Google Analytics ID.