scrapemate
crawley
scrapemate | crawley | |
---|---|---|
1 | 8 | |
59 | 232 | |
- | - | |
4.5 | 6.4 | |
12 days ago | about 1 month ago | |
Go | Go | |
MIT Licence | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
scrapemate
-
colly VS scrapemate - a user suggested alternative
2 projects | 15 Apr 2023
crawley
-
github/crawley v1.5.0 released
crawley project: https://github.com/s0rg/crawley
- What's the command to search specific string in all directories of a website?
-
crawley - the unix-way web-crawler
https://github.com/s0rg/crawley/releases/tag/v1.1.6 is online and have "-dirs" option, just for this task.
-
dl: Command-line file downloader tool
Also it's fun to require curl to install a download tool :D Maybe some more packaging options for Linux and MacOSX are in the pipe ? Something like that
- Crawley v1.0.0: fast unix-way web crawler/spider
What are some alternatives?
colly - Elegant Scraper and Crawler Framework for Golang
kafka-go - Kafka library in Go
webpalm - 🕸️ Crawl in the web network
cointop - A fast and lightweight interactive terminal based UI application for tracking cryptocurrencies 🚀
Geziyor - Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
Rich Interactive Widgets for Terminal UIs - Terminal UI library with rich, interactive widgets — written in Golang
ant - A web crawler for Go
go-prompt - Building powerful interactive prompts in Go, inspired by python-prompt-toolkit.
The Platinum Searcher - A code search tool similar to ack and the_silver_searcher(ag). It supports multi platforms and multi encodings.
termbox-go - Pure Go termbox implementation
termui - Golang terminal dashboard
tcell - Tcell is an alternate terminal package, similar in some ways to termbox, but better in others.