Top 15 Go Scraper Projects
-
-
Project mention: First project - The API for engineering multiple choice questions | reddit.com/r/golang | 2022-05-08
There is the scraper struct that spawns goroutine. Then, each goroutine scraps the web URL using go colly, and the structured MCQ questions are served from API endpoints. Users can choose between persistent Postgres model or in-memory data structure to store the questions and retrieve them from API. I have used dependency injection to inject the models via the interface to my application struct.
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
-
Project mention: Rod - A Devtools driver for web automation and scraping | reddit.com/r/github_trends | 2022-04-29
-
-
-
-
Scout APM
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
-
-
GMDB
GMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)
-
dorkscout
DorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets
-
Project mention: GitHub - gnur/booksing: web-based epub indexer | reddit.com/r/selfhosted | 2021-09-21
Maybe https://github.com/gnur/demeter, from the same author?
-
torrodle
⚡️ A magnet link scraper for streaming videos (movies, tv shows, anime, porn) along with subtitles.
-
-
Project mention: Get high-quality movie snapshots from various websites | reddit.com/r/coolgithubprojects | 2021-10-14
-
Project mention: rrip - program to bulk-download images from reddit | reddit.com/r/golang | 2022-05-15
Go Scraper related posts
- rrip - program to bulk-download images from reddit
- First project - The API for engineering multiple choice questions
- How to collaborate on web scraping?
- How I Scraped Michelin Guide Using Go
-
lux VS youtube - a user suggested alternative
2 projects | 2 Feb 2022
- Terminal interface to search the LLVM-C API
- Terminal interface to search the LLVM-C API
Index
What are some of the best open-source Scraper projects in Go? This list will help you:
Project | Stars | |
---|---|---|
1 | lux | 17,804 |
2 | colly | 16,540 |
3 | Ferret | 4,973 |
4 | rod | 2,376 |
5 | Geziyor | 1,704 |
6 | finance-go | 542 |
7 | Dataflow kit | 514 |
8 | ant | 261 |
9 | GMDB | 214 |
10 | dorkscout | 170 |
11 | demeter | 160 |
12 | torrodle | 134 |
13 | llvm-c-search | 11 |
14 | moviestills | 7 |
15 | rrip | 2 |
Are you hiring? Post a new remote job listing for free.