Geziyor
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering. (by geziyor)
Pholcus
Pholcus is a distributed high-concurrency crawler software written in pure golang (by andeya)
Our great sponsors
| Geziyor | Pholcus | |
|---|---|---|
| 2 | - | |
| 2,472 | 7,504 | |
| 1.1% | - | |
| 0.6 | 0.0 | |
| 6 months ago | over 1 year ago | |
| Go | Go | |
| Mozilla Public License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Geziyor
Posts with mentions or reviews of Geziyor.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-13.
-
Show HN: I scraped 25M Shopify products to build a search engine
As someone who has scraped millions of items myself, I had success using Geziyor (https://github.com/geziyor/geziyor) built in Go. Shopify sites are especially easy to scrape because they tend to share the same product data formatting and don't hide it behind JS rendering.
-
Show HN: Flyscrape – A standalone and scriptable web scraper in Go
Its been 8+ years since i started scraping. I even wrote a popular Go web scraping framework previously: (https://github.com/geziyor/geziyor).
These days, I'm not even using Go for scraping, as the webpage changes makes me crazy, so I moved to Typescript+Playwright. (Crawlee framework is cool, while not strictly necessary).
My favorite stack as of 2023: TypeScript+Playwright+Crawlee(Optional)
Pholcus
Posts with mentions or reviews of Pholcus.
We have used some of these posts to build our list of alternatives
and similar projects.
We haven't tracked posts mentioning Pholcus yet.
Tracking mentions began in Dec 2020.
What are some alternatives?
When comparing Geziyor and Pholcus you can also consider the following projects:
colly - Elegant Scraper and Crawler Framework for Golang
jsonrpconion - Library for building JSON RPC services on Tor network
gichidan - Gichidan - CLI wrapper for Ichidan deep-web search engine.
Ferret - Declarative web scraping
google-search-results-golang - Google Search Results GoLang API
gopixabay