Pholcus
Pholcus is a distributed high-concurrency crawler software written in pure golang (by andeya)
Geziyor
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering. (by geziyor)
Our great sponsors
| Pholcus | Geziyor | |
|---|---|---|
| - | 2 | |
| 7,504 | 2,472 | |
| - | 1.1% | |
| 0.0 | 0.6 | |
| over 1 year ago | 6 months ago | |
| Go | Go | |
| Apache License 2.0 | Mozilla Public License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Pholcus
Posts with mentions or reviews of Pholcus.
We have used some of these posts to build our list of alternatives
and similar projects.
We haven't tracked posts mentioning Pholcus yet.
Tracking mentions began in Dec 2020.
Geziyor
Posts with mentions or reviews of Geziyor.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-13.
-
Show HN: I scraped 25M Shopify products to build a search engine
As someone who has scraped millions of items myself, I had success using Geziyor (https://github.com/geziyor/geziyor) built in Go. Shopify sites are especially easy to scrape because they tend to share the same product data formatting and don't hide it behind JS rendering.
-
Show HN: Flyscrape – A standalone and scriptable web scraper in Go
Its been 8+ years since i started scraping. I even wrote a popular Go web scraping framework previously: (https://github.com/geziyor/geziyor).
These days, I'm not even using Go for scraping, as the webpage changes makes me crazy, so I moved to Typescript+Playwright. (Crawlee framework is cool, while not strictly necessary).
My favorite stack as of 2023: TypeScript+Playwright+Crawlee(Optional)
What are some alternatives?
When comparing Pholcus and Geziyor you can also consider the following projects:
colly - Elegant Scraper and Crawler Framework for Golang
gichidan - Gichidan - CLI wrapper for Ichidan deep-web search engine.
jsonrpconion - Library for building JSON RPC services on Tor network
Ferret - Declarative web scraping
google-search-results-golang - Google Search Results GoLang API
gopixabay