ant
A web crawler for Go (by yields)
Geziyor
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering. (by geziyor)
ant | Geziyor | |
---|---|---|
4 | 2 | |
276 | 2,480 | |
- | 0.6% | |
0.0 | 0.6 | |
12 months ago | 7 months ago | |
Go | Go | |
MIT License | Mozilla Public License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ant
Posts with mentions or reviews of ant.
We have used some of these posts to build our list of alternatives
and similar projects.
Geziyor
Posts with mentions or reviews of Geziyor.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-13.
-
Show HN: I scraped 25M Shopify products to build a search engine
As someone who has scraped millions of items myself, I had success using Geziyor (https://github.com/geziyor/geziyor) built in Go. Shopify sites are especially easy to scrape because they tend to share the same product data formatting and don't hide it behind JS rendering.
-
Show HN: Flyscrape – A standalone and scriptable web scraper in Go
Its been 8+ years since i started scraping. I even wrote a popular Go web scraping framework previously: (https://github.com/geziyor/geziyor).
These days, I'm not even using Go for scraping, as the webpage changes makes me crazy, so I moved to Typescript+Playwright. (Crawlee framework is cool, while not strictly necessary).
My favorite stack as of 2023: TypeScript+Playwright+Crawlee(Optional)
What are some alternatives?
When comparing ant and Geziyor you can also consider the following projects:
crawlab - Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
colly - Elegant Scraper and Crawler Framework for Golang