prettybenchcmp
chromedp
| prettybenchcmp | chromedp | |
|---|---|---|
| - | 29 | |
| 18 | 11,177 | |
| - | 1.5% | |
| 0.0 | 5.0 | |
| over 8 years ago | about 1 month ago | |
| Go | Go | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
prettybenchcmp
We haven't tracked posts mentioning prettybenchcmp yet.
Tracking mentions began in Dec 2020.
chromedp
-
Rustify some puppeteer code
To my surprise the code was closer in structure to the puppeteer version than it was to the chromedp. The chromedp version uses nested context declarations to manage the browser and page runtimes, the rust version uses a more linear approach. You construct a browser instance and then you can interact with it as a user would. This points at the fact that the chromiumoxide api is higher level.
-
Gopherizing some puppeteer code
Looking at the alternatives there are two that stand out chromedp and rod. Rod looks like it is the prodigal son of behave and cucumber some well established BDD frameworks. Personally I am not finding the MustYaddaYadda... very readable and combining it with other custom APIs would probably make it become inconsistent. It has a few nice things in the way it abstracts iframes but I am just unable to go past the higher level API.
- Web scraping with Go
-
Web Crawler in Go: Extracting Keyword-Relevant Text with Text Density
There are a billion things that you need to consider when building a decent web crawler, especially interacting with pages in the modern web. For example, a lot of content is dynamically loaded by the browser nowadays, and won't show up if you make a simple HTTP request. Open your browser devtools and look at the network tab after you make a request, and you'll see it makes loads of auxiliary requests. Some content is also only loaded after you interact with it (e.g. hover, click). For that reason I'd recommend using something like chromedp and do browser based crawling, even if it's much slower.
-
How can I do infinte scroll with go http
You could use something like the chrome dev tools (https://github.com/chromedp/chromedp) or look into JS runtimes in Go and try to handle the I/O yourself.
-
Web Automation: Don't Use Selenium, Use Playwright
Thanks. I've found Chromedp [0] to be a good Selenium replacement when programming in Go. Used in conjunction with HeadlessShell [1] you can deploy a Go app into a container and do the testing all within the same container with low overhead.
[0] https://github.com/chromedp/chromedp
-
Run single JS func in Go app
Is it node specific? Could you just use https://github.com/chromedp/chromedp and run it as an actually webpage and get the value from that?
-
Thoughts on Go headless browser tools for testing and scraping?
It looks like https://github.com/chromedp/chromedp is the most popular option. There's also https://github.com/playwright-community/playwright-go. Any thoughts or advice about using these tools?
- Is it possible to scrape a website protected by Cloudflare?
- Is there a library similar to HTMLUnit in GO?
What are some alternatives?
selenoid - Selenium Hub successor running browsers within containers. Scalable, immutable, self hosted Selenium-Grid on any platform with single binary.
rod - A Chrome DevTools Protocol driver for web automation and scraping.
govcr - HTTP mock for Golang: record and replay HTTP/HTTPS interactions for offline testing
go-selenium - Selenium WebDriver client for Go
cdp - Package cdp provides type-safe bindings for the Chrome DevTools Protocol (CDP), written in the Go programming language.
counterfeiter - A tool for generating self-contained, type-safe test doubles in go
playwright-go - Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a single API.
gofuzz - Fuzz testing for go.
colly - Elegant Scraper and Crawler Framework for Golang
mockhttp - Mock object for Go http.ResponseWriter
gomate.io - Behavior-driven development tool for GoLang