chromedp
star-history
Our great sponsors
chromedp | star-history | |
---|---|---|
27 | 36 | |
10,341 | 5,809 | |
2.0% | 4.3% | |
5.5 | 8.9 | |
13 days ago | 6 days ago | |
Go | TypeScript | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
chromedp
- Web scraping with Go
-
Web Crawler in Go: Extracting Keyword-Relevant Text with Text Density
There are a billion things that you need to consider when building a decent web crawler, especially interacting with pages in the modern web. For example, a lot of content is dynamically loaded by the browser nowadays, and won't show up if you make a simple HTTP request. Open your browser devtools and look at the network tab after you make a request, and you'll see it makes loads of auxiliary requests. Some content is also only loaded after you interact with it (e.g. hover, click). For that reason I'd recommend using something like chromedp and do browser based crawling, even if it's much slower.
-
How can I do infinte scroll with go http
You could use something like the chrome dev tools (https://github.com/chromedp/chromedp) or look into JS runtimes in Go and try to handle the I/O yourself.
-
Web Automation: Don't Use Selenium, Use Playwright
Thanks. I've found Chromedp [0] to be a good Selenium replacement when programming in Go. Used in conjunction with HeadlessShell [1] you can deploy a Go app into a container and do the testing all within the same container with low overhead.
[0] https://github.com/chromedp/chromedp
-
Run single JS func in Go app
Is it node specific? Could you just use https://github.com/chromedp/chromedp and run it as an actually webpage and get the value from that?
-
Thoughts on Go headless browser tools for testing and scraping?
It looks like https://github.com/chromedp/chromedp is the most popular option. There's also https://github.com/playwright-community/playwright-go. Any thoughts or advice about using these tools?
- Is it possible to scrape a website protected by Cloudflare?
- Is there a library similar to HTMLUnit in GO?
-
Easiest way to MITM my browser requests/responses using Go
The alternative is to drive, for example, Chrome with the DevTools protocol (using something like https://github.com/chromedp/chromedp or https://github.com/raff/godet (this is my version of a DevTools driver).
- Web scraping libraries
star-history
-
Show HN: I've built a locally running perplexity clone
That’s a great project you pulled off. From the time I starred it (10-12h ago I think), and upon re-checking this post, you gained 500+ stars lol.
Visualized in a chart with star-history: https://star-history.com/#nilsherzig/LLocalSearch
-
What I learned from looking at 900 most popular open source AI tools
You can actively see a fresh "hype curve" in the transformer-debugger repo that was posted a couple days ago (https://github.com/openai/transformer-debugger) (star history https://star-history.com/#openai/transformer-debugger&Date).
Regardless of the repo's stars or how valuable it really is, at the time I saw it posted to HN, it had 1.6k stars/16 hours. What channel are people listening to to star it so quickly. I'm not implying any nefariousness, mind you, I'm only wondering where all the stargazers were referred from so fast and in such volume.
-
What I learned in 6 months of working on a CodeGen dev tool GPT Pilot
I’ve been releasing open-source projects for years now, and I’ve always wanted to see how fast my Github repo is growing compared to other successful repositories on https://star-history.com/. The problem is that on Star History, I’m unable to zoom into the graph, so a new repo that has 1,000 stars cannot be compared with a big repo that has 50,000 because you can’t see how the bigger repo does in its beginning. So, I asked GPT Pilot to build this functionality. It scrapes Github repos for stargazers, saves them into the database, plots them on a graph, and enables the graph to be zoomed in and out.
-
Htmx is a great front-end library, but its x account is full of memes
i'm a one man shop in montana, competing w/ Google, Vercel & Facebook for dev mindshare
if i did what everyone else does you never would have heard of htmx
https://star-history.com/#bigskysoftware/htmx&Date
-
Htmx and Web Components: A Perfect Match
also: https://star-history.com/#bigskysoftware/htmx&facebook/react...
-
Show HN: Like-History.ai
Similar to http://star-history.com for GitHub repos, http://like-history.ai is a tool to help generate the like history of projects on HuggingFace.co
More details: https://twitter.com/Tim_Qian/status/1730245069259575485
- Star History: the missing GitHub star history graph of GitHub repos
-
Htmx is part of the GitHub Accelerator
yeah, he was the one that really started the madness:
https://star-history.com/#bigskysoftware/htmx&bigskysoftware...
his video posted on july 7th
-
Startups are in first batch of GitHub OS Accelerator
Github star history graph of the batch:
https://star-history.com/#trpc/trpc&termux/termux-app&respon...
- Cursor: A code editor built for programming with AI
What are some alternatives?
rod - A Devtools driver for web automation and scraping
receiptline - Markdown for receipts. Printable digital receipts. Generate receipt printer commands and images.
go-selenium - Selenium WebDriver client for Go
starred - creating your own Awesome List by GitHub stars!
cdp - Package cdp provides type-safe bindings for the Chrome DevTools Protocol (CDP), written in the Go programming language.
redux-undo - :recycle: higher order reducer to add undo/redo functionality to redux state containers
playwright-go - Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a single API.
timeonsite - Timeonsitetracker.js - Modern & accurate "Time on site" tracking for web and mobile browsers
colly - Elegant Scraper and Crawler Framework for Golang
robusta - Kubernetes observability and automation, with an awesome Prometheus integration
gomate.io - Behavior-driven development tool for GoLang
nix-prisma-example - An example Prisma project using nix