GoQuery VS bluemonday

Your comment was posted 4 minutes ago. That means you still have enough time to edit your comment to change it so it contains real URLs:

<https://github.com/PuerkitoBio/goquery>

<https://github.com/dop251/goja>

(Please do not reply to this comment—I won't be able to delete it once the previous post is fixed if it contains replies.)

How about - https://github.com/PuerkitoBio/goquery

Assuming you're asking about https://github.com/PuerkitoBio/goquery , to interpret your printout you want to look at what Find is defined to return, a *Selection. https://github.com/PuerkitoBio/goquery/blob/39fb6d4dc47a07e5782494b6defc89a194b1f906/traversal.go#L23

github.com/PuerkitoBio/goquery - library that provides a convenient and concise way to query HTML and XML documents. It provides a jQuery-like API for selecting elements and extracting data, making it a popular choice for web scraping in Go.

Yep, I thing I can add it. Add new goquery alternative will be good :)

If I want to parse the structure of HTML and not interact with it from a browser point of view, I use this in Go: https://github.com/PuerkitoBio/goquery

goquery

I had a similar problem that I solved with goquery and otto. You can use goquery to traverse the DOM and otto to execute the script fragment. Then just grab the data from otto's VM.

Your scraping being slow and using Chrome might be a blessing in disguise though. If you aren't careful you can get detected as a bot and banned from the site.

https://github.com/PuerkitoBio/goquery

If you're willing to add constraints around the goal, you can catch this type of error with semgrep rules and/or unit tests using qoquery.

RUN go get github.com/PuerkitoBio/goquery

I'm really glad to see `bluemonday` in such company, but I'm also really happy to hand over the reigns to a group of engineers that can focus on OSS.

I am the author of https://github.com/microcosm-cc/bluemonday but being a maintainer is a journey, you make a tool for yourself, you realise others will benefit and open it up to others... time passes... and then you realise you are that tiny pillar in the XKCD comic about dependencies, and that when you make a casual update to the project that multiple security companies ping you to ask the impact and scope of the change, implications, and of course others ping you to say that it breaks their individual workflow.

I've known Filippo for almost as long as that library has existed, and I know it's in a safe pair of hands, and that Geomys is going to be a good home to all of the OSS projects that they have in their portfolio.

It's definitely a journey, how should these foundational elements be supported and funded? This is one answer to that question, and I'm glad it exists as my spare cycles were very few.

I'm on the receiving end of donations from sourcegraph for this. It's around $10 per month from that single donation and is for the only Go HTML santizer, which you use when you have user generated / untrusted input that you need to display as HTML. https://github.com/microcosm-cc/bluemonday

For me the library has been good enough for my own use for a very very long time. I mostly neglect it unless there's some critical issue. I don't improve it at all as my time is better spent on my day job.

I've often thought that there's room for improvement such as a DOM style santizer to validate input rather than just a SAX style sanitizer, perhaps formatting of output in addition to sanitising input, transformation rules, etc.

When I got the donation I was surprised, first ever bit of support for open source software I'd written (as this was not written on company dime).

Even at $10 per month it's motivating enough to think someone values it. If it accrues into something significant I may actually feel motivated to improve it.

Interesting is that I'd regard this as successful by usage, it's used by virtually everything in the Go world that makes a website.

Perhaps people don't know it exists though? And for that awareness thanks to thanks.dev

bluemonday is an html sanitizer you could try

For sanitizing html input at work we use https://github.com/microcosm-cc/bluemonday.

Sounds like a task for bluemonday.