GoQuery
A little like that j-thing, only in Go. (by PuerkitoBio)
mxj
Decode / encode XML to/from map[string]interface{} (or JSON); extract values with dot-notation paths and wildcards. Replaces x2j and j2x packages. (by clbanning)
Our great sponsors
| GoQuery | mxj | |
|---|---|---|
| 11 | 4 | |
| 13,537 | 608 | |
| 1.2% | - | |
| 6.6 | 4.5 | |
| about 2 months ago | 15 days ago | |
| Go | Go | |
| BSD 3-clause "New" or "Revised" License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
GoQuery
Posts with mentions or reviews of GoQuery.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-11-11.
-
Show HN: Flyscrape – A standalone and scriptable web scraper in Go
Your comment was posted 4 minutes ago. That means you still have enough time to edit your comment to change it so it contains real URLs:
<https://github.com/PuerkitoBio/goquery>
<https://github.com/dop251/goja>
(Please do not reply to this comment—I won't be able to delete it once the previous post is fixed if it contains replies.)
-
Check to see if JSON contains something
How about - https://github.com/PuerkitoBio/goquery
-
Help understanding goquery return value
Assuming you're asking about https://github.com/PuerkitoBio/goquery , to interpret your printout you want to look at what Find is defined to return, a *Selection. https://github.com/PuerkitoBio/goquery/blob/39fb6d4dc47a07e5782494b6defc89a194b1f906/traversal.go#L23
-
Learn how to scrape Trustpilot reviews using Go
github.com/PuerkitoBio/goquery - library that provides a convenient and concise way to query HTML and XML documents. It provides a jQuery-like API for selecting elements and extracting data, making it a popular choice for web scraping in Go.
-
Service for generate RSS/Atom feeds from web pages that lack them.
Yep, I thing I can add it. Add new goquery alternative will be good :)
-
Is there a library similar to HTMLUnit in GO?
If I want to parse the structure of HTML and not interact with it from a browser point of view, I use this in Go: https://github.com/PuerkitoBio/goquery
-
10分钟go crawler colly从入门到精通
goquery
-
I Need to Find an Apartment
I had a similar problem that I solved with goquery and otto. You can use goquery to traverse the DOM and otto to execute the script fragment. Then just grab the data from otto's VM.
Your scraping being slow and using Chrome might be a blessing in disguise though. If you aren't careful you can get detected as a bot and banned from the site.
-
Static analyzers for text templates
If you're willing to add constraints around the goal, you can catch this type of error with semgrep rules and/or unit tests using qoquery.
-
Building Golang crawler with Docker
RUN go get github.com/PuerkitoBio/goquery
mxj
Posts with mentions or reviews of mxj.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-30.
-
Newbie: I have a big xml file, the content is much nested tags and what I need to do is adding a field in a very nested tag in this file. One “not elegant” way is to make thousands of structs to parse the file. Do you guys have a simple solution for a task like that.
It generates Go structs from XML files. Compared to projects like https://github.com/clbanning/mxj, it generates much better Go code and you can feed it multiple example XML files.
-
If maps are not ordered, why does it display in the correct order when printing ?
Prior to Go 1.12 unit tests where you wanted to verify a map value - or its serialization in JSON - you needed to visually inspect the output. You couldn't just compare the result to a known string value. (You can see the messy result of this still lingering in older packages, such as, github.com/clbanning/mxj or .../x2j and .../j2x. In fact, similar sorting of map values was added in .../mxj for marshaling XML docs from maps.)
-
Golang json to xml, xlm to json
Hello, maybe someone had experience converting xlm to json and json to xlm without structs? I have found some libs like github.com/clbanning/mxj but it loses sequences, of course I could modify xlm to remove seq to pass validation etc. Ideally it should work like this: https://www.utilities-online.info/xmltojson#.W1cSCNIzZPY
What are some alternatives?
When comparing GoQuery and mxj you can also consider the following projects:
colly - Elegant Scraper and Crawler Framework for Golang
bluemonday - bluemonday: a fast golang HTML sanitizer (inspired by the OWASP Java HTML Sanitizer) to scrub user generated content of XSS
xpath - XPath package for Golang, supports HTML, XML, JSON document query.
toml - TOML parser for Golang with reflection.
htmlquery - htmlquery is golang XPath package for HTML query.
go-humanize - Go Humans! (formatters for units to human friendly sizes)
xml - Package feed implements a flexible, robust and efficient RSS and Atom parser
go-pkg-rss
goregen - randexp for Go.
sh - A shell parser, formatter, and interpreter with bash support; includes shfmt
editorconfig-core-go - EditorConfig Core written in Go