Learn how to scrape Trustpilot reviews using Go

• colly

  39 22,165 6.0 Go

  Elegant Scraper and Crawler Framework for Golang

  

github.com/gocolly/colly - popular and widely-used library for web scraping in Go. It provides a higher-level API than net/http and makes it easier to extract information from websites. It also provides features such as concurrency, automatic request retries, and support for cookies and sessions.

• GoQuery

  11 13,552 6.6 Go

  A little like that j-thing, only in Go.

  

github.com/PuerkitoBio/goquery - library that provides a convenient and concise way to query HTML and XML documents. It provides a jQuery-like API for selecting elements and extracting data, making it a popular choice for web scraping in Go.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• scrape

  1 1,502 10.0 Go

  A simple, higher level interface for Go web scraping. (by yhat)

  

github.com/yhat/scrape - library that provides a convenient and flexible way to extract information from websites. It provides a high-level API that makes it easy to extract specific elements from a web page, and it also supports custom extractors for more complex scraping tasks.

• scraping

  1 1 10.0 Go

  Simple scraping scripts as part of tutorial from in the blog TheDevBook.com

Basically, that's it. We now can extract reviews and dump them into a JSON object for future analysis. The final code can be found on GitHub.

Suggest a related project