Go for web scraping

• colly

  41 23,553 5.0 Go

  Elegant Scraper and Crawler Framework for Golang

  

  http://go-colly.org/ is excellent

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• rod

  20 5,593 7.7 Go

  A Chrome DevTools Protocol driver for web automation and scraping.

  

  I recently tried out https://github.com/go-rod/rod. I think it's based on chromedp (so, Chrome dev tools and headless browser) but it also has code to download and run a supported version of Chrome that doesn't interfere with your local browser.

• go-wiki

  7 93 4.7 Go

  This is a Golang open-source module that makes it easy to access and parse data from Wikipedia (Wikipedia API wrapper)

  If you ever need to scrap the Wikipedia, use this: https://github.com/trietmn/go-wiki

• goGetJS

  4 41 0.0 Go

  a tool for extracting, searching, and saving JavaScript files (with optional headless browser)

• katana

  10 12,860 9.4 Go

  A next-generation crawling and spidering framework.

  

  Checkout https://github.com/projectdiscovery/katana It is right up there with any advanced web scraper you will find in python world or beyond.

Suggest a related project