Go Scraping

Open-source Go projects categorized as Scraping

Top 15 Go Scraping Projects

  1. colly

    Elegant Scraper and Crawler Framework for Golang

    Project mention: Golang with Colly: Use Random Fake User-Agents When Scraping | dev.to | 2025-01-10

    https://github.com/lib4u/fake-useragent https://github.com/gocolly/colly

  2. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  3. Ferret

    Declarative web scraping

  4. pipet

    Swiss-army tool for scraping and extracting data from online assets, made for hackers

    Project mention: Show HN: Pipet – CLI tool for scraping and extracting data online, with pipes | news.ycombinator.com | 2024-09-30
  5. Geziyor

    Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

  6. till

    DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.

  7. Dataflow kit

    Extract structured data from web sites. Web sites scraping.

  8. antch

    Antch, a fast, powerful and extensible web crawling & scraping framework for Go

  9. Nutrient

    Nutrient - The #1 PDF SDK Library. Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.

    Nutrient logo
  10. JsonGenius

    Get structured JSON data from any page.

  11. newser

    Newser is a simple utility to generate a pdf with you favorite news articles

  12. goClone

    🌱 goClone - clone websites in seconds

  13. xdsl-exporter

    xDSL Prometheus Exporter

  14. goGetJS

    a tool for extracting, searching, and saving JavaScript files (with optional headless browser)

  15. moviestills

    A small CLI app to scrap high-quality movie snapshots from various websites.

  16. Article2Audio

    Convert articles to audio using OpenAI's Text to Speech API via a python script or web app

    Project mention: Show HN: Article2Audio – Convert URLs to audio, sync to your podcast app | news.ycombinator.com | 2024-07-21
  17. go-scraper

    This repo show how to Scrape different type of data

  18. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Scraping discussion

Log in or Post with

Go Scraping related posts

  • Golang with Colly: Use Random Fake User-Agents When Scraping

    2 projects | dev.to | 10 Jan 2025
  • Show HN: Flyscrape – A standalone and scriptable web scraper in Go

    6 projects | news.ycombinator.com | 11 Nov 2023
  • Colly: Elegant Scraper and Crawler Framework for Golang

    1 project | news.ycombinator.com | 23 Aug 2023
  • Do I really need to grind leetcode to get a software job? It's been the bane of my existence

    1 project | /r/learnprogramming | 22 Jun 2023
  • Hello, I am new to Python. I know the basics but I have no idea what should I do next.

    1 project | /r/learnpython | 22 Jun 2023
  • colly VS scrapemate - a user suggested alternative

    2 projects | 15 Apr 2023
  • Web scraper help

    1 project | /r/golang | 1 Mar 2023
  • A note from our sponsor - Nutrient
    nutrient.io | 14 Feb 2025
    Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free. Learn more →

Index

What are some of the best open-source Scraping projects in Go? This list will help you:

# Project Stars
1 colly 23,722
2 Ferret 5,772
3 pipet 2,664
4 Geziyor 2,663
5 till 813
6 Dataflow kit 662
7 antch 261
8 JsonGenius 175
9 newser 86
10 goClone 66
11 xdsl-exporter 45
12 goGetJS 41
13 moviestills 18
14 Article2Audio 9
15 go-scraper 0

Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai

Did you know that Go is
the 4th most popular programming language
based on number of references?