Go Scraper

Open-source Go projects categorized as Scraper

Top 23 Go Scraper Projects

  1. lux

    👾 Fast and simple video download library and CLI tool written in Go

  2. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  3. colly

    Elegant Scraper and Crawler Framework for Golang

    Project mention: Golang with Colly: Use Random Fake User-Agents When Scraping | dev.to | 2025-01-10

    https://github.com/lib4u/fake-useragent https://github.com/gocolly/colly

  4. Ferret

    Declarative web scraping

  5. rod

    A Chrome DevTools Protocol driver for web automation and scraping.

    Project mention: Ask HN: Why are there no open-source Remote Browser Isolation solutions? | news.ycombinator.com | 2025-03-12
  6. pipet

    Swiss-army tool for scraping and extracting data from online assets, made for hackers

    Project mention: Show HN: Pipet – CLI tool for scraping and extracting data online, with pipes | news.ycombinator.com | 2024-09-30
  7. Geziyor

    Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

  8. cariddi

    Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. mangal

    📖 The most advanced (yet simple) cli manga downloader in the entire universe! Lua scrapers, export formats, anilist integration, fancy TUI and more!

  11. till

    DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.

  12. finance-go

    :bar_chart: Financial markets data library implemented in go.

  13. Dataflow kit

    Extract structured data from web sites. Web sites scraping.

  14. ant

    A web crawler for Go (by yields)

  15. GMDB

    GMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)

  16. dorkscout

    DorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets

  17. meteor

    Meteor is an easy-to-use, plugin-driven metadata collection framework to extract data from different sources and sink to any data catalog. (by raystack)

  18. demeter

    Demeter is a tool for scraping the calibre web ui

  19. JsonGenius

    Get structured JSON data from any page.

  20. spidy

    Domain names collector - Crawl websites and collect domain names along with their availability status. (by twiny)

  21. scraply

    Scraply a simple dom scraper to fetch information from any html based website

  22. fitter

    New way for collect information from the API's/Websites (by PxyUp)

    Project mention: Fitter - Open Source no-code tool for map-reduce data from different source and even more! | dev.to | 2024-10-30

    View on GitHub

  23. scrapemate

    Golang Crawling and scraping framework (by gosom)

  24. ultimate-guitar-scraper

    A simple scraper for Ultimate-Guitar.com's mobile API, written in Go. (by Pilfer)

  25. rrip

    Bulk image downloader for reddit.

  26. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Scraper discussion

Log in or Post with

Go Scraper related posts

  • Golang with Colly: Use Random Fake User-Agents When Scraping

    2 projects | dev.to | 10 Jan 2025
  • Show HN: Fitter – uniq no-code parser with a lot of features

    1 project | news.ycombinator.com | 27 Oct 2024
  • Show HN: Fitter – configurable open-source scraper

    1 project | news.ycombinator.com | 14 Jan 2024
  • Scraping the full snippet from Google search result

    3 projects | dev.to | 1 Jan 2024
  • Show HN: Flyscrape – A standalone and scriptable web scraper in Go

    6 projects | news.ycombinator.com | 11 Nov 2023
  • Colly: Elegant Scraper and Crawler Framework for Golang

    1 project | news.ycombinator.com | 23 Aug 2023
  • rrip v0.5 - Go template filters / formatting, GNU style long options

    1 project | /r/DataHoarder | 3 Aug 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 26 Mar 2025
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Scraper projects in Go? This list will help you:

# Project Stars
1 lux 28,890
2 colly 23,896
3 Ferret 5,791
4 rod 5,768
5 pipet 3,381
6 Geziyor 2,680
7 cariddi 1,636
8 mangal 1,573
9 till 814
10 finance-go 735
11 Dataflow kit 678
12 ant 278
13 GMDB 235
14 dorkscout 234
15 meteor 203
16 demeter 186
17 JsonGenius 175
18 spidy 153
19 scraply 125
20 fitter 122
21 scrapemate 108
22 ultimate-guitar-scraper 92
23 rrip 74

Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai