Top 12 Go Spider Projects

Spider

• Add a project

1. colly

   1 41 24,156 6.7 Go

   Elegant Scraper and Crawler Framework for Golang

   

   Project mention: Golang with Colly: Use Random Fake User-Agents When Scraping | dev.to | 2025-01-10

   https://github.com/lib4u/fake-useragent https://github.com/gocolly/colly

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. crawlab

   2 4 11,740 8.1 Go

   Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

   

4. Pholcus

   3 0 7,588 0.0 Go

   Pholcus is a distributed high-concurrency crawler software written in pure golang

   

5. DHT

   4 1 2,747 0.0 Go

   BitTorrent DHT Protocol && DHT Spider.

   

6. Geziyor

   5 2 2,710 1.1 Go

   Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

   

7. webpalm

   6 11 370 5.7 Go

   🕸️ Crawl in the web network

   

8. ant

   7 4 278 2.0 Go

   A web crawler for Go (by yields)

   

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. spidy

    8 4 157 0.0 Go

    Domain names collector - Crawl websites and collect domain names along with their availability status. (by twiny)

    

11. scrapemate

    9 1 118 6.7 Go

    Golang Crawling and scraping framework (by gosom)

    

12. goscrapy

    10 1 95 6.6 Go

    GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by Python's Scrapy framework.

    

    Project mention: GoScrapy: Harnessing Go's power for fast web scraping | news.ycombinator.com | 2024-09-06

13. wbot

    11 2 16 4.6 Go

    A simple & efficient web crawler.

    

14. turbo-tor-crawl

    12 1 6 10.0 Go

    Recursive hostnames crawler

    

Go Spider related posts

• New modern web crawling tool

  2 projects | news.ycombinator.com | 30 Apr 2023

• Show HN: A fast, feature-rich crawler for Go

  1 project | news.ycombinator.com | 26 Mar 2021

• Fast, feature-rich web crawler for Go

  1 project | /r/golang | 26 Mar 2021

• Feature rich crawler for Go.

  1 project | /r/golang | 26 Mar 2021

• Create a tiny crawler/scraper for Go

  1 project | /r/golang | 26 Mar 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 15 May 2025

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

InfluxDB – Built for High-Performance Time Series Workloads

InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

www.influxdata.com

Do not miss the trending Go projects with our weekly report!