Go Scraping

Open-source Go projects categorized as Scraping | Edit details

Top 7 Go Scraping Projects

  • colly

    Elegant Scraper and Crawler Framework for Golang

    Project mention: First project - The API for engineering multiple choice questions | reddit.com/r/golang | 2022-05-08

    There is the scraper struct that spawns goroutine. Then, each goroutine scraps the web URL using go colly, and the structured MCQ questions are served from API endpoints. Users can choose between persistent Postgres model or in-memory data structure to store the questions and retrieve them from API. I have used dependency injection to inject the models via the interface to my application struct.

  • Ferret

    Declarative web scraping

  • SonarLint

    Deliver Cleaner and Safer Code - Right in Your IDE of Choice!. SonarLint is a free and open source IDE extension that identifies and catches bugs and vulnerabilities as you code, directly in the IDE. Install from your favorite IDE marketplace today.

  • Geziyor

    Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

  • Dataflow kit

    Extract structured data from web sites. Web sites scraping.

  • antch

    Antch, a fast, powerful and extensible web crawling & scraping framework for Go

  • newser

    Newser is a simple utility to generate a pdf with you favorite news articles

    Project mention: Is there a tool to save websites as pdf in optimized A5X/A6X format? | reddit.com/r/Supernote | 2022-03-26

    https://github.com/lnenad/newser is an open source project made specifically for this use case by an A5X user.

  • moviestills

    A small CLI app to scrap high-quality movie snapshots from various websites.

    Project mention: Get high-quality movie snapshots from various websites | reddit.com/r/coolgithubprojects | 2021-10-14
  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-05-08.

Go Scraping related posts

Index

What are some of the best open-source Scraping projects in Go? This list will help you:

Project Stars
1 colly 16,585
2 Ferret 4,981
3 Geziyor 1,704
4 Dataflow kit 514
5 antch 226
6 newser 74
7 moviestills 7
Find remote jobs at our new job board 99remotejobs.com. There are 7 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com