goskyr

A configurable command-line web scraper written in go with auto configuration capability (by jakopako)

Goskyr Alternatives

Similar projects and alternatives to goskyr

  • fitter

    New way for collect information from the API's/Websites (by PxyUp)

  • croncert-config

    configuration and github actions for concertcloud.live (fka croncert.ch), a website that shows you concerts in various cities

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • colly

    Elegant Scraper and Crawler Framework for Golang

  • soup

    Web Scraper in Go, similar to BeautifulSoup

  • lux

    13 goskyr VS lux

    👾 Fast and simple video download library and CLI tool written in Go

  • Rendora

    dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites

  • Geziyor

    Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • Ferret

    Declarative web scraping

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better goskyr alternative or higher similarity.

goskyr reviews and mentions

Posts with mentions or reviews of goskyr. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-03-09.
  • No code command line webscraper
    3 projects | /r/webscraping | 9 Mar 2023
    I am currently building a webscraper, called goskyr, that can be run from the command line and is supposed to be easily configurable. So instead of having to write code to scrape a website you'd just write a configuration snippet and run the scraper. I realize that there are a number of gui based scraping services that make it extremely easy to setup a scraping process for any website, so for people having no coding experience whatsoever that would probably be the easiest solution. I'm trying to come close to those gui based solutions in terms of functionality by providing a 'smart' way of finding potentially interesting data/fields and letting the user select a subset in a terminal based ui. Also date extraction & parsing and the newly added machine learning capability is probably worth mentioning. Still, those other, gui based solutions are really awesome, eg octoparse or scrapestorm.
  • Crowdsourced concert scraping project
    2 projects | /r/webscraping | 17 May 2022
    I am currently working on a configurable command line webscraper, called goskyr and my first use case is collecting as much concert data as possible for this website idea I had, croncert.ch I am hoping that people other than me are willing to contribute to the scraper configuration file in this repository, https://github.com/jakopako/croncert-config, which also contains a github action to regularly run the scraper. What do you think? Could this work? How should I spread the word?

Stats

Basic goskyr repo stats
2
32
8.4
3 days ago

jakopako/goskyr is an open source project licensed under GNU General Public License v3.0 only which is an OSI approved license.

The primary programming language of goskyr is Go.

SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com