goskyr
lux
goskyr | lux | |
---|---|---|
2 | 13 | |
32 | 25,312 | |
- | - | |
8.7 | 7.4 | |
2 days ago | 9 days ago | |
Go | Go | |
GNU General Public License v3.0 only | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
goskyr
-
No code command line webscraper
I am currently building a webscraper, called goskyr, that can be run from the command line and is supposed to be easily configurable. So instead of having to write code to scrape a website you'd just write a configuration snippet and run the scraper. I realize that there are a number of gui based scraping services that make it extremely easy to setup a scraping process for any website, so for people having no coding experience whatsoever that would probably be the easiest solution. I'm trying to come close to those gui based solutions in terms of functionality by providing a 'smart' way of finding potentially interesting data/fields and letting the user select a subset in a terminal based ui. Also date extraction & parsing and the newly added machine learning capability is probably worth mentioning. Still, those other, gui based solutions are really awesome, eg octoparse or scrapestorm.
-
Crowdsourced concert scraping project
I am currently working on a configurable command line webscraper, called goskyr and my first use case is collecting as much concert data as possible for this website idea I had, croncert.ch I am hoping that people other than me are willing to contribute to the scraper configuration file in this repository, https://github.com/jakopako/croncert-config, which also contains a github action to regularly run the scraper. What do you think? Could this work? How should I spread the word?
lux
-
Bilibili download stalls at around 30-60%
Not a fix, but I tend to use lux when downloading from bilibili. It is faster too.
- Lux: A fast and simple video downloader built with Go
-
Download videos in stream
You can try lux
- Show HN: A Qt based GUI for many CLI based online media downloaders
-
[Question]Cannot download any music on vanced. Do I need premium or something.
Or use youtube-dl, yt-dlp, lux, and others
-
Media Downloader is a Qt based GUI front end to CLI media dowloading tools such as yt-dlp, youtube-dl, gallery-dl, lux, you-get, svtplay-dl, aria2c, wget and safaribooks.
lux
-
lux VS youtube - a user suggested alternative
2 projects | 2 Feb 2022
- Annie: Simple video download CLI tool like YouTube-dl written in Go
-
YouTube-dl's first release since June 2021
Seems weird to me to frown upon python and then being ok with perl.. but whatever float your boat! Perhaps check out https://github.com/iawia002/annie which is Go so you can get a static binary.
What are some alternatives?
croncert-config - configuration and github actions for concertcloud.live (fka croncert.ch), a website that shows you concerts in various cities
cyberdrop-downloader - Cyberdrop.me album downloader written in Go
colly - Elegant Scraper and Crawler Framework for Golang
yt-dlp - A feature-rich command-line audio/video downloader
fitter - New way for collect information from the API's/Websites
ydata-profiling - 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.
soup - Web Scraper in Go, similar to BeautifulSoup
unifi-protect-remux - Tool to help remux .ubv files from Ubiquiti's Unifi Protect system so they can be turned into standard .mp4 files
Rendora - dynamic server-side rendering using headless Chrome to effortlessly solve the SEO problem for modern javascript websites
youtube - Download media or send API requests
Geziyor - Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
aria2 - aria2 is a lightweight multi-protocol & multi-source, cross platform download utility operated in command-line. It supports HTTP/HTTPS, FTP, SFTP, BitTorrent and Metalink.