BasicCrawler
percollate
| BasicCrawler | percollate | |
|---|---|---|
| 1 | 14 | |
| 3 | 4,122 | |
| - | - | |
| 10.0 | 5.7 | |
| almost 4 years ago | 1 day ago | |
| Jupyter Notebook | JavaScript | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
BasicCrawler
-
Reading from the web offline and distraction-free
Very cool.
The take-any-webpage-offline need is also common in the education space (teachers want to save a webpage and send it to their students as part of a lesson and don't want to worry about availability or ads etc).
I used to work on tools for this https://github.com/learningequality/ricecooker/blob/develop/... and https://github.com/learningequality/BasicCrawler/blob/master...
percollate
-
The Case Against AI Everything, Everywhere, All at Once
You can still choose automation. The easier route for me is to use wallabag to save the article. Then on my remarkable tablet I can grab a very readable document with https://github.com/koreader/koreader.
The other option is to use https://github.com/danburzo/percollate to convert a webpage to a nice document directly. I use both tools depending on my needs.
-
Share my down(load) function!
This function is just a simple combination with yt-dlp and percollate.
- Selfhosted service to screenshot websites - but I'm not finding the options I need
-
Reverse Engineering or Recreating the Chrome Extension?
If someone hasn't already done this and I can't figure out how they are converting HTML, I have also considered using Percollate to convert, then sending to ReMarkable via rmapi.
-
ArchiveBox Alternative
The Cli Tool Percollate offers a different approach, but is also very good: https://github.com/danburzo/percollate
- Reading web articles on the reMarkable
-
Is there a command line program to convert web pages into readable markdown/htm/pdf format? preferably markdown
Concerning pdf there is the well known wkhtmltopdf , but let me say that I love the not so well known percollate
- CLI to turn web pages into beautiful, readable PDF, ePub, or HTML docs
-
Show HN: Lurnby, a tool for better learning, is now open source
Since I'm working on a similar project, this is how I am planning to pull content from the web, utilizing percollate[1] to get the HTML content, I haven't written any implementation for this in Python yet.
If you don't mind me asking, how were you going to implement spaced repetition? Since the Incremental Reading algorithm has never been published as far as I know.
[1]: https://github.com/danburzo/percollate
- What Are The Best Linux Apps?
What are some alternatives?
rdrview - Firefox Reader View as a command line tool
koodo-reader - A modern ebook manager and reader with sync and backup capacities for Windows, macOS, Linux and Web
SingleFile - Web Extension for saving a faithful copy of a complete web page in a single HTML file
zimit - Make a ZIM file from any Web site and surf offline!
monolith-of-web - A chrome extension to make a single static HTML file of the web page using a WebAssembly port of monolith CLI
parser - 📜 Extract meaningful content from the chaos of a web page
Readability4J - A Kotlin port of Mozilla‘s Readability. It extracts a website‘s relevant content and removes all clutter from it.
Lurnby - A tool for active reading and personal knowledge management
url-to-epub - A simple script that generates an EPUB from a single URL, zero-config
Shiori - Simple bookmark manager built with Go
gImageReader - A Gtk/Qt front-end to tesseract-ocr.