newser
ftr-site-config
newser | ftr-site-config | |
---|---|---|
2 | 13 | |
83 | 349 | |
- | - | |
3.2 | 9.5 | |
about 2 years ago | 7 days ago | |
Go | ||
- | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
newser
-
Is there a tool to save websites as pdf in optimized A5X/A6X format?
https://github.com/lnenad/newser is an open source project made specifically for this use case by an A5X user.
-
Show HN: Newser, utility written in go to generate a pdf with news content
I've gotten myself a Supernote A5X (awesome device btw) and since it doesn't have a web browser or anything I've wanted to have a way to read news on it. I've hacked together this utility in a couple of days and it works wonders for me personally so I thought it might be interesting to others. It can also be used as a noise free newspaper generator as it removes images/ads/links and other noisy stuff.
https://github.com/lnenad/newser
(there is a screenshot of the first page of the generated pdf)
It scrapes (news) websites for content and puts it into a pdf. For me the pdf location is my dropbox supernote directory so my setup is to run this thing daily and have a fresh pdf with news whenever I want it.
It's rough around the edges probably (currently added crawl support for verge, ars, engadget) but I think it's a good base so if anyone wants to contribute feel free. Some of the stuff I want to add is pictures (maybe), maybe parse the text html to include font styling and other stuff.
I've tried to generalize it as much as possible so the crawling is pretty much automatic and is controlled by a config file where you define "rules" on how to parse the website.
ftr-site-config
-
can someone suggest a good rss reader for android please?
As far as full-text caching... maybe a self-hosted instance or paid version of the FiveFilters Full-Text RSS service would work. You can integrate that into whatever aggregator you want.
-
Help Finding the Best RSS App Mac/iOS
However you can retrofit this onto any reader by using a service that creates a full text feed from a summary feed. Two that I have used in the past are https://morss.it/ and https://www.fivefilters.org/full-text-rss/.
-
How to rebuild social media on top of RSS
RSS feeds that don't contain the full article text drive me nuts.
Here is a workaround that I've had good luck with:
https://www.fivefilters.org/full-text-rss/
In addition to improving usability, it defeats attempts to measure clickbait summary efficacy, etc., since it breaks sites' ability to pull popularity / telemetry info.
-
RSS-Bridge: feeds for websites that don't have one
By any chance, could this be used as an alternative to the full-article RSS tool that FiveFilters offers?
-
NetNewsWire: Free and Open Source RSS Reader for Mac and iOS
Please check out FullTextRSS from Five Filters: https://www.fivefilters.org/full-text-rss/
They have an OSS version you can host yourself. It fixes the problem of sites not sharing their full text in their feed, by going and scraping the site into a full feed for you.
-
Newsbite and seeing full articles
Full-Text RSS - FiveFilters.org
-
Show HN: Newser, utility written in go to generate a pdf with news content
This is great!
If it's useful, I work on a project where we maintain a repository of XPath selectors for extracting article content from many different sites: https://github.com/fivefilters/ftr-site-config - they're based on the original public Instapaper rules.
We also have PDF generation, but it's not really for crawling, and wasn't created for reading on a device like the Supernote, more for printing and reading: https://pdf.fivefilters.org/simple-print/
-
Best RSS experience?
To accomplish full-text I ended up purchasing a license for https://www.fivefilters.org/full-text-rss/, self host it and bounce it through a docker container running Tor+privproxy which generates a new circuit every 10 minutes to help avoid IP based limits on certain websites I subscribe to. I can also disable the Tor bounce per-feed if needed.
-
The most underused browser feature
Thanks for mentioning Instant View, I hadn't come across that. We actually maintain something similar here: https://github.com/fivefilters/ftr-site-config
We use these in our own tools and also get contributions from others, including Wallabag users: https://github.com/wallabag/wallabag
Before it was sold, Instapaper used to have something similar. A public database of its site-specific extraction templates. We used that as the starting point for our repository.
-
A 4 minute introduction to RSS
If you're trying to build one yourself, have a look at the open source Readability code[1]. It was originally developed by Arc90 and is now used by Apple and Mozilla in their browser reader views. The code has been ported to a number of different languages.
I work on a service called Full-Text RSS[2] that used a PHP port of Readability, coupled with site-specific extraction rules[3] to identify and extract article content from each feed item. It then produces a full-text version of the given feed. The idea is you subscribe to the full-text version in whichever feed reader you use and it will transparently give you full-text articles where you had partial content before.
[1] https://github.com/mozilla/readability
[2] https://www.fivefilters.org/full-text-rss/
[3] https://github.com/fivefilters/ftr-site-config
What are some alternatives?
rss2kindle - Convert RSS feed to a PDF for reading on Kindle
tridactyl - A Vim-like interface for Firefox, inspired by Vimperator/Pentadactyl.
pdfinverter - darken (or lighten) a PDF
dom-distiller - Distills the DOM
unipdf - Golang PDF library for creating and processing PDF files (pure go)
arc90-readability - A copy of the original Arc90 repo with links to many of the current ports.
one-file-pdf - A minimalist Go PDF writer in 1982 lines. Draws text, images and shapes. Helps understand the PDF format. Used in production for reports.
rssguard - Feed reader (and podcast player) which supports RSS/ATOM/JSON and many web-based feed services.
fay - Stateless, Fast and Reliable PDF rendering service.
SponsorBlock - Skip YouTube video sponsors (browser extension)
go-wkhtmltopdf - Golang commandline wrapper for wkhtmltopdf
ALL-about-RSS - A list of RSS related stuff: tools, services, communities and tutorials, etc.