soup-strainer
htmldate
soup-strainer | htmldate | |
---|---|---|
1 | 1 | |
33 | 107 | |
- | - | |
10.0 | 7.6 | |
about 10 years ago | 16 days ago | |
Python | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
soup-strainer
-
How does Firefox's Reader View work?
I implemented a variation of the Readability algorithm some 9 years ago, in case anyone needs a server-side Python version and is interested in dragging it (kicking and screaming) into the 2020s:
https://github.com/rcarmo/soup-strainer
htmldate
What are some alternatives?
dom-distiller - Distills the DOM
TWINT - An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
unclutter - A modern reader mode and article library for your browser.
newspaper - newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
trafilatura - Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
python-readability - fast python port of arc90's readability tool, updated to match latest readability.js!
Readability4J - A Kotlin port of Mozilla‘s Readability. It extracts a website‘s relevant content and removes all clutter from it.
micawber - a small library for extracting rich content from urls
go-trafilatura - go-trafilatura is a Go port of the trafilatura Python library.
html2text - Convert HTML to Markdown-formatted text.
go-domdistiller - Go-DomDistiller is a Go port of the DOM Distiller library which implements Reader mode in Chrome for Android and Desktop. It has no dependencies on Chromium and is meant to run as a command line program or on a server.
lassie - Web Content Retrieval for Humans™