readability.php VS tidy-html5

There are RSS readers like Tiny Tiny RSS [1] which are able to do exactly that (in this case using a PHP port of Mozilla's library [2]). Does not work in 100% of cases but is a really useful thing.

[1] https://tt-rss.org/

[2] https://github.com/fivefilters/readability.php

https://github.com/fivefilters/readability.php is port of it, and it's server backend support, ported from https://github.com/mozilla/readability

Any developers who'd like to contribute to improving how article content is extracted from web pages should check out Mozilla's Readability repository: https://github.com/mozilla/readability

I'm currently trying to bring the PHP port up to speed here: https://github.com/fivefilters/readability.php

We use currently use an older version as part of our article extraction for Push to Kindle: https://www.fivefilters.org/push-to-kindle/

So I included the tidy libraries in my project.

Maybe look into HTML Tidy. It's job is to clean up HTML and convert legacy code to modern form, so it knows about DTDs. You might be able to pass it some options to get what you want.

I've always used tidy for HTML/XML formatting jobs.

Personally I use command that switches the file type to html, and then formats it with tidy. It assumes you're pasting into a new buffer.

I use tidy.

So I installed HTML tidy.

Prune instructs the parser to remove any elements within the extracted article block that look superfluous. This can result in false positives, so we tend to disable it when we've gone to the trouble of creating site-specific extraction rules.

Tidy determines if the source HTML should be cleaned up first with HTML Tidy - https://github.com/htacg/tidy-html5. If you're parsing the source HTML with an HTML 5 parser, as we are now, it shouldn't be necessary any more (I think we actually ignore it now). We used it more before when we relied on libxml parsing, which often trips up on modern HTML.