Goose3
sumy
| Goose3 | sumy | |
|---|---|---|
| 2 | 1 | |
| 765 | 3,419 | |
| 1.0% | - | |
| 6.4 | 6.7 | |
| 10 days ago | 2 months ago | |
| HTML | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Goose3
-
Article Extraction Library for Scraping Text Data (Python)
Goose3 is what I use to scrape financial articles for real-time financial news analysis. It's very good. https://github.com/goose3/goose3
-
Website categorization - use cases, taxonomies, content extraction
There are also many ready made libraries available for content extraction written in python which is more commonly used in data science, e.g. goose3 (https://github.com/goose3/goose3) and newspaper (https://github.com/codelucas/newspaper).
sumy
What are some alternatives?
newspaper - newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
python-goose - Html Content / Article Extractor, web scrapping lib in Python
html2text - Convert HTML to Markdown-formatted text.
trafilatura - Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
textract - extract text from any document. no muss. no fuss.
micawber - a small library for extracting rich content from urls
python-readability - fast python port of arc90's readability tool, updated to match latest readability.js!
toapi - Every web site provides APIs.
lassie - Web Content Retrieval for Humans™
opengraph - A python module to parse the Open Graph Protocol