sumy
Goose3
Our great sponsors
| sumy | Goose3 | |
|---|---|---|
| 1 | 2 | |
| 3,417 | 764 | |
| - | 1.8% | |
| 6.7 | 6.4 | |
| 2 months ago | 6 days ago | |
| Python | HTML | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sumy
Goose3
-
Article Extraction Library for Scraping Text Data (Python)
Goose3 is what I use to scrape financial articles for real-time financial news analysis. It's very good. https://github.com/goose3/goose3
-
Website categorization - use cases, taxonomies, content extraction
There are also many ready made libraries available for content extraction written in python which is more commonly used in data science, e.g. goose3 (https://github.com/goose3/goose3) and newspaper (https://github.com/codelucas/newspaper).
What are some alternatives?
newspaper - newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
html2text - Convert HTML to Markdown-formatted text.
python-goose - Html Content / Article Extractor, web scrapping lib in Python
textract - extract text from any document. no muss. no fuss.
trafilatura - Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
python-readability - fast python port of arc90's readability tool, updated to match latest readability.js!
micawber - a small library for extracting rich content from urls
toapi - Every web site provides APIs.
opengraph - A python module to parse the Open Graph Protocol
lassie - Web Content Retrieval for Humans™