Goose3
micawber
| Goose3 | micawber | |
|---|---|---|
| 2 | - | |
| 765 | 621 | |
| 1.0% | - | |
| 6.4 | 4.8 | |
| 10 days ago | 4 months ago | |
| HTML | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Goose3
-
Article Extraction Library for Scraping Text Data (Python)
Goose3 is what I use to scrape financial articles for real-time financial news analysis. It's very good. https://github.com/goose3/goose3
-
Website categorization - use cases, taxonomies, content extraction
There are also many ready made libraries available for content extraction written in python which is more commonly used in data science, e.g. goose3 (https://github.com/goose3/goose3) and newspaper (https://github.com/codelucas/newspaper).
micawber
We haven't tracked posts mentioning micawber yet.
Tracking mentions began in Dec 2020.
What are some alternatives?
newspaper - newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
trafilatura - Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
python-goose - Html Content / Article Extractor, web scrapping lib in Python
lassie - Web Content Retrieval for Humans™
opengraph - A python module to parse the Open Graph Protocol
toapi - Every web site provides APIs.
Haul - An Extensible Image Crawler
htmldate - Fast and robust date extraction from web pages, with Python or on the command-line
TWINT - An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.