web2text
blackmaria
| web2text | blackmaria | |
|---|---|---|
| 2 | 6 | |
| 162 | 151 | |
| 3.7% | - | |
| 0.0 | 4.9 | |
| over 2 years ago | 7 months ago | |
| HTML | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
web2text
-
Advice building model for web elements/ browsing specific site
The only paper and code I’m aware of is in Scala and called https://github.com/dalab/web2text. They originally used a CNN. I think their training data was way to small.
-
Best content extraction library from news link?
If you need just extraction features, maybe Readability.js created by Mozilla or Web2Text could be help your problem (or kinda wrapper of these), but still can't get perfect solution for this. It's because all sites have different HTML structures.
blackmaria
-
Advice building model for web elements/ browsing specific site
I have also seen several tools that try to use LLM to do web scraping. I didn't look into the details. https://www.reddit.com/r/MachineLearning/comments/12v0vda/p_i_built_a_tool_that_autogenerates_scrapers_for/ https://github.com/Smyja/blackmaria
- GitHub - Smyja/blackmaria: Python package for webscraping in Natural language
- Black Maria is a Python package that does web scraping with GPT and natural language
- Python Package for Webscraping with GPT3
- Blackmaria: Python package for scraping webpages using Natural language
What are some alternatives?
newspaper - newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
Geek-Jokes API - Random Geek Jokes REST API
pix2struct
flask-api-utils - Flask extension that takes care of API representation and authentication.
readability - A standalone version of the readability lib
flask-restful - Simple framework for creating REST APIs
flask-api - Browsable web APIs for Flask.
Flask Paper Kit - Flask Boilerplate - Paper Kit Design | AppSeed
nextcord - A Python wrapper for the Discord API forked from discord.py
Apprentice - Built for streamlining development of Google Assistant Actions
flask-ask - Alexa Skills Kit for Python
Flask-FileAlchemy - YAML-formatted plain-text file based models for Flask backed by Flask-SQLAlchemy