tarsier
PokeData
| tarsier | PokeData | |
|---|---|---|
| 8 | 1 | |
| 1,003 | 1 | |
| 53.4% | - | |
| 9.1 | 0.0 | |
| 6 days ago | over 2 years ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tarsier
-
ScrapeGraphAI: Web scraping using LLM and direct graph logic
Agreed!
Apify's Website Content Crawler[0] does a decent job of this for most websites in my experience. It allows you to "extract" content via different built-in methods (e.g. Extractus [1]).
We currently use this at Magic Loops[2] and it works _most_ of the time.
The long-tail is difficult though, and it's not uncommon for users to back out to raw HTML, and then have our tool write some custom logic to parse the content they want from the scraped results (fun fact: before GPT-4 Turbo, the HTML page was often too large for the context window... and sometimes it still is!).
Would love a dedicated tool for this. I know the folks at Reworkd[3] are working on something similar, but not sure how much is public yet.
[0] https://apify.com/apify/website-content-crawler
[1] https://github.com/extractus/article-extractor
[2] https://magicloops.dev/
[3] https://reworkd.ai/
- Control the browser using GPT-4 vision by AgentGPT team
- Show HN: GPT-4 vision utilities to browse the web
PokeData
What are some alternatives?
python-awesome - Learn Python, Easy to learn, Awesome
datadoubleconfirm - Simple datasets and notebooks for data visualization, statistical analysis and modelling - with write-ups here: http://projectosyo.wix.com/datadoubleconfirm.
article-extractor - To extract main article from given URL with Node.js
ML-Workspace - 🛠All-in-one web-based IDE specialized for machine learning and data science.
html2text - Convert HTML to Markdown-formatted text.
Data-Science-For-Beginners - 10 Weeks, 20 Lessons, Data Science for All!
Data-extraction-and-text-analysis - The objective of this assignment is to extract textual data articles from the URL and perform text analysis to compute variables.
AutoCrawler - Official implement of paper "AutoCrawler: A Progressive Understanding Web Agent for Web Crawler Generation"
dude - dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators