tarsier
datadoubleconfirm
tarsier | datadoubleconfirm | |
---|---|---|
8 | 1 | |
1,003 | 55 | |
53.4% | - | |
9.1 | 4.5 | |
6 days ago | 6 months ago | |
Jupyter Notebook | Jupyter Notebook | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tarsier
-
ScrapeGraphAI: Web scraping using LLM and direct graph logic
Agreed!
Apify's Website Content Crawler[0] does a decent job of this for most websites in my experience. It allows you to "extract" content via different built-in methods (e.g. Extractus [1]).
We currently use this at Magic Loops[2] and it works _most_ of the time.
The long-tail is difficult though, and it's not uncommon for users to back out to raw HTML, and then have our tool write some custom logic to parse the content they want from the scraped results (fun fact: before GPT-4 Turbo, the HTML page was often too large for the context window... and sometimes it still is!).
Would love a dedicated tool for this. I know the folks at Reworkd[3] are working on something similar, but not sure how much is public yet.
[0] https://apify.com/apify/website-content-crawler
[1] https://github.com/extractus/article-extractor
[2] https://magicloops.dev/
[3] https://reworkd.ai/
- Control the browser using GPT-4 vision by AgentGPT team
- Show HN: GPT-4 vision utilities to browse the web
datadoubleconfirm
-
Make Your Own Tourist Map
Next, I needed location data for MRT stations. These were sourced here.
What are some alternatives?
python-awesome - Learn Python, Easy to learn, Awesome
NBA-attendance-prediction - Attendance prediction tool for NBA games using machine learning. Full pipeline implemented in Python from data ingestion to prediction. Attained mean absolute error of around 800 people (about 5% capacity) on test set.
article-extractor - To extract main article from given URL with Node.js
Data-extraction-and-text-analysis - The objective of this assignment is to extract textual data articles from the URL and perform text analysis to compute variables.
html2text - Convert HTML to Markdown-formatted text.
danbooru-tags - An analysis of tags and metadata on Danbooru