tarsier
python-awesome
tarsier | python-awesome | |
---|---|---|
8 | 11 | |
1,003 | 251 | |
53.4% | - | |
9.1 | 0.0 | |
6 days ago | over 2 years ago | |
Jupyter Notebook | Jupyter Notebook | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tarsier
-
ScrapeGraphAI: Web scraping using LLM and direct graph logic
Agreed!
Apify's Website Content Crawler[0] does a decent job of this for most websites in my experience. It allows you to "extract" content via different built-in methods (e.g. Extractus [1]).
We currently use this at Magic Loops[2] and it works _most_ of the time.
The long-tail is difficult though, and it's not uncommon for users to back out to raw HTML, and then have our tool write some custom logic to parse the content they want from the scraped results (fun fact: before GPT-4 Turbo, the HTML page was often too large for the context window... and sometimes it still is!).
Would love a dedicated tool for this. I know the folks at Reworkd[3] are working on something similar, but not sure how much is public yet.
[0] https://apify.com/apify/website-content-crawler
[1] https://github.com/extractus/article-extractor
[2] https://magicloops.dev/
[3] https://reworkd.ai/
- Control the browser using GPT-4 vision by AgentGPT team
- Show HN: GPT-4 vision utilities to browse the web
python-awesome
-
Python tutorial on Github. Please like and sponsor for more tutorials
Python tutorial on Github. Please like and sponsor for more tutorials - https://github.com/gautam1858/python-awesome
- Excellent Python tutorial. Please like sponsor for more tutorials
- Excellent Python tutorial, please like, sponsor for more tutorials
- Excellent Python tutorial, please sponsor for more tutorials
- Python Course for Beginners on GitHub – Please Support via GitHub Sponsorship
- Github Curriculum for Python and Machine Learning - Looking for Github Sponsor
- GitHub Curriculum for Python and Machine Learning – Looking for GitHub Sponsor
- Learn Python, Easy to learn, way to get started
What are some alternatives?
article-extractor - To extract main article from given URL with Node.js
bigpython - Source code for Big Python tutorials on YouTube
html2text - Convert HTML to Markdown-formatted text.
start-machine-learning - A complete guide to start and improve in machine learning (ML), artificial intelligence (AI) in 2024 without ANY background in the field and stay up-to-date with the latest news and state-of-the-art techniques!
datadoubleconfirm - Simple datasets and notebooks for data visualization, statistical analysis and modelling - with write-ups here: http://projectosyo.wix.com/datadoubleconfirm.
100-plus-Python-programming-exercises-extended - The repository is about 100+ python programming exercise problem discussed, explained, and solved in different ways
Data-extraction-and-text-analysis - The objective of this assignment is to extract textual data articles from the URL and perform text analysis to compute variables.
awesome-python-for-data-science - A curated list of awesome resources such as books, tutorials, courses, open-source libraries, exercises, and other materials that support Pythonistas in the making, and Pythonistas migrating into Data Science! 📊
AutoCrawler - Official implement of paper "AutoCrawler: A Progressive Understanding Web Agent for Web Crawler Generation"
dude - dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators