URS
JobFunnel
Our great sponsors
| URS | JobFunnel | |
|---|---|---|
| 11 | 1 | |
| 727 | 1,740 | |
| - | - | |
| 7.5 | 0.0 | |
| 6 months ago | over 2 years ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
URS
-
Nitter Shutting Down
If they don't want you to use their API just respect their wishes and scrape Reddit. https://github.com/JosephLai241/URS it's the only moral thing we can do.
- GitHub - JosephLai241/URS: Universal Reddit Scraper - A comprehensive Reddit scraping command-line tool written in Python.
-
I'm a complete beginner and would like to use a scraper on r/conspiracys for a school project
For future visitors the steps that this user needed were: (Install python 3.7) git clone --depth=1 https://github.com/JosephLai241/URS.git cd URS pip3 install . -r requirements.txt Then edit the .env contained in the directory with the reddit api credentials
-
Pulling comments from threads with "keyword" in their title?
Just used this repo to do exactly this for a PhD program project. https://github.com/JosephLai241/URS
- 技术老嗨给个支援，有没有好的词频统计方法。试了结巴包感觉词典漏掉了很多，爬了一堆txt留言连紫蜡烛和西朝鲜的的词频都没识别出来
-
Visualizing Data from Pushshift
Shameless plug - I wrote URS which allows you to export comments to JSON in a thread structure. Take a look at the samples branch for examples.
-
Question for using the Universal Reddit Scraper (URS)
I'm new to python, and coding generally. I'm using a great tool called the Universal Reddit Scraper (https://github.com/JosephLai241/URS) to pull some reddit data. It allows you to scrape subreddits, among other things. It creates a CSV file with list of submissions in a given subreddit with each one's ID as a column.
-
Tools for downloading Reddit user profiles and subreddits?
Because I'm not sure this guy does everything you want https://github.com/JosephLai241/URS
-
Wordcloud /r/suomi all-time Top100 postauksista
Toteutettu Universal Reddit Scraperillä.
- My issue with the Transgender_Surgeries Wiki - and how I propose to solve this issue
JobFunnel
-
Late Night Random Discussion Thread - February 05, 2021 at 09:00PM
JobFunnel ( repo for scrapping )
What are some alternatives?
asyncpraw - Async PRAW, an abbreviation for "Asynchronous Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
PornHub-downloader-python - Download stuff from PH the easy way.
reddit-analyzer - Simple python script to analyze reddit accounts
facebook_page_scraper - Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV
RedditDownloader - Scrapes Reddit to download media of your choice.
PythonWebScraping - Python web-scraping projects!
redditcoins-backend - Pull reddit data from APIs and store it in local db
facebook-post-scraper - Facebook Post Scraper 🕵️🖱️
Reddit-Crawler - Crawls for all posts and link comments from a specfic user and posts them to a specific subreddit. Utilizes PRAW and attempts to prevent reposts
languagepod101-scraper - Python scraper for Language Pods such as Japanesepod101.com :japanese_ogre: :japan: :sushi: Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
whatsapp-osint - WhatsApp spy - logs online/offline events from ANYONE in the world
tf-idf - Term Frequency-Inverse Document Frequency from Scratch