URS
Reddit-Crawler
Our great sponsors
| URS | Reddit-Crawler | |
|---|---|---|
| 11 | 1 | |
| 727 | 2 | |
| - | - | |
| 7.5 | 0.0 | |
| 6 months ago | over 3 years ago | |
| Python | Python | |
| MIT License | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
URS
-
Nitter Shutting Down
If they don't want you to use their API just respect their wishes and scrape Reddit. https://github.com/JosephLai241/URS it's the only moral thing we can do.
- GitHub - JosephLai241/URS: Universal Reddit Scraper - A comprehensive Reddit scraping command-line tool written in Python.
-
I'm a complete beginner and would like to use a scraper on r/conspiracys for a school project
For future visitors the steps that this user needed were: (Install python 3.7) git clone --depth=1 https://github.com/JosephLai241/URS.git cd URS pip3 install . -r requirements.txt Then edit the .env contained in the directory with the reddit api credentials
-
Pulling comments from threads with "keyword" in their title?
Just used this repo to do exactly this for a PhD program project. https://github.com/JosephLai241/URS
- 技术老嗨给个支援，有没有好的词频统计方法。试了结巴包感觉词典漏掉了很多，爬了一堆txt留言连紫蜡烛和西朝鲜的的词频都没识别出来
-
Visualizing Data from Pushshift
Shameless plug - I wrote URS which allows you to export comments to JSON in a thread structure. Take a look at the samples branch for examples.
-
Question for using the Universal Reddit Scraper (URS)
I'm new to python, and coding generally. I'm using a great tool called the Universal Reddit Scraper (https://github.com/JosephLai241/URS) to pull some reddit data. It allows you to scrape subreddits, among other things. It creates a CSV file with list of submissions in a given subreddit with each one's ID as a column.
-
Tools for downloading Reddit user profiles and subreddits?
Because I'm not sure this guy does everything you want https://github.com/JosephLai241/URS
-
Wordcloud /r/suomi all-time Top100 postauksista
Toteutettu Universal Reddit Scraperillä.
- My issue with the Transgender_Surgeries Wiki - and how I propose to solve this issue
Reddit-Crawler
-
EDIT to Beredore
Source Code found here
What are some alternatives?
asyncpraw - Async PRAW, an abbreviation for "Asynchronous Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
Shreddit - Remove your comment history on Reddit as deleting an account does not do so.
reddit-analyzer - Simple python script to analyze reddit accounts
RedditDownloader - Scrapes Reddit to download media of your choice.
reddit-comment-bot - Reddit bot that auto replies to comments on set subreddits
redditcoins-backend - Pull reddit data from APIs and store it in local db
AmputatorBot - Remove AMP from your URLs. AmputatorBot is a highly specialised Reddit and Twitter bot that automatically replies to comments, submissions and tweets containing AMP URLs with the canonical link(s). It's also available as a website and REST API. See also: https://www.reddit.com/r/AmputatorBot/comments/ehrq3z/why_did_i_build_amputatorbot/.
whatsapp-osint - WhatsApp spy - logs online/offline events from ANYONE in the world
PRAW - PRAW, an acronym for "Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.
reddit-auto-poster.py - Python script for posting to multiple subreddits automagically.
rStardewValleybot - A bot that takes posts from r/StardewValley on Reddit and posts them on Twitter.