Reddit-Crawler
Crawls for all posts and link comments from a specfic user and posts them to a specific subreddit. Utilizes PRAW and attempts to prevent reposts (by TrippW)
URS
Universal Reddit Scraper - A comprehensive Reddit scraping/archival command-line tool. (by JosephLai241)
Our great sponsors
| Reddit-Crawler | URS | |
|---|---|---|
| 1 | 11 | |
| 2 | 727 | |
| - | - | |
| 0.0 | 7.5 | |
| over 3 years ago | 6 months ago | |
| Python | Python | |
| GNU General Public License v3.0 only | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Reddit-Crawler
Posts with mentions or reviews of Reddit-Crawler.
We have used some of these posts to build our list of alternatives
and similar projects.
-
EDIT to Beredore
Source Code found here
URS
Posts with mentions or reviews of URS.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-01-27.
-
Nitter Shutting Down
If they don't want you to use their API just respect their wishes and scrape Reddit. https://github.com/JosephLai241/URS it's the only moral thing we can do.
- GitHub - JosephLai241/URS: Universal Reddit Scraper - A comprehensive Reddit scraping command-line tool written in Python.
-
I'm a complete beginner and would like to use a scraper on r/conspiracys for a school project
For future visitors the steps that this user needed were: (Install python 3.7) git clone --depth=1 https://github.com/JosephLai241/URS.git cd URS pip3 install . -r requirements.txt Then edit the .env contained in the directory with the reddit api credentials
-
Pulling comments from threads with "keyword" in their title?
Just used this repo to do exactly this for a PhD program project. https://github.com/JosephLai241/URS
- 技术老嗨给个支援，有没有好的词频统计方法。试了结巴包感觉词典漏掉了很多，爬了一堆txt留言连紫蜡烛和西朝鲜的的词频都没识别出来
-
Visualizing Data from Pushshift
Shameless plug - I wrote URS which allows you to export comments to JSON in a thread structure. Take a look at the samples branch for examples.
-
Question for using the Universal Reddit Scraper (URS)
I'm new to python, and coding generally. I'm using a great tool called the Universal Reddit Scraper (https://github.com/JosephLai241/URS) to pull some reddit data. It allows you to scrape subreddits, among other things. It creates a CSV file with list of submissions in a given subreddit with each one's ID as a column.
-
Tools for downloading Reddit user profiles and subreddits?
Because I'm not sure this guy does everything you want https://github.com/JosephLai241/URS
-
Wordcloud /r/suomi all-time Top100 postauksista
Toteutettu Universal Reddit Scraperillä.
- My issue with the Transgender_Surgeries Wiki - and how I propose to solve this issue
What are some alternatives?
When comparing Reddit-Crawler and URS you can also consider the following projects:
Shreddit - Remove your comment history on Reddit as deleting an account does not do so.
asyncpraw - Async PRAW, an abbreviation for "Asynchronous Python Reddit API Wrapper", is a python package that allows for simple access to Reddit's API.