psaw
Python Pushshift.io API Wrapper (for comment/submission search) (by dmarx)
SubredditDownloader
This python tools allows downloading of all submissions from a subreddit using Pushshift (API/Files) and the reddit API (by Jabb0)
psaw | SubredditDownloader | |
---|---|---|
20 | 2 | |
311 | 16 | |
- | - | |
0.0 | 0.0 | |
over 2 years ago | about 3 years ago | |
Python | Python | |
BSD 2-clause "Simplified" License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
psaw
Posts with mentions or reviews of psaw.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-12-14.
-
"Unable to connect to pushshift.io."
PSAW is deprecated: https://github.com/dmarx/psaw Try PMAW. Although, be aware of the well documented, ongoing issues with Pushshift itself; some of the wrappers aren't working as expected. I suspect that once the API itself is functioning normally there may be further updates to the wrappers.
-
I've been getting Response status code 404 since Monday morning. Is this due to the system update? Should I be changing my script someway to access the updated API?
This information is contained in the Readme on Github but is not in the readthedocs page for some reason.
-
How to make the bot respond based on invocation and not subreddit
You could use https://github.com/dmarx/psaw to monitor keywords. I haven't personally used it but it is a popular method.
-
How to collect top submissions per day of a specific subreddit?
You can do the first part easily with PSAW if you use python, it lets you get submissions from pushshift and then updates them with the current data from the reddit api. Then you would have to sort them, which is also fairly easy with python.
-
PRAW - How do I get more responses
Most of PRAWs methods have a limit argument. Usually with a default of 100. Set it to None, which actually sets the limit to 1000. You'd have to resort to other APIs if you want more than 1000 items like this: https://github.com/dmarx/psaw.
-
Most posts in search results are only showing a score of 1.
To get live scores or other metadata, you should incorporate accessing the reddit API into your workflow. One easy way to do this is using the 3rd party Pushshift wrapper called PSAW. See the note about setting r = praw.Reddit(...) and api = PushshiftAPI(r).
-
[OC] Modelling /r/CryptoCurrency's Time Variant Subconcious Using Deep Learning!
PSAW: https://github.com/dmarx/psaw
-
Removing deleted/archived posts
Try using psaw. That will query Pushshift first and copy over updated data from reddit.
-
PSAW user question
Try without the `asc` sort parameter. From the source code we can see that it can cause issues https://github.com/dmarx/psaw/blob/master/psaw/PushshiftAPI.py#L162-L164
-
Question/Help - Getting data about user flairs on r/Hololive
I again changed the way I collect data. Adapted from (https://deepnote.com/@deepnote/Mining-and-Exploring-Reddit-Data-using-Python-rfZ7TRRAT2unpCqU6egaKA) and using PSAW (Python Pushshift.io API Wrapper) (https://github.com/dmarx/psaw).
SubredditDownloader
Posts with mentions or reviews of SubredditDownloader.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-01-23.
-
Submission Counts from Popular News Subreddits Via Pushshift
Here is the code: already posted it a couple of times but one more time won't hurt: https://github.com/Jabb0/SubredditDownloader
-
Getting Manyall Submissions From A Subreddit
If you want to download specific features of a subreddit you might want to have a look at this tool I wrote:https://github.com/Jabb0/SubredditDownloader Needs some changes for the features you want but that should be possible without issues.
What are some alternatives?
When comparing psaw and SubredditDownloader you can also consider the following projects:
Pushshift API - Pushshift API
Removeddit - View deleted stuff from reddit
huggingface_hub - The official Python client for the Huggingface Hub.
reddit-flair-popularity
RemindMeBot - u/RemindMeBot on reddit
PrawWrapper - A wrapper around PRAW for easier unit testing