Pushshift API VS psaw

As an average user, you may not notice much difference in your browsing experience. For those using external moderation or accessibility tools, though Reddit has announced that tools/apps focusing on accessibility and moderation will not be negatively affected by the pricing changes, many of these tools are already provided by third-party apps that will be affected. Sites such as Unddit (for tracking post/comment edit history), which run on APIs like Pushshift, that are not quite covered under the vague criteria of being “legal, non-commercial, and helpful to mods,” are likely to no longer work as intended going forward.

Pushshift also supports other query parameters, such as specifying a time range using 'before' and 'after' or sorting the results by 'score', 'num_comments', etc. You can find the full list of query parameters in the Pushshift documentation: https://github.com/pushshift/api

The thing to look at is Pusshift: https://github.com/pushshift/api

Rule 3 says I can't link directly, but I can link to this. Pushshift is absolutely amazing for things like this. Just enter a url like http://api.pushshift.io/reddit/search/comment?q="\[START OF COMMENT TEXT]" and you should be able to find it quite easily.

In the meantime, the third party tool Pushshift can accomplish pretty much the same thing, just with some effort. It's a database of (almost) every comment and submission on Reddit, and you can filter the results based on things like the author and keywords in the body. You can write the queries yourself, but it's much easier to just use a webpage designed to make it easy. For example, if you wanted to find old KITTY pings, you could just enter "groupbot" in the author field, and "KITTY" in the "search term" of https://camas.unddit.com/. The result is this:

It has, https://github.com/pushshift/api code behind the api server here.

PSAW is deprecated: https://github.com/dmarx/psaw Try PMAW. Although, be aware of the well documented, ongoing issues with Pushshift itself; some of the wrappers aren't working as expected. I suspect that once the API itself is functioning normally there may be further updates to the wrappers.

This information is contained in the Readme on Github but is not in the readthedocs page for some reason.

You could use https://github.com/dmarx/psaw to monitor keywords. I haven't personally used it but it is a popular method.

You can do the first part easily with PSAW if you use python, it lets you get submissions from pushshift and then updates them with the current data from the reddit api. Then you would have to sort them, which is also fairly easy with python.

Most of PRAWs methods have a limit argument. Usually with a default of 100. Set it to None, which actually sets the limit to 1000. You'd have to resort to other APIs if you want more than 1000 items like this: https://github.com/dmarx/psaw.

To get live scores or other metadata, you should incorporate accessing the reddit API into your workflow. One easy way to do this is using the 3rd party Pushshift wrapper called PSAW. See the note about setting r = praw.Reddit(...) and api = PushshiftAPI(r).

PSAW: https://github.com/dmarx/psaw

Try using psaw. That will query Pushshift first and copy over updated data from reddit.

Try without the `asc` sort parameter. From the source code we can see that it can cause issues https://github.com/dmarx/psaw/blob/master/psaw/PushshiftAPI.py#L162-L164

I again changed the way I collect data. Adapted from (https://deepnote.com/@deepnote/Mining-and-Exploring-Reddit-Data-using-Python-rfZ7TRRAT2unpCqU6egaKA) and using PSAW (Python Pushshift.io API Wrapper) (https://github.com/dmarx/psaw).