snoowrap VS Pushshift API

I've look at the source code on https://github.com/not-an-aardvark/snoowrap/tree/master but the code looks very confusing so I still dont know how it works. Can someone explain? thanks!

There is. Use something like https://github.com/not-an-aardvark/snoowrap and it's easy

You can access directly the official reddit API from this library https://github.com/not-an-aardvark/snoowrap It was wrappers around all the endpoints https://www.reddit.com/dev/api/

I found this library that I can use for streaming everything and from reading this other post on this Reddit it seems like I should first send the comments & submissions to a queue like Apache Kafka and then bulk insert them into my database. I've never used anything like this, so what do you guys recommend?

I use PRAW for the most time but I think otherRequester in this example should work.

Use snoowrap

The Reddit bot looks like it'll be easy. Using a package like https://github.com/not-an-aardvark/snoowrap, it allows syntax like:

I'm learning some JavaScript so I figured I'd do some testing with the Reddit API with snoowrap. I wasn't aware of the API rules when I first started testing, I didn't have a descriptive user agent and I may have been unintentionally making more requests then I should've.

As an average user, you may not notice much difference in your browsing experience. For those using external moderation or accessibility tools, though Reddit has announced that tools/apps focusing on accessibility and moderation will not be negatively affected by the pricing changes, many of these tools are already provided by third-party apps that will be affected. Sites such as Unddit (for tracking post/comment edit history), which run on APIs like Pushshift, that are not quite covered under the vague criteria of being “legal, non-commercial, and helpful to mods,” are likely to no longer work as intended going forward.

Pushshift also supports other query parameters, such as specifying a time range using 'before' and 'after' or sorting the results by 'score', 'num_comments', etc. You can find the full list of query parameters in the Pushshift documentation: https://github.com/pushshift/api

The thing to look at is Pusshift: https://github.com/pushshift/api

Rule 3 says I can't link directly, but I can link to this. Pushshift is absolutely amazing for things like this. Just enter a url like http://api.pushshift.io/reddit/search/comment?q="\[START OF COMMENT TEXT]" and you should be able to find it quite easily.

In the meantime, the third party tool Pushshift can accomplish pretty much the same thing, just with some effort. It's a database of (almost) every comment and submission on Reddit, and you can filter the results based on things like the author and keywords in the body. You can write the queries yourself, but it's much easier to just use a webpage designed to make it easy. For example, if you wanted to find old KITTY pings, you could just enter "groupbot" in the author field, and "KITTY" in the "search term" of https://camas.unddit.com/. The result is this:

It has, https://github.com/pushshift/api code behind the api server here.