SAWP VS reddit_sse_stream

Right now all the functionality described in the project readme works as advertised (you can run the example notebook if you want) but I only have a small amount of data. Since I don't want to spend thousands of dollars per month on this, something I'm considering is making it easy to install the entire system and set it up to crawl and store data locally (or run it on heroku) for a user's small scale purposes. That way, somebody can decide to set up their own sunbelt instance and run it for a couple of months to gather data relevant for their project or business interest. Just an idea.

It's easy to get started using Sunbelt for your Reddit data analysis. Simply install the Sunbelt API Wrapper for Python using `pip install sawp`, and follow the rest of the instructions located on GitHub.

Will you still be providing the SSE Stream API using this new bearer token authentication?

Pushshift used to have this https://github.com/pushshift/reddit_sse_stream

while the point of pushshift is absolute collection of data, it also had the https://github.com/pushshift/reddit_sse_stream for getting notified of new posts, which was a godsend for bots (moderation and i guess otherwise) during the short time it worked correctly

use std::io::{Error, ErrorKind}; use futures::prelude::*; #[tokio::main] async fn main() { let url = "http://stream.pushshift.io"; let stream = reqwest::get(url) .await .unwrap() .bytes_stream(); let mut reader = async_sse::decode( stream .map_err(|e| Error::new(ErrorKind::Other, e)) .into_async_read() ); let event = reader.next().await.unwrap(); println!("{:?}", event); }

async fn main() { let url = "http://stream.pushshift.io";