-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
I've tried to understand why praw makes such a long pauses. I've inspected the source code and I found where the pausing time is set and could not understand why it is calculated like this. I decided to look at the commits and, I am very glad, that it was you, who changed the formula, and I can ask you directly! Can you please explain this commit? According to this formula, at the beginning of each period, the pause is always set to 10 seconds. And at the end of the period, script tries to make up the difference. https://github.com/praw-dev/asyncprawcore/commit/a451b3c8682edb79d2c5bcfc62bd2ebd76f81b98
It's been a while, but I put the whole explanation for my change in the ticket here, which includes a link to the spreadsheet (you can make a copy of the spreadsheet to change the variables) where I show the math over time. The goals were to use up requests as fast as possible, ie don't sleep at all, when there's extra ones, and also try to avoid a multi-minute long sleep at the end of the window by preemptively rationing requests when it's behind.