Downsampling Time Series for Visual Representation [pdf]

• abstreet

  56 7,312 8.9 Rust

  Transportation planning and traffic simulation software for creating cities friendlier to walking, biking, and public transit

  

Does anybody know an approach for downsampling time series when you need to compare two downsampled series? Let's say:

1) You measure millions of (time, count) events, covering 24hrs.

2) You downsample this somehow to save space.

3) You start measuring (time, count) events again, covering 7 hours. You expect the data to match up with the previous measurements, and you'd like to plot differences.

Is there a way to trim the downsampled 24hr set so that it matches the downsampled 7hr set?

Motivation: https://github.com/a-b-street/abstreet/issues/85

• flot-downsample

  2 269 0.0 JavaScript

  Downsample plugin for Flot charts.

• SurveyJS

  surveyjs.io featured

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• simplify-js

  2 2,222 0.0 JavaScript

  High-performance JavaScript polyline simplification library

This looks cool, I especially like the "intuitive" longest line algorithm.

~7 years ago I was trying to build a dashboard that displayed real-time measurements from a beehive. The sensors would take temperature, weight, humidity, etc. Back then I used simplify.js [0] which uses two simplification algorithms in two passes. The more compute intensive one is the Ramer Douglas Peucker algorithm [1]. One issue I had with streaming data is that new data points could change the past line, at least with my naive implementation. I'd love to see a real-time / streaming time series simplification algorithm where the past points don't appear to change wildly despite continuing to downsample.

[0] https://github.com/mourner/simplify-js

[1] https://en.wikipedia.org/wiki/Ramer%E2%80%93Douglas%E2%80%93...

• masterscrat

  1 - -

Interesting to see this pop up here! I was looking for a solution to plot terabytes of time series during my MSc Thesis at CERN and ended up adding support for this to a Grafana fork. Fun times.

Details here: https://github.com/MasterScrat/masterscrat.github.io/blob/ma...

Suggest a related project