[D] Has anyone here gotten any advantage in inference/training time, or memory footprint by using sparse models instead of Dense? Theoretically, sparsity sounds efficient, but I haven't personally able to get a slight boost even with 90x sparse Resnets.

• AOgmaNeo

  7 49 9.8 C++

  Arduino and Desktop compatible fast online/incremental machine learning system.

  

Not really deep learning, but our biologically-inspired online learning system called AOgmaNeo makes heavy use of sparsity. It can run at over 200fps with 800,000 synapses on a Teensy 4.1 (Arduino-compatible microcontroller). It can also recall 256x256 video 1 minute long on a desktop CPU (trains at ~60 fps).

• blocksparse

  1 1,003 0.0 Cuda

  Efficient GPU kernels for block-sparse matrix multiplication and convolution

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project