[D] Intuition about "Discrete Latents" in paper about VQ-VAEs

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • chainer-VQ-VAE

    A Chainer implementation of VQ-VAE.

  • Code for https://arxiv.org/abs/1711.00937 found: https://github.com/dhgrs/chainer-VQ-VAE

  • deep-vector-quantization

    VQVAEs, GumbelSoftmaxes and friends

  • How the codebook is initialised makes a big difference, if more codes are used at the start then they often stay in use but it can be finicky to figure that out. I've found initialising codes normally with small standard deviation (e.g. 0.01) to help (so codes lie on a hypersphere). Failing that, here is an example with k-means initialisation https://github.com/karpathy/deep-vector-quantization .

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Impact of Input Length on the Reasoning Performance of Large Language Models

    1 project | news.ycombinator.com | 1 May 2024
  • Kolmogorov-Arnold Networks

    4 projects | news.ycombinator.com | 30 Apr 2024
  • Quick tip: Write numpy arrays directly to the SingleStore VECTOR data type

    1 project | dev.to | 1 May 2024
  • Navigating the Risky Waters of Loan Defaults: A Predictive Beacon

    1 project | dev.to | 30 Apr 2024
  • Alternative Chunking Methods

    1 project | news.ycombinator.com | 30 Apr 2024