Deep-vector-quantization Alternatives

Similar projects and alternatives to deep-vector-quantization

DALL-E

31 10,711 0.0 Python deep-vector-quantization VS DALL-E

PyTorch package for the discrete VAE used for DALL·E.
chainer-VQ-VAE

1 82 0.0 Python deep-vector-quantization VS chainer-VQ-VAE

A Chainer implementation of VQ-VAE.
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better deep-vector-quantization alternative or higher similarity.

Suggest an alternative to deep-vector-quantization

deep-vector-quantization reviews and mentions

Posts with mentions or reviews of deep-vector-quantization. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-09-08.

[D] Intuition about "Discrete Latents" in paper about VQ-VAEs
2 projects | /r/MachineLearning | 8 Sep 2021

How the codebook is initialised makes a big difference, if more codes are used at the start then they often stay in use but it can be finicky to figure that out. I've found initialising codes normally with small standard deviation (e.g. 0.01) to help (so codes lie on a hypersphere). Failing that, here is an example with k-means initialisation https://github.com/karpathy/deep-vector-quantization .
this is not overfitting but something else, right?
2 projects | /r/deeplearning | 30 Mar 2021

The context is, that I am trying to learn a discrete vocabulary of latent codes, i.e. have a discrete learnable embedding to sort of quantize the otherwise continuous latent outputs of the encoder that are then used to reconstruct the input image via the decoder cf. this code snippet. So the idea is not to generate random sampled from noise but to learn an efficient notebook, i.e. bottleneck that captures the essentials of the data set. The decoder then outputs a prob distribution for every pixel over the 255 possible values 8 bit images can take o. The KL (assuming a uniform prior to encourage uniform use of all possible vocabulary entries) is currently weighted with 1.