[R] My simple Transformer audio encoder gives the same output for each timestep after the encoder

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • taming-transformers

    Taming Transformers for High-Resolution Image Synthesis

  • What’s your goal exactly? Are you trying to make a transformer based auto encoder of audio spectrograms? If so you should either start with either a proven ViT-based AE implementation (either a VAE or a VQ-GAN). But I don’t see why you necessarily need a ViT for this, if you’re working at a much smaller scale a convolutional architecture is plenty and much more amenable to beginners. See https://github.com/CompVis/taming-transformers for an example of a convolutional VQ GAN.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Finetune a GPT Model for Spam Detection on Your Laptop in Just 5 Minutes

    1 project | news.ycombinator.com | 3 May 2024
  • AI Agent Notebooks Using LangChain, LlamaIndex, Milvus, and More

    1 project | news.ycombinator.com | 3 May 2024
  • Mastering Dataset Acquisition: A Comprehensive Guide

    2 projects | dev.to | 3 May 2024
  • Simple GitHub Issue Handled(?) By Copilot Workspace

    1 project | news.ycombinator.com | 2 May 2024
  • Show HN: Hamilton's UI – observability, lineage, and catalog for data pipelines

    1 project | news.ycombinator.com | 2 May 2024