open-musiclm
LongNet
| open-musiclm | LongNet | |
|---|---|---|
| 1 | 16 | |
| 488 | 655 | |
| - | - | |
| 7.0 | 9.0 | |
| 12 months ago | 5 months ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
open-musiclm
-
[Research] Pretrained MusicLM?
I'm working on a personal project where I'm planning to create a fine-tuned version of Music LM, but I'm not sure if there are any pretrained weights that I can use that are available to the public. The closest thing that I can find is this: GitHub - zhvng/open-musiclm: Implementation of MusicLM, a text to music model published by Google Research, with a few modifications.which is a modified, custom version of MusicLM, but I'm looking for something closer to the paper. Does anyone have any resources on this?
LongNet
-
Which features you wish that were added to Character Ai?
i wish they would implement this into character.ai github.com/kyegomez/LongNet
- Why AI will not replace programmers.
-
LongLlama
If you want to talk immature looking, longnet wouldn't even compile. That's a big oof, considering it's a python and usually nonworking code is good enough to generate byte code. (also it has hard-coded dtype and device)
-
An open model that beats ChatGPT. We're seeing a real shift towards open source models that will accelerate in the coming weeks.
When will the Open Source LLMs start using LongNet https://github.com/kyegomez/LongNet https://arxiv.org/abs/2307.02486
- GitHub - kyegomez/LongNet: Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
What are some alternatives?
Los-Angeles-Music-Composer - Local windowed attention multi-instrumental music transformer for supervised music generation
Transformer-in-Transformer - An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches
Lars-Ulrich-Challenge - Algorithmic and AI MIDI Drums Generator Implementation
long_llama - LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.
audiocraft-infinity-webui
unilm - Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
Perceiver - Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow
PromptBroker - 🦊 The ONLY AI Prompts Broker you will ever need.
a-PyTorch-Tutorial-to-Transformers - Attention Is All You Need | a PyTorch Tutorial to Transformers
swarms - Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Business Operation Automation. Join our Community: https://discord.gg/DbjBMJTSWD
Play-Billing-v6-For-Unity - A Plugin for Unity which implements Google Play Billing Library v6.0.1 for in app products, made (mostly) by ChatGPT and GPT-4.
nn - 🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠