DALLE-mtf
v-diffusion-pytorch
DALLE-mtf | v-diffusion-pytorch | |
---|---|---|
41 | 10 | |
435 | 690 | |
0.0% | - | |
0.0 | 0.0 | |
about 2 years ago | over 1 year ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
DALLE-mtf
-
How Open is Generative AI? Part 2
This vision is in line with EleutherAI, a non-profit organization founded in July 2020 by a group of researchers. Driven by the perceived opacity and the challenge of reproducibility in AI, their goal was to create leading open-source language models.
- The open source learning curve for AI researchers
- EleutherAI: Empowering Open-Source Artificial Intelligence Research
-
Seeking advice on fine-tuning Pythia for semantic search in a non-English language
My current idea is to utilize the EleutherAI pythia (Databricks Dolly). I would like to know whether translating the Dolly-15k dataset into the desired language using state-of-the-art translation techniques like DeepL would be a viable approach to fine-tune the Pythia base model. I want to use this model for semantic search, so perfection is not a necessity.
-
Does anyone want to collaborate to make anti-capitalist AI?
There are open source AI efforts, like EleutherAI. Needless to say, they are lagging behind big players, but it's better than nothing.
-
ChatGPT is bonkers.
The new GPT 3.5 isn't aware what are GPT-3.5 or davinci-002 (repeatable) and claimed that it was designed by EleutherAI and has only 6 bil parameters (wasn't been able to repeat but didn't really try).
-
My teacher has falsely accused me of using ChatGPT to use an assignment.
Hi, my name is Stella Biderman and I run EleutherAI, the one of the foremost non-profit research institutes in the world that trains and studies large language models. I have been involved with the majority of models to hold the title “largest open source GPT model in the world” and have dabbled in exploring using plagiarism detection tools to identify code written by GPT-J.
-
dolly-v2-12b
dolly-v2-12bis a 12 billion parameter causal language model created by Databricks that is derived from EleutherAI’s Pythia-12b and fine-tuned on a ~15K record instruction corpus generated by Databricks employees and released under a permissive license (CC-BY-SA)
-
Futurism: "The Company Behind Stable Diffusion Appears to Be At Risk of Going Under"
It is true that Emad needs to find an appropriate business model. The good news is that the hype is still undergoing. I'm sure that Emad can grab another round of liquidity injection. He got plenty of resources. Remember he is also from the finance industry. He got https://www.eleuther.ai/ which can supply a secured, in-house custom LLM equivalent to bloombergGPT.
-
How can AI be used to protect against exploitative use of other AI?
By promoting fully open-source AI, i.e. making datasets, models, methodology and codebases freely available and transparent. What OpenAI claimed to be aiming for, basically.
v-diffusion-pytorch
-
Leaked deck raises questions over Stability AI’s Series A pitch to investors
This is dumb.
We employed Eleuther team members as Stability AI employees/contractors and incubated them until the 501(c)3 was set up and we managed to bring in other funders too: https://techcrunch.com/2023/03/02/stability-ai-hugging-face-...
I am on the board and delighted to continue to support their work as an independent organisation for LM evaluation, alignment and interpretability which is much needed.
Indeed though our approach was handing out significant compute for no control, no equity, no IP.
Anyone who has received Stability AI grants will be able to attest to this with multiple breakthroughs as a result, for example funding https://github.com/BlinkDL/RWKV-LM, the work of https://github.com/lucidrains and others.
Similarly we funded the beta of MidJourney with a cash grant for compute without ever even floating asking for equity etc as it is a market-creating innovation.
At the time MidJourney was using cc12m_1, a model developed by one of our lead (employed) generative AI developers Katherine Crownson / RiversHaveWings (https://github.com/crowsonkb/v-diffusion-pytorch)
Our model is simply to take open innovation and create commercial variants of that (our stable series models) from scratch and on our own, plus variants of that for private data - https://twitter.com/EMostaque/status/1649152422634221593?s=2...
This means we can be hands off versus other funders and trust researchers and help them succeed, something others do not.
-
[D] Is Midjourney AI more-or-less the same architecture as DALL-E 2? Can I read about the model in detail somewhere or is there anything published in this regard?
From what I've gathered by being involved early in the beta / in other discords, Midjourney was originally based on a fine-tuned version of classifier-free guided v-diffusion. The fine-tuning dataset was a manually curated set largely from LAION-2B similar to the laion-art / laion-hd. To make it so fast they were using Progressive Distillation (possibly distilling on PLMS steps rather than p/ddim?) and settings optimized to let them skip a few of the first steps like Quick CLIP-Guided Diffusion. There's a good chance they were doing some prompt augmentation as well, although I think this would be susceptible to prompt discovery attacks which I haven't seen any examples of for Midjourney.
-
Tweet: "Give us a few weeks, open version in the works." regarding an open Google Imagen-like system
Source. This tweet is from a person whose organization has been publicly credited with providing compute for others in the past (example: "Thank you to stability.ai for compute to train these models!").
- Does anyone know which GAN this is?
-
Dall-E 2
com/RiversHaveWings/status/1462859669454536711, 2021.
[8] Katherine Crowson. v-diffusion. https://github.com/crowsonkb/v-diffusion-pytorch, 2021.
- How do I start creating my own AI generated art?
-
Advice on improving Text to Image Model (CC12M Diffusion) model at higher output dimensions?
More parameters are available as seen in this code. The fix was adapted from this.
-
Colab notebook "Text to Image (CC12M Diffusion)" from RiversHaveWings was updated with significantly faster image generation speed. It generates 4 images in 4.75 minutes (not including setup time) on a Tesla K80 GPU (free-tier Colab).
I'm not sure if this Colab notebook was mentioned in this sub previously, but it's been available since January 2022. The cc12m_1_cfg model used by this Colab notebook is different than the cc12m_1 model from this December 2021 post (reference).
-
Airport carpets (a genurary submission)
A few more here https://twitter.com/metasemantic/status/1486334535436488705. Samples careful constructed with a heavily modified diffusion model by @rivershavewings https://github.com/crowsonkb/v-diffusion-pytorch
-
Steampunk Airships
Most of the code was from Katherine Crowson's (@RiversHaveWings) v-diffusion-pytorch library (https://github.com/crowsonkb/v-diffusion-pytorch), which is an implementation of denoising diffusion probabilistic models (https://arxiv.org/abs/2006.11239). I used the CC12M_1 CFG checkpoint.
What are some alternatives?
VQGAN-CLIP - Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.
dalle-mini - DALL·E Mini - Generate images from a text prompt
CLIP-Guided-Diffusion - Just playing with getting CLIP Guided Diffusion running locally, rather than having to use colab.
tensorrtx - Implementation of popular deep learning networks with TensorRT network definition API
gpt-3 - GPT-3: Language Models are Few-Shot Learners
big-sleep - A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun
dalle-2-preview
jaxtorch - A JAX nn library
DALLE-pytorch - Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
glide-text2im - GLIDE: a diffusion-based text-conditional image synthesis model