Basic-UI-for-GPT-J-6B-with-low-vram VS gpt-neo_dungeon

You need a lot of VRAM to run the AI models, scaling somewhat with the amount of parameters a model uses. The most advanced model Pygmalion has is 6 billion parameters, which requires a minimum of 16GB of VRAM to run locally at decent speeds. There are methods of running 6b locally on low VRAM machines as listed here: https://github.com/arrmansa/Basic-UI-for-GPT-J-6B-with-low-vram but even then, the generations would be excruciatingly slow, and the lowest VRAM card used with this method has 6GB of VRAM.

While waiting however I came across https://github.com/arrmansa/Basic-UI-for-GPT-J-6B-with-low-vram which allows you to use some of system memory to run the model. I was able to get a version working with 2.7B on my 2060 6GB with KoboldAI. The github above has an error that prevents it from working (https://github.com/arrmansa/Basic-UI-for-GPT-J-6B-with-low-vram/issues/1), but other than that it works.

Just to add to this, there is a low VRAM version of GPT-J here (suggest 16GB RAM + 8GB GPU).

I found this yesterday, is it somehow possible to use this with KoboldAI to run GPT-J on weaker graphics cards?

There are plenty of free alternatives. Write With Transformer exists, is free, and has a few AI models to choose from. You can try the base GPT-J 6B model on EleutherAI's website, or through the KoboldAI Google Colab. Clover Edition exists, and has multiple AI models to choose from. GPT-Neo Dungeon exists, and uses GPT-Neo, hence the name. Open CYOAI and AI Dungeon 2 Unleashed also exist. GodAI exists as well, and uses GPT-2. KoboldAI is a good frontend for locally running AI models, and it has a subreddit at r/KoboldAI. Dreamily exists, and has a mobile app. However, they require quite a bit of personal information to make an account; only make an account if you trust them with said info. Their privacy policy also, at one point, actually admitted to monitoring private content. There is also a filter in place, though I'm unsure what the filter disallows (aside from mentioning Xi Jinping). Also, HoloAI, Hyperwrite, ShortlyAI, and InferKit have fairly abusable free trials. HoloAI uses GPT-J 6B, InferKit uses Megatron-11B, and Hyperwrite and ShortlyAI both use GPT-3 (although, they both also use OpenAI's incredibly broad filter; quite a lot of stuff is disallowed).

GPT-Neo Dungeon exists, and uses GPT-Neo, hence the name.

Getting an older version of the game isn't a great idea. If you mean an older version of the app, the filter would be there anyways, since the filter is done on the server-side, and the AI would be the same as it is now. The original version of AI Dungeon uses the Classic AI, which I doubt many people are willing to settle for. However, there are plenty of forks of the original version of AID, and some AID clones, such as Clover Edition, GPT-Neo Dungeon, Open CYOAI, and AI Dungeon 2 Unleashed. As was mentioned already, NovelAI also has a text adventure mode that plays near identically to AI Dungeon, and the text adventure module does kinda capture the feel of AI Dungeon. Honestly, all it takes to recreate AI Dungeon on alternatives is to add "> You"/"> You say" at the start of your inputs. Literally all AI Dungeon's Do and Say modes did was add "> You" and "> You say", respectively, to the beginning of your input. Also, I think you're underestimating how many people actually did use AI Dungeon to write serious stories.

NovelAI uses GPT-Neo 2.7B and GPT-J 6B, with subscription tiers of $10/$15/$25 per month. HoloAI uses GPT-J 6B. It has a free trial, and subscription tiers of $5/$8 per month. Hyperwrite offers 1500 outputs for free, and uses GPT-3. After the free trial, a subscription is required. Though, some content (to be more specific, NSFW content) is disallowed. ShortlyAI uses GPT-3, and offers a free trial. After the free trial, a subscription is required. Though, similarly to Hyperwrite, NSFW content is disallowed. Write With Transformer exists, is free, and has a few AI models to choose from. You can try the base GPT-J 6B model on EleutherAI's website, or through the KoboldAI Google Colab. Endless Visual Novel, though it isn't yet released, will be going into closed alpha this month (you can currently sign up for the closed alpha, if it interests you). A subscription (the subscription prices haven't been specified yet) will be required to use the AI and create stories. It uses the GPT-3 Davinci model (the same model that AI Dungeon's Dragon model is based on) for text generation, and also has AI-generated imagery and music to go along with it. As the name implies, it plays in a visual novel format. Depending on what you use AI Dungeon for, it could genuinely end up outclassing AI Dungeon when it releases. There are also some more alternatives worth mentioning, though they all require some setup to get working, and most run locally, which requires more computing power than what the average person has. While they are quite good, the fact that they're aren't exactly user friendly might be a deal breaker for you. Anyhow, Clover Edition exists, and has multiple AI models to choose from. GPT-Neo Dungeon exists, and uses GPT-Neo, hence the name. Open CYOAI and AI Dungeon 2 Unleashed also exist. GodAI exists as well, and uses GPT-2. KoboldAI is a good frontend for locally running AI models, and it has a subreddit at r/KoboldAI.

HoloAI uses GPT-J 6B. It has a free trial, and subscription tiers of $5/$8 per month. Hyperwrite offers 1500 outputs for free, and uses GPT-3. After the free trial, a subscription is required. Though, some content (mostly NSFW content) is disallowed. ShortlyAI uses GPT-3, and offers a free trial. After the free trial, a subscription is required. Though, similarly to Hyperwrite, some content is disallowed. InferKit has a free trial, uses the Megatron 11B model. A subscription is required after the free trial. Write With Transformer exists, is free, and has a few AI models to choose from. You can try the base GPT-J 6B model on EleutherAI's website, or through the KoboldAI Google Colab. Clover Edition exists, and has multiple AI models to choose from. GPT-Neo Dungeon exists, and uses GPT-Neo, hence the name. Open CYOAI and AI Dungeon 2 Unleashed also exist. GodAI exists as well, and uses GPT-2. KoboldAI is a good frontend for locally running AI models, and it has a subreddit at r/KoboldAI. Dreamily exists, and has a mobile app. However, they require quite a bit of personal information to make an account; only make an account if you trust them with said info. Their privacy policy also, at one point, actually admitted to monitoring private content, as well as to collecting quite a lot of personal info and sharing said info with third parties. There is also a filter in place, though I'm unsure what the filter disallows (aside from mentioning Xi Jinping).

I have some other free alternatives to mention (mainly because Dreamily has the same privacy issues that plagued AID, which might be a deal breaker for you, and because Dreamily isn't really the best free alternative). Write With Transformer exists, is free, and has a few AI models to choose from. You can try the base GPT-J 6B model on EleutherAI's website, or through the KoboldAI Google Colab. The base GPT-J 6B model is basically the best free alternative, overall. Clover Edition exists, and has multiple AI models to choose from. GPT-Neo Dungeon exists, and uses GPT-Neo, hence the name. Open CYOAI and AI Dungeon 2 Unleashed also exist. GodAI exists as well, and uses GPT-2. KoboldAI is a good frontend for locally running AI models, and it has a subreddit at r/KoboldAI. Also, to mention some alternatives that have free trials (but aren't completely free), HoloAI uses GPT-J 6B. It has a free trial, and subscription tiers of $5/$8 per month. Hyperwrite offers 1500 outputs for free, and uses GPT-3. Though, some content (mostly NSFW content) is disallowed. ShortlyAI uses GPT-3, and offers a free trial. Though, similarly to Hyperwrite, some content is disallowed. InferKit has a free trial, uses the Megatron 11B model.

NovelAI exists, and uses GPT-J 6B and GPT-Neo 2.7B. It has subscription tiers of $10/$15/$25 per month, and is likely the best alternative overall, with pretty good outputs, a ton of generation options, and a lot of features. HoloAI offers a free trial, and uses GPT-J 6B. After the free trial, it has subscription tiers of $5/$8 per month. Hyperwrite offers 1500 outputs for free, and uses GPT-3. After the free trial, a subscription is required. Though, to comply with OpenAI's ToS, a lot of content is disallowed. ShortlyAI uses GPT-3, and offers a free trial. After the free trial, a subscription is required. Though, similarly to Hyperwrite, some content is disallowed to comply with OpenAI's ToS. InferKit has a free trial, uses the Megatron 11B model. A subscription is required after the free trial. Write With Transformer exists, is free, and has a few AI models to choose from. You can try the base GPT-J 6B model on EleutherAI's website, or through the KoboldAI Google Colab. Clover Edition exists, and has multiple AI models to choose from. GPT-Neo Dungeon exists, and uses GPT-Neo. It also has finetuned models available. Open CYOAI and AI Dungeon 2 Unleashed also exist. GodAI exists as well, and uses GPT-2. KoboldAI is a good frontend for locally running AI models, and it has a subreddit: r/KoboldAI. Dreamily exists, and has a mobile app. However, they require quite a bit of personal information to make an account; only make an account if you trust them with said info. Their privacy policy also (a couple of weeks or so ago, they later removed this part) admitted to actively monitoring adventures. There is also a filter in place, though I'm unsure what the filter disallows (aside from mentioning Xi Jinping). Given that Dreamily has seemingly no monetization, they also may be selling info. AI Tales came out within the last couple of months, though it's significantly more akin to a traditional video game than AI Dungeon or any other alternatives are. The AI isn't great, though, and you generally have far less control over the story than with other AI text generators. However, it's still somewhat interesting, and worth trying. Though, it's currently only available as a mobile app.

HoloAI offers a free trial, and uses GPT-J 6B. After the free trial, it has subscription tiers of $5/$8 per month. Hyperwrite offers 1500 outputs for free, and uses GPT-3. After the free trial, a subscription is required. Though, to comply with OpenAI's ToS, a lot of content is disallowed. ShortlyAI uses GPT-3, and offers a free trial. After the free trial, a subscription is required. Though, similarly to Hyperwrite, some content is disallowed to comply with OpenAI's ToS. InferKit has a free trial, uses the Megatron 11B model. A subscription is required after the free trial. Also, note that the free trials for HoloAI, Hyperwrite, ShortlyAI, and InferKit are all pretty abusable. Write With Transformer exists, is free, and has a few AI models to choose from. You can try the base GPT-J 6B model on EleutherAI's website, or through the KoboldAI Google Colab. Clover Edition exists, and has multiple AI models to choose from. GPT-Neo Dungeon exists, and uses GPT-Neo. It also has finetuned models available. Open CYOAI and AI Dungeon 2 Unleashed also exist. GodAI exists as well, and uses GPT-2. KoboldAI is a good frontend for locally running AI models, and it has a subreddit: r/KoboldAI. Dreamily exists, and has a mobile app. However, they require quite a bit of personal information to make an account; only make an account if you trust them with said info. Their privacy policy also (a couple of weeks or so ago, they later removed this part) admitted to actively monitoring adventures. There is also a filter in place, though I'm unsure what the filter disallows (aside from mentioning Xi Jinping). Given that Dreamily has seemingly no monetization, they also may be selling info. AI Tales came out within the last couple of months, though it's significantly more akin to a traditional video game than AI Dungeon or any other alternatives are. The AI isn't great, though, and you generally have far less control over the story than with other AI text generators. However, it's still somewhat interesting, and worth trying.

NovelAI uses GPT-Neo 2.7B and GPT-J 6B, and has subscription tiers of $10/$15/$25 per month. It's probably the best alternative overall, in terms of output quality, the amount of features, and ease of use. HoloAI offers a free trial, and uses GPT-J 6B. After the free trial, it has subscription tiers of $5/$8 per month. Hyperwrite offers 1500 outputs for free, and uses GPT-3. After the free trial, a subscription is required. Though, to comply with OpenAI's ToS, a lot of content is disallowed. ShortlyAI uses GPT-3, and offers a free trial. Subscriptions start at $25 per month. Though, similarly to Hyperwrite, some content is disallowed to comply with OpenAI's ToS. Philosopher AI exists, and uses the GPT-3 Davinci model; the same model that AI Dungeon's Dragon model uses. Though, it's meant less for storytelling, and meant more for philosophical questions and such, hence the name. You also pay per query, rather than paying a monthly subscription or something, though each query is fairly expensive. InferKit has a free trial, uses the Megatron 11B model, and has subscriptions starting at $20 per month. Write With Transformer exists, is free, and has a few AI models to choose from. You can try the base GPT-J 6B model on EleutherAI's website, or through the KoboldAI Google Colab. Clover Edition exists, and has multiple AI models to choose from. GPT-Neo Dungeon exists, and uses GPT-Neo. It also has finetuned models available. Open CYOAI, and AI Dungeon 2 Unleashed also exist. GodAI exists as well, and uses GPT-2. KoboldAI is a good frontend for locally running AI models, and it has a subreddit: r/KoboldAI. Dreamily exists, and has a mobile app. However, they require quite a bit of personal information to make an account; only make an account if you trust them with said info. Their privacy policy also (a week or so ago, they later removed this part) admitted to actively monitoring adventures. There also seems to be a filter of some sort in place.

You can try HoloAI's free trial. After the free trial, it has subscription tiers of $5/$8 per month. KoboldAI is completely free, and is a good frontend for running AI models locally. Hyperwrite offers 1500 outputs for free, and uses GPT-3. Though, to comply with OpenAI's ToS, a lot of content is disallowed. Talk To Transformer exists, though it's basically a free trial for Inferkit, now. Write With Transformer exists. You can try the base GPT-J 6B model on EleutherAI's website, or through the KoboldAI Google Colab. Clover Edition, GPT-Neo Dungeon, Open CYOAI, and AI Dungeon 2 Unleashed, all exist. GodAI exists. Dreamily exists, and has a mobile app. However, guessing from this post, even though the developer said this was a bug, it seems censorship of some sort is planned. Dreamily also requires a fair bit personal info to make an account; only make an account if you trust them with said personal info. You can still play without an account, though.