awesome-golem
gpt-neo
awesome-golem | gpt-neo | |
---|---|---|
34 | 82 | |
184 | 6,158 | |
2.2% | - | |
6.8 | 7.3 | |
4 months ago | about 2 years ago | |
Python | ||
Creative Commons Zero v1.0 Universal | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-golem
-
Isn't ICP a *clear* evolution of blockchain technology, am I missing something?
If you want to run scientific calculations or similar, I highly recommend Golem. Right now, its best applications are ones that can scale by sharding, to use parallel computations. Think doing 100 similar small jobs on 100 computers instead of 1 large job on 1 computer. One average CPU-month costs $3.17, or you can rent 100 CPU-hours for $0.44. Notable examples are blender_cuda which runs on a GPU, and the entirety of awesome-golem.
-
PSA | Developers, do this on your repositories!
Adding the repository to the awesome-golem repository. Doing this makes it possible to scout a neat and organized list of projects, without having to do much digging. There are categories that help go through the list quickly, for those that are looking for something specific.
-
Daily General Discussion - November 12, 2021
There are lots of use cases on Golem. Many of which were created by the community. You can keep track of them relatively easily on Awesome Golem (all the applications on that list were created within the last year, for the latest implementation, Yagna).
-
Wildland Update (GLM - Golem Foundation Project) & why Golem is a sleeping giant
See everything you can do with Golem: https://github.com/golemfactory/awesome-golem
-
What's a coin that was popular and had a lot of hype at one time, but now completely died down?
Golem as a project is larger than it's ever been, there's an awesome list of community created apps and tools, the network has more nodes this year than it has before (stats), there's been over 300k GNT / GLM given out to the community in the GLM Rewards Program, not including bounties and hackathons in the last year (48,000 GLM + 83,180 USDC).
- Auto Editor on Golem
-
Welcome to the Fall edition of the Golem AMA - October 6th, 2021, 6pm CEST
The Golem ecosystem is growing steadily (here’s our Awesome list in case you missed it, recently listed on the overall Awesome repository with over 160k stars!)
-
Introducing Thorg: mining made easy and fun, powered by Golem
There are actually already quite a few things you can do with Golem already before Thorg. It's part of the reason why Awesome Golem, containing all the useful stuffs is already listed on the overall Awesome repo which is the 8th highest starred repo on GitHub.
-
Any crypto veterans want to share what were the 'next big thing' coins back in 2017 that flopped?
It's also much easier to build applications on the new network as a potential requestor. We have a lot of community-created apps that people can run and/or learn from. There are also tools that are community-created which never existed around Clay Golem. You can find most of them listed here on Awesome Golem.
-
Understanding Golem
Awesome-Golem - for pre-existing applications.
gpt-neo
-
How Open is Generative AI? Part 2
By December 2020, EleutherAI had introduced The Pile, a comprehensive text dataset designed for training models. Subsequently, tech giants such as Microsoft, Meta, and Google used this dataset for training their models. In March 2021, they revealed GPT-Neo, an open-source model under Apache 2.0 license, which was unmatched in size at its launch. EleutherAI’s later projects include the release of GPT-J, a 6 billion parameter model, and GPT-NeoX, a 20 billion parameter model, unveiled in February 2022. Their work demonstrates the viability of high-quality open-source AI models.
-
Creating an open source chat bot like ChatGPT for my own dataset without GPU?
Yeah, if that is your requirement you should definitely ignore chatterbot, as its older and probably not what your teacher wants. I'm looking at the gpt-neo docs right now: https://github.com/EleutherAI/gpt-neo
-
Any real competitor to GPT-3 which is open source and downloadable?
3.) EleutherAI's GPT-Neo and GPT-NeoX: EleutherAI is an independent research organization that aims to promote open research in artificial intelligence. They have released GPT-Neo, an open-source language model based on the GPT architecture, and are developing GPT-NeoX, a highly-scalable GPT-like model. You can find more information on their GitHub repositories: GPT-Neo: https://github.com/EleutherAI/gpt-neo GPT-NeoX: https://github.com/EleutherAI/gpt-neox
-
⚡ Neural - AI Code Generation for Vim
This is one of the first comprehensive plugins that has been rewritten to support multiple AI backends such as OpenAI GPT3+ and other custom sources in the future such as ChatGPT, GPT-J, GPT-neo and more.
-
Looks like some Taliban fighters are getting burnt out working the 9-5 grind
GPT-Neo is newer than GPT-2 on the open source side of things. In my experience, it tends to give longer and more creative responses than GPT-2 but not on the level of GPT-3. I've not tried GPT-J or GPT-NeoX, but they're also open source and reportedly better than GPT-Neo (albeit less accessible).
- H3 - a new generative language models that outperforms GPT-Neo-2.7B with only *2* attention layers! In H3, the researchers replace attention with a new layer based on state space models (SSMs). With the right modifications, they find that it can outperform transformers.
- First Open Source Alternative to ChatGPT Has Arrived
-
Where is the line for AI and where does ChatGPT stand?
Finally, yes-- it is trained via masked language modeling (text prediction). The approach has been fairly standard for years- the big difference with the GPT* models is the number of paramaters and volume of text-- we still haven't reached a ceiling with LLM parameters- they appear to keep improving with size. This training allows the model to learn a strong representation of language. Their training approach is published and open-source GPT* versions have already been made and released (https://github.com/EleutherAI/gpt-neo). However, the models are huge and can't be run locally for hobbyists. This gets at larger issues in democratization of ML.
- Using the GPT-3 AI Writer inside Obsidian(This is COOL)
-
Teaser trailer for "The Diary of Sisyphus" (2023), the world's first feature film written by an artificial intelligence (GPT-NEO) and produced Briefcase Films, my indie film studio based in Northern Italy
- GPT-Neo 2.7B, released Mar/2021, and unmaintained/unsupported as of Aug/2021? or;
What are some alternatives?
yapapi - Python high-level API for Golem.
gpt-neox - An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
community-golem-docs - Collection of community-created documentation for Golem
haystack - :mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
DeML-Golem - Proof Of Concept of DEcentralised Machine Learning on top of the Golem (https://golem.network/) architecture
openchat - OpenChat: Easy to use opensource chatting framework via neural networks
siad - The Sia daemon
tensorflow - An Open Source Machine Learning Framework for Everyone
goth - Golem Test Harness, an integration testing framework for yagna - the (new) Golem Network client.
mesh-transformer-jax - Model parallel transformers in JAX and Haiku
auto-editor - Auto-Editor: Effort free video editing!
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.