-
hivemind
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
-
petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Do you know of BOINC? I got my idea from that. I believe I may be throwing too much at you, but first I think you should read this about volunteer computing. Sorry after reading it, but BOINC is not what we need. Instead I am thinking in the combination of hivemind and Petals. Especially Petals! I really can't quite sum it up correctly to convince everyone of the advantages of why it would be so awesome to be able to make it possible for everyone run the biggest PygmalionAI language model at home, BitTorrent-style, while also training it and improving it collaboratively.
Do you know of BOINC? I got my idea from that. I believe I may be throwing too much at you, but first I think you should read this about volunteer computing. Sorry after reading it, but BOINC is not what we need. Instead I am thinking in the combination of hivemind and Petals. Especially Petals! I really can't quite sum it up correctly to convince everyone of the advantages of why it would be so awesome to be able to make it possible for everyone run the biggest PygmalionAI language model at home, BitTorrent-style, while also training it and improving it collaboratively.
Related posts
-
Would anyone be interested in contributing to some group projects?
-
Hive mind:Train deep learning models on thousands of volunteers across the world
-
Could a model not be trained by a decentralized network? Like Seti @ home or kinda-sorta like bitcoin. Petals accomplishes this somewhat, but if raw computer power is the only barrier to open-source I'd be happy to try organizing decentalized computing efforts
-
Orca (built on llama13b) looks like the new sheriff in town
-
Do you think that AI research will slow down to a halt because of regulation?