Would anyone be interested in contributing to some group projects?

• vtx

  1 6 9.9 HTML

  an experiment (by 0-5788719150923125)

  

The other project I've recently spent a lot of time with is, in large part, a chat bot. It uses Huggingface's Transformers for inference, a LightningAI for training, and Docker for automation of nearly every task. At every level, it was designed for the desktop user (small models, single GPU). The bot is capable of connecting to Discord, Telegram, Twitch, Reddit, Twitter, and the Source (of course!)

• petals

  98 8,661 8.5 Python

  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

  

Recently, I've added support for Petals to this bot. I was hoping to experiment with some prefix-tuning of smaller models (like BLOOM 560m), but there's nobody hosting them - and I do not have enough VRAM to do it myself! I would greatly appreciate some additional GPUs, here.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• box

  1 3 10.0 HTML

  Discontinued a framework [Moved to: https://github.com/0-5788719150923125/vtx] (by 0-5788719150923125)

  

I really hope you'll join me, for the Petals support, at least! A single docker-compose.yml file is all we need, for now. If we are able to find enough people willing to host some smaller models, perhaps we could expand into the Hivemind, and create our own, custom foundation model one day?

• hivemind

  40 1,837 5.4 Python

  Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

  

I really hope you'll join me, for the Petals support, at least! A single docker-compose.yml file is all we need, for now. If we are able to find enough people willing to host some smaller models, perhaps we could expand into the Hivemind, and create our own, custom foundation model one day?

Suggest a related project