CSS llm Projects

dalai

59 13,060 6.5 CSS

The simplest way to run LLaMA on your local machine

Project mention: Ask HN: What are the capabilities of consumer grade hardware to work with LLMs? | news.ycombinator.com | 2023-08-03

I agree, I've definitely seen way more information about running image synthesis models like Stable Diffusion locally than I have LLMs. It's counterintuitive to me that Stable Diffusion takes less RAM than an LLM, especially considering it still needs the word vectors. Goes to show I know nothing.
I guess it comes down to the requirement of a very high end (or multiple) GPU that makes it impractical for most vs just running it in Colab or something.
Tho there are some efforts:
https://github.com/cocktailpeanut/dalai

InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

CSS llm related posts

Ask HN: What are the capabilities of consumer grade hardware to work with LLMs?

1 project | news.ycombinator.com | 3 Aug 2023
How can I run a large language model locally?

1 project | /r/learnprogramming | 11 Jul 2023
meirl

1 project | /r/meirl | 22 May 2023
FreedomGPT: AI with no censorship

3 projects | /r/KotakuInAction | 12 May 2023
Newbie , installed dalai with llama locally, trying to make sense of responses

2 projects | /r/LocalLLaMA | 16 Apr 2023
Deep Learning Newbie Question

1 project | /r/deeplearning | 15 Apr 2023
Printing Dalai full output in Node.Js?

1 project | /r/node | 13 Apr 2023
A note from our sponsor - SaaSHub
www.saashub.com | 19 May 2024

SaaSHub helps you find the best software and product alternatives Learn more →