Our great sponsors
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
> A Tangent, but how long before we will see half the population having relationships with their AI assistants like in the sci-fi movie "Her".
I don't know about half, but some people are already having relationships: https://replika.ai/
> Maybe the downfall will not just be climate catastrophe but hyper isolated people living alone with their ultra realistic bot friends and family without any desire to experience the ups and downs of actual social experience.
I think the danger is that bots are not necessarily ultra realistic, at least on an emotional level - they can be 100% subservient and loyal to you.
Also - we already chide parents for letting their kids grow up stuck to a device. Imagine if children could actually have an imaginary friend? Would that AI share the same culture and values as your family?
I suppose there could be some upsides but this is very uncharted territory.
Another great option is https://github.com/oobabooga/text-generation-webui
The 7B model will run without changes on a 3080. The 13B 4-bit model also runs on a 3080.
This Reddit post has the instructions I followed: https://old.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_...
Related posts
- The next generation of AI for developers and Google Workspace
- Alpaca- An Instruct Tuned Llama 7B. Responses on par with txt-DaVinci-3. Demo up
- Haystack DB – 10x faster than FAISS with binary embeddings by default
- CatLIP: Clip Vision Accuracy with 2.7x Faster Pre-Training on Web-Scale Data
- Multimodal Embeddings for JavaScript, Swift, and Python