Bill Gates just published a 7-page letter about AI and his predictions for its future

• text-generation-webui

  876 35,862 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

its closer than you think, you can download the facebook model at the moment but I cant run it as I already use python and a few other versions of torch for other things and i cant seem to get it working but you can look up an easy way here. https://github.com/oobabooga/text-generation-webui/

• llama.cpp

  769 55,846 10.0 C++

  LLM inference in C/C++

https://github.com/ggerganov/llama.cpp [CPU loading with comparatively low memory requirements (7b running on phones and Raspberry Pi 4) - no fancy front end yet]

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project