Off-topic: What NVIDIA GPU do I need to run privateGPT or Alpaca-Lora for code translations, debugging, unit tests, etc?

• privateGPT

  2 18 7.3 Python

  Interact privately with your documents using the power of GPT, 100% privately, no data leaks (by maozdemir)

• JARVIS

  52 23,054 7.2 Python

  JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

  

https://github.com/microsoft/JARVIS (when ready says >=24GB VRAM)

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• EnergonAI

  1 626 10.0 Python

  Discontinued Large-scale model inference.

  

That's actually an amazing repo, just saw that it looks quite simple to clone and try running inference (text generation) as shown here: https://github.com/hpcaitech/EnergonAI/tree/main/examples/opt

Suggest a related project