llama.cpp support has been added!

This page summarizes the projects mentioned and recommended in the original post on /r/Oobabooga

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • text-generation-webui

    A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

  • Documentation

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • llamacpp-python

    Python bindings for llama.cpp

  • This was contributed by @thomasantony and made possible by his llamacpp-python library.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Show HN: Collate multiple PDFs into one with cover and automatic TOC

    1 project | news.ycombinator.com | 15 Jun 2024
  • New Linux distro: PyTermOS

    1 project | dev.to | 15 Jun 2024
  • Tesla's FSD – A Useless Technology Demo

    1 project | news.ycombinator.com | 15 Jun 2024
  • Jax, NumPy, PyTorch or ONNX export with no code duplication

    1 project | news.ycombinator.com | 15 Jun 2024
  • Ask HN: Are you aware of a sane path to selfhosted email server?

    2 projects | news.ycombinator.com | 8 Jun 2024