only seeing disk cache slider, no gpu anything?

This page summarizes the projects mentioned and recommended in the original post on /r/KoboldAI

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • koboldcpp

    A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

  • runpodctl

    🧰 | RunPod CLI for pod management

  • Keep in mind you can also use www.runpod.io to rent access to systems with a 3090 for about $.45/hr. It might be significantly cheaper ir at least more affordable to do this for a few hours a week instead of dropping $1,000 on a new laptop. This is what I personally do (I generally use it in the evening, and can get an Nvidia A6000 with 48GB VRAM for $.49/hr spot pricing). This lets me play with the latest 33B and 65B models, with really fast replies, and I spend maybe $5-7 a week if I use it a lot.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • KoboldAI-Runpod

    This is just a simple set of notebooks to load koboldAI and SillyTavern Extras on a runpod with Pytorch 2.0.1 Template

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • DeepRacer-for-Cloud v5.2.2 now available with new real-time training metrics

    2 projects | dev.to | 3 May 2024
  • ipywidgets alternatives - solara and ipyvuetify

    3 projects | 13 Oct 2023
  • On the KoboldAI Lite site, which AI modules are the currently best ones role playing in Adventure Mode or Story Mode?

    1 project | /r/KoboldAI | 18 Aug 2023
  • The Jupyter+Git problem is now solved

    7 projects | news.ycombinator.com | 19 Jul 2023
  • Trying to get into machine learning and create a code that would recognise when my cat is detected on a camera, how should I approach this?

    1 project | /r/learnmachinelearning | 1 Jul 2023