gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization (by RahulSChand)

Gpu_poor Alternatives

Similar projects and alternatives to gpu_poor

  • ollama

    Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  • outlines

    Structured Text Generation

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
  • instructor

    structured outputs for llms

  • swiss_army_llama

    A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

  • LLamaStack

    Discontinued ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp

  • chatd

    2 gpu_poor VS chatd

    Chat with your documents using local AI

  • llama.net

    .NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. 🦙

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • chitchat

    2 gpu_poor VS chitchat

    A simple LLM chat front-end that makes it easy to find, download, and mess around with models on your local machine. (by clarkmcc)

  • Pacha

    1 gpu_poor VS Pacha

    "Pacha" TUI (Text User Interface) is a JavaScript application that utilizes the "blessed" library. It serves as a frontend for llama.cpp and provides a convenient and straightforward way to perform inference using local language models.

  • code-llama-for-vscode

    Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better gpu_poor alternative or higher similarity.

gpu_poor reviews and mentions

Posts with mentions or reviews of gpu_poor. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-11-26.

Stats

Basic gpu_poor repo stats
3
623
8.3
6 months ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com