GGML for Falcoder7B, SantaCoder 1B, TinyStarCoder 160M

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • wizardCoder-vsc

    Visual Studio Code extension for WizardCoder

    • Directly, no.. but Someone made a vscode extension for WizardCoder: https://github.com/mzbac/wizardCoder-vsc

  • AutoGPTQ-API

    Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.

    • The backend it uses is however based on AutoGPTQ and not GGML: https://github.com/mzbac/AutoGPTQ-API

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • turbopilot

    Discontinued Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU

    • fyi https://github.com/ravenscroftj/turbopilot

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts