Python llamacpp

Open-source Python projects categorized as llamacpp
Edit details
Topics: llama llm Fastapi chatgpt openai
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 12 Python llamacpp Projects

  • code-llama-for-vscode

    Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

    • Project mention: Stable Code 3B: Coding on the Edge | news.ycombinator.com | 2024-01-16

    How are people using codellama and this in their workflows?

    I found one option: https://github.com/xNul/code-llama-for-vscode

    But I'm guessing there are others, and they might differ in how they provide context to the model.

  • realtime-bakllava

    llama.cpp with BakLLaVA model describes what does it see

    • Project mention: Llama.cpp with BakLLaVA model describes what does it see | news.ycombinator.com | 2023-11-04

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • gptme

    A CLI and web UI to interact with LLMs in a Chat-style interface, with code execution capabilities and other tools.

    • Project mention: Fine-tuning Local LLMs for "Code Interpreter" use: Seeking Experience and Insights | /r/LocalLLaMA | 2023-11-01

    I'm building a little code+chat CLI called gptme, that aims to leverage the capabilities of local LLMs to mimic the functionalities offered by OpenAI's "Advanced Data Analysis" (formerly known as "Code Interpreter"). It is similar in spirit to the more popular open-interpreter, which some of you might have heard of.

  • chat-llama-discord-bot

    A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, MPT, or any other Large Language Model (LLM) supported by text-generation-webui or llama.cpp.

  • llama-api

    An OpenAI-like LLaMA inference API

    • Project mention: What do you use to run your models? | /r/LocalLLaMA | 2023-12-07

    https://github.com/c0sogi/llama-api , right? This offers better performance on GPU-optimized models, right?

  • erudito

    Erudito: Easy API/CLI to ask questions about your documentation

    • Project mention: [Local Llama] Exécutez Llama pour poser des questions sur vos fichiers | /r/enfrancais | 2023-05-11

  • langchain-ask-pdf-local

    An AI-app that allows you to upload a PDF and ask questions about it. It uses StableVicuna 13B and runs locally.

    • Project mention: Has anyone been able to train their own model on private data? | /r/LocalLLaMA | 2023-05-27

    Now im using this repo https://github.com/wafflecomposite/langchain-ask-pdf-local But with a wrapper to use oobagoba api (so I can benefit from the gpu power)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • cappr

    Completion After Prompt Probability. Make your LLM make a choice

  • magi_llm_gui

    A Qt GUI for large language models

    • Project mention: What is the best text web ui currently? | /r/LocalLLaMA | 2023-07-04

    Other than Ooba, this is my fav (and works with a TON of model architectures) -> https://github.com/shinomakoi/magi_llm_gui

  • tldwol

    Web API that summarizes multimedia from various sources using modern AI tools.

    • Project mention: Show HN: TL;DWOL – Summarize videos or audio on your machine using AI | news.ycombinator.com | 2023-09-24

  • Exa

    Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and minimal learning curve. (by kyegomez)

    • Project mention: Tree of Thoughts | news.ycombinator.com | 2023-05-26

    The author appears motivated by some... interesting... beliefs. Hard to tell if this entire thing is a joke or not.

    https://github.com/kyegomez/EXA#for-humanity

    https://blog.apac.ai/liberation-awaits

  • LLM_json_schema

    Guaranty the output of an LLM to follow a json schema.

    • Project mention: Show HN: Open-Source JSON Schema Enforcer for LLMs | news.ycombinator.com | 2023-12-05
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python llamacpp related posts

Index

What are some of the best open-source llamacpp projects in Python? This list will help you:

Project Stars
1 code-llama-for-vscode 511
2 realtime-bakllava 361
3 gptme 233
4 chat-llama-discord-bot 113
5 llama-api 101
6 erudito 89
7 langchain-ask-pdf-local 77
8 cappr 63
9 magi_llm_gui 38
10 tldwol 23
11 Exa 20
12 LLM_json_schema 18

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com