swiss_army_llama

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract. (by Dicklesworthstone)
Add to my DEV experience Suggest topics
Source Code
swiss_army_llama Reviews
Suggest alternative
Edit details
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Swiss_army_llama Alternatives

Similar projects and alternatives to swiss_army_llama

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better swiss_army_llama alternative or higher similarity.
Suggest an alternative to swiss_army_llama

swiss_army_llama reviews and mentions

Posts with mentions or reviews of swiss_army_llama. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-11-26.
  • Ask HN: Cheapest way to run local LLMs?
    6 projects | news.ycombinator.com | 26 Nov 2023
    Depends what you mean by "local". If you mean in your own home, then there isn't a particularly cheap way unless you have a decent spare machine. If you mean "I get to control everything myself" then you can rent a cheap VPS on a value host like Contabo (you can get 8cores, 30gb of ram, and 1tb SSD on Ubuntu 22.04 for something like $35/month-- just stick the to US data centers).

    Then if you want something that is extremely quick and easy to set up and provides a convenient REST api for completions/embeddings with some other nice features, you might want to check out my project here:

    https://github.com/Dicklesworthstone/swiss_army_llama

    Especially if you use Docker to set it up, you can go from a brand new box to a working setup in under 20 minutes and then access it via the Swagger page from any browser.

  • What's the difference between LangChain, llama indexand others like autollm?
    3 projects | news.ycombinator.com | 3 Nov 2023
    I found all of them to be quite bloated and annoying to use directly, which is why I made my own FastAPI based one, Swiss Army Llama. Iā€™m obviously biased, but I far prefer it:

    https://github.com/Dicklesworthstone/swiss_army_llama

  • Show HN: Swiss Army Llama ā€“ A Versatile, FastAPI-Based Multitool for Local LLMs
    1 project | news.ycombinator.com | 10 Oct 2023
  • Show HN: Swiss Army Llama
    2 projects | news.ycombinator.com | 30 Sep 2023
    I just added a very cool feature that lets you supply a sample JSON file and it will automatically generate a BNF grammar for it. You can also supply a pydantic data model description and it will generate the corresponding JSON BNF for you:

    https://github.com/Dicklesworthstone/swiss_army_llama/blob/m...

    And then you can add that grammar file and it will validate it with this:

    https://github.com/Dicklesworthstone/swiss_army_llama/blob/5...

    1 project | news.ycombinator.com | 29 Sep 2023
  • Show HN: Fast Vector Similarity Using Rust and Python
    8 projects | news.ycombinator.com | 23 Aug 2023
    Cool, I also made a similar kind of tool recently that I also shared on HN a couple weeks ago. You might find it useful for generating and managing LLM embeddings locally:

    https://github.com/Dicklesworthstone/llama_embeddings_fastap...

  • Show Show HN: Llama2 Embeddings FastAPI Server
    5 projects | news.ycombinator.com | 15 Aug 2023
    Thanks for pointing out those models. I see from a quick Huggingface search that the bge model is available in GGML format. You can trivially add new GGML format models to the code by simply adding the direct download link to this line:

    https://github.com/Dicklesworthstone/llama_embeddings_fastap...

    So to add the base bge model, you could just add this URL to the list:

    https://huggingface.co/maikaarda/bge-base-en-ggml/resolve/ma...

    I will add that as an additional default.

  • Llama2 Embeddings FastAPI Service
    1 project | /r/LocalLLaMA | 10 Aug 2023
  • Show HN: LLama2 Embeddings API Service Made with FastAPI
    1 project | news.ycombinator.com | 8 Aug 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 4 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more ā†’

Stats

Basic swiss_army_llama repo stats
11
867
8.8
30 days ago

The primary programming language of swiss_army_llama is Python.

Popular Comparisons

  1. swiss_army_llama VS llama_embeddings_fastap
  2. swiss_army_llama VS openembeddings
  3. swiss_army_llama VS np-sims
  4. swiss_army_llama VS serve
  5. swiss_army_llama VS simsimd
  6. swiss_army_llama VS rocketrosti
  7. swiss_army_llama VS DoctorGPT
  8. swiss_army_llama VS fast_vector_similarity
  9. swiss_army_llama VS outlines
  10. swiss_army_llama VS qdrant

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com