LM Studio: A desktop app to discover, download, and run offline LLMs

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  1. llama.cpp

    LLM inference in C/C++

    Like many of you, I've been attempting to follow the developments in the open source / local LLM scene over the last few weeks. Wrapping my head around the different pieces of the puzzle was pretty hard, and actually trying out some models on my laptop took surprisingly a lot of effort.

    I built LM Studio to make discovering local models easy super easy and require no command line setup.

    It is cross-platform, but only the Apple Silicon version is available right now.

    The app is built on top of the llama.cpp project [0] and it should support any model based on the llama architecture + converted to "ggml" [1].

    Here are a few great models to get started with. You can just paste these URLs into the search bar in the app:

    - https://huggingface.co/TheBloke/wizardLM-7B-GGML/tree/previo...

    - https://huggingface.co/TheBloke/Manticore-13B-GGML/tree/prev...

    - https://huggingface.co/eachadea/ggml-vicuna-7b-1.1

    - https://huggingface.co/eachadea/ggml-vicuna-7b-1.1

    Anecdotally, these models run reasonably fast on my M1 MacBook Pro which has 16GB of RAM.

    [0] https://github.com/ggerganov/llama.cpp

    [1] https://github.com/ggerganov/ggml

  2. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  3. ggml

    Tensor library for machine learning

    Like many of you, I've been attempting to follow the developments in the open source / local LLM scene over the last few weeks. Wrapping my head around the different pieces of the puzzle was pretty hard, and actually trying out some models on my laptop took surprisingly a lot of effort.

    I built LM Studio to make discovering local models easy super easy and require no command line setup.

    It is cross-platform, but only the Apple Silicon version is available right now.

    The app is built on top of the llama.cpp project [0] and it should support any model based on the llama architecture + converted to "ggml" [1].

    Here are a few great models to get started with. You can just paste these URLs into the search bar in the app:

    - https://huggingface.co/TheBloke/wizardLM-7B-GGML/tree/previo...

    - https://huggingface.co/TheBloke/Manticore-13B-GGML/tree/prev...

    - https://huggingface.co/eachadea/ggml-vicuna-7b-1.1

    - https://huggingface.co/eachadea/ggml-vicuna-7b-1.1

    Anecdotally, these models run reasonably fast on my M1 MacBook Pro which has 16GB of RAM.

    [0] https://github.com/ggerganov/llama.cpp

    [1] https://github.com/ggerganov/ggml

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Show HN: Transductive regular expressions for text editing

    5 projects | news.ycombinator.com | 7 Feb 2025
  • Make non-Qt apps look native on Qt desktops

    1 project | dev.to | 7 Feb 2025
  • Ext4backup, a tool that tries to preserve as much information as possible

    1 project | news.ycombinator.com | 7 Feb 2025
  • Build a TCP Web Server in C: A Beginner’s Guide

    1 project | dev.to | 7 Feb 2025
  • How to Set Up a Free RTMP Server with Open Source Red5

    1 project | dev.to | 6 Feb 2025

Did you know that C is
the 6th most popular programming language
based on number of references?