Local LLM Assistant in Zed

• zed

  31 32,865 10.0 Rust

  Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

  

The GitHub issue #4424 for Zed relates to the lack of a feature for using local large language models (LLMs). In response to this, I proposed a workaround that enables the integration of local LLMs into Zed. This solution addresses the need for a non-proprietary, offline alternative to mainstream models like ChatGPT, potentially increasing privacy and control for users.

To integrate a custom model in Zed, I bypassed the limitation of only using OpenAI models. I did this by running the Mistral model from the Ollama library and cloning it to appear as "gpt-4-1106-preview." The steps included pulling and running the Mistral model, then using Ollama's commands to clone it. I updated Zed's settings to point to the local API URL of the cloned model. Restarting Zed applied these changes, enabling the use of the local LLM within Zed's environment.

For more details, you can refer to the GitHub issue directly: https://github.com/zed-industries/zed/issues/4424#issuecomme...

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project