SaaSHub helps you find the best software and product alternatives Learn more ā
Cortex.cpp Alternatives
Similar projects and alternatives to cortex.cpp
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
-
-
-
-
FLiPStackWeekly
FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...
-
-
-
nitro
Next Generation Server Toolkit. Create web servers with everything you need and deploy them wherever you prefer.
-
-
server
The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)
-
-
metal-cpp
Metal-cpp is a low-overhead C++ interface for Metal that helps developers add Metal functionality to graphics apps, games, and game engines that are written in C++.
-
-
BigDL
Discontinued Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
-
-
-
-
-
durdraw
Versatile ASCII and ANSI Art text editor for drawing in the Linux/Unix/macOS terminal, with animation, 256 and 16 colors, Unicode and CP437, and customizable themes
cortex.cpp discussion
cortex.cpp reviews and mentions
-
Llama.cpp supports Vulkan. why doesn't Ollama?
There is https://cortex.so/ that Iām looking forward too.
-
Neovim: My Setup for Developer Assistant with Local Language Models
This is the one you are looking for. https://github.com/janhq/cortex
-
Introducing Jan
Jan incorporates a lightweight, built-in inference server called Nitro. Nitro supports both llama.cpp and NVIDIA's TensorRT-LLM engines. This means many open LLMs in the GGUF format are supported. Jan's Model Hub is designed for easy installation of pre-configured models but it also allows you to install virtually any model from Hugging Face or even your own.
-
Ollama Python and JavaScript Libraries
I'd like to see a comparison to nitro https://github.com/janhq/nitro which has been fantastic for running a local LLM.
- FLaNK Weekly 08 Jan 2024
- Nitro: A fast, lightweight 3MB inference server with OpenAI-Compatible API
- Apple Silicon Llama 7B running in docker?
- Is there any LLM that can be installed with out python
-
A note from our sponsor - SaaSHub
www.saashub.com | 12 Jun 2026
Stats
menloresearch/cortex.cpp is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of cortex.cpp is C++.