SaaSHub helps you find the best software and product alternatives Learn more →
Cortex.cpp Alternatives
Similar projects and alternatives to cortex.cpp
-
-
AppSignal
AppSignal knows why the f*#k it crashed. Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.
-
-
-
-
-
FLiPStackWeekly
FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
ultralytics
Ultralytics YOLO27, YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image classification, pose estimation, object tracking
-
nitro
Next Generation Server Toolkit. Create web servers with everything you need and deploy them wherever you prefer.
-
server
The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)
-
-
BigDL
Discontinued Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
-
-
metal-cpp
Metal-cpp is a low-overhead C++ interface for Metal that helps developers add Metal functionality to graphics apps, games, and game engines that are written in C++.
-
-
-
-
durdraw
Versatile ASCII and ANSI Art text editor for drawing in the Linux/Unix/macOS terminal, with animation, 256 and 16 colors, Unicode and CP437, and customizable themes
-
ollama
Discontinued Get up and running with Llama 2, Mistral, Gemma, and other large language models. [Moved to: https://github.com/ollama/ollama] (by jmorganca)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better cortex.cpp alternative or higher similarity.
cortex.cpp discussion
cortex.cpp reviews and mentions
Posts with mentions or reviews of cortex.cpp.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2025-01-31.
-
Llama.cpp supports Vulkan. why doesn't Ollama?
There is https://cortex.so/ that I’m looking forward too.
-
Neovim: My Setup for Developer Assistant with Local Language Models
This is the one you are looking for. https://github.com/janhq/cortex
-
Introducing Jan
Jan incorporates a lightweight, built-in inference server called Nitro. Nitro supports both llama.cpp and NVIDIA's TensorRT-LLM engines. This means many open LLMs in the GGUF format are supported. Jan's Model Hub is designed for easy installation of pre-configured models but it also allows you to install virtually any model from Hugging Face or even your own.
-
Ollama Python and JavaScript Libraries
I'd like to see a comparison to nitro https://github.com/janhq/nitro which has been fantastic for running a local LLM.
- FLaNK Weekly 08 Jan 2024
- Nitro: A fast, lightweight 3MB inference server with OpenAI-Compatible API
- Apple Silicon Llama 7B running in docker?
- Is there any LLM that can be installed with out python
-
A note from our sponsor - SaaSHub
www.saashub.com | 5 Oct 2026
Stats
Basic cortex.cpp repo stats
10
2,764
9.9
over 1 year ago
menloresearch/cortex.cpp is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of cortex.cpp is C++.
Sponsored
AppSignal knows why the f*#k it crashed.
Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.
www.appsignal.com