ctransformers
artificial-nose
| ctransformers | artificial-nose | |
|---|---|---|
| 4 | 5 | |
| 1,718 | 343 | |
| - | - | |
| 8.6 | 2.3 | |
| 4 months ago | 8 months ago | |
| C | C | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ctransformers
-
Refact LLM: New 1.6B code model reaches 32% HumanEval and is SOTA for the size
Does ctransformer (https://github.com/marella/ctransformers#supported-models) support running refact?
I see that model type "gpt_refact" in https://huggingface.co/smallcloudai/Refact-1_6B-fim/blob/mai...
-
How do I utilize these quantized models being uploaded?
You can also use ctransformers with the ggml models if you want to use python rather than c++.
-
Langchain and self hosted LLaMA hosted API
For ggml https://github.com/marella/ctransformers/ and https://github.com/abetlen/llama-cpp-python has a decent server. https://github.com/go-skynet/LocalAI is very active too.
- Also reconnecting with Scala. Interested in LLMs
artificial-nose
- Can someone explain how the Grove Gas Sensor V2 (Multichannel) works?
-
13yo kid builds TinyML powered “e-nose” to diagnose pneumonia
No, the author designed the ML training project also, and there is no actual code. The last section of the Make article is how to send the data to Edge Impulse and configure the ML training [0].
Mentioning Microsoft Azure IoT Central in the article and the video is odd, because you definitely don't need that to complete this project. It seems to be a feature that the Microsoft employee added to the GitHub project their self [1].
Caleb mentioned in the video that a co-worker of his aunt authored the research paper about detecting bacterial pneumonia from VOC levels. Everything else feels like a Microsoft marketing hype train that went off the rails.
[0]: https://makezine.com/projects/second-sense-build-an-ai-smart...
[1]: https://github.com/kartben/artificial-nose/blob/master/firmw...
- TinyML powered artificial nose
-
I built an artificial nose powered by AI. What are the top/most useful scents I should train it to recognize out-of-the-box?
I don't think I ever posted the link to the GitHub repo containing the source code, 3D model, bill of materials, and more... 😊 https://github.com/kartben/artificial-nose
What are some alternatives?
llama-cpp-python - Python bindings for llama.cpp
kendryte-standalone-sdk - Standalone SDK for kendryte K210
LangChain_PDFChat_Oobabooga - oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local
Tasmota - Alternative firmware for ESP8266 and ESP32 based devices with easy configuration using webUI, OTA updates, automation using timers or rules, expandability and entirely local control over MQTT, HTTP, Serial or KNX. Full documentation at
text-generation-inference - Large Language Model Text Generation Inference
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
lamp - deep learning and scientific computing framework with native CPU and GPU backend for the Scala programming language
TornadoVM - TornadoVM: A practical and efficient heterogeneous programming framework for managed languages
basaran - Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
LocalAI - :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.