tinygrad
tensorflow_macos
| tinygrad | tensorflow_macos | |
|---|---|---|
| 58 | 33 | |
| 17,800 | 2,887 | |
| - | - | |
| 9.7 | 3.4 | |
| 10 months ago | almost 3 years ago | |
| Python | Shell | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tinygrad
- tinygrad: extreme simplicity, easiest framework to add new accelerators to
-
GGML – AI at the Edge
Might be a silly question but is GGML a similar/competing library to George Hotz's tinygrad [0]?
[0] https://github.com/geohot/tinygrad
-
Render neural network into CUDA/HIP code
at first glance i thought may its like tinygrad. but looks has many ops than that tiny grad but most maps to underlying hardware provided ops?
i wonder how well tinygrad's apporach will work out, ops fusion sounds easy, just a walk a graph, pattern match it and lower to hardware provided ops?
Anyway if anyone wants to understand the philosophy behind tinygrad, this file is great start https://github.com/geohot/tinygrad/blob/master/docs/abstract...
-
llama.cpp now officially supports GPU acceleration.
There are currently at least 3 ways to run llama on m1 with GPU acceleration. - mlc-llm (pre-built, only 1 model has been ported) - tinygrad (very memory efficient, not that easy to integrate into other projects) - llama-mps (original llama codebase + llama adapter support)
- George Hotz building an AMD competitor to Nvidia.
-
George Hotz ROCm adventures
Hopefully we will see now full support with AMD hardware on https://github.com/geohot/tinygrad. You can read more about it on https://tinygrad.org/
-
The Coming of Local LLMs
tinygrad
https://github.com/geohot/tinygrad/tree/master/accel/ane
But I have not tested it on Linux since Asahi has not yet added support.
llama.cpp runs at 18ms per token (7B) and 200ms per token (65B) without quantization.
- Everything we know about Apple's Neural Engine
- Everything we know about the Apple Neural Engine (ANE)
- How 'Open' Is OpenAI, Really?
tensorflow_macos
-
Updated Apple Silicon Guide for M2 Pro and M2 Max Chips
https://github.com/apple/tensorflow_macos is no longer needed
-
The hunt for the M1’s neural engine
Tensorflow has a CoreML enabled version which run on ANE.
https://github.com/apple/tensorflow_macos
-
M1 Mac users
Apple released a guide on how to use the M1's integrated Neural Chip in TensorFlow. Have a look at this Apple documentation page (and maybe also this GitHub that talks about TensorFlow together with Apple's own ML Compute platform).
-
MacBook Air or Wait for new potential MacBook Air with M2
Tensorflow does work on Apple Silicon
- Kernels dying when using tensorflow in Jupyter Notebooks.
-
Main PyTorch maintainer confirms that work is being done to support Apple Silicon GPU acceleration for the popular machine learning framework.
Apple did some work to optimize tensorflow for M1, can be found here https://github.com/apple/tensorflow_macos It's alpha, but works fine, I tried it
-
The M1 Max is the fastest GPU we have ever measured in Affinity Photo benchmark
https://github.com/apple/tensorflow_macos/issues/25
https://forums.macrumors.com/threads/apple-silicon-deep-lear...
It is expected that the M1 Max should have similar performance to a RTX-2080 or Titan X.
-
MacBook Pro M1 Pro benchmark
In case anyone is interested, in ran a fairly simple MNIST benchmark (proposed here : https://github.com/apple/tensorflow_macos/issues/25) on my recently acquired M1 Pro MBP (16-core GPU, 16GB RAM).
-
Error while installing tensorflow on Mac M1
The only method I know of to download tensorflow on M1 macs is the one documented here: https://github.com/apple/tensorflow_macos
- How exactly does the Neural Engine benefit the consumer?
What are some alternatives?
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
miniforge - A conda-forge distribution.
llama.cpp - LLM inference in C/C++
Pointnet_Pointnet2_pytorch - PointNet and PointNet++ implemented by pytorch (pure python) and on ModelNet, ShapeNet and S3DIS.
openpilot - openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.
ROCm - AMD ROCm™ Software - GitHub Home [Moved to: https://github.com/ROCm/ROCm]
llama - Inference code for Llama models
flamegraph - Easy flamegraphs for Rust projects and everything else, without Perl or pipes <3
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
Python-docker - Docker Official Image packaging for Python
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
coremltools - Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.