ncnn
volk
Our great sponsors
ncnn | volk | |
---|---|---|
12 | 8 | |
19,176 | 1,197 | |
1.8% | - | |
9.4 | 8.1 | |
5 days ago | 6 days ago | |
C++ | C | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ncnn
-
AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source
ncnn uses Vulkan for GPU acceleration, I've seen it used in a few projects to get AMD hardware support.
https://github.com/Tencent/ncnn
-
[D] Best way to package Pytorch models as a standalone application
They're using NCNN to package the model. Have a look. https://github.com/Tencent/NCNN
-
Realtime object detection android app
Hi. Here is my prefered android app for realtime objet detection: https://github.com/nihui/ncnn-android-nanodet ; https://github.com/Tencent/ncnn contains a lot of android demo app for a lot of models.
- ncnn: High-performance neural network inference framework optimized for mobile
-
Esp32 tensorflow lite
ncnn home page: https://github.com/Tencent/ncnn
-
MMDeploy: Deploy All the Algorithms of OpenMMLab
ncnn
-
Draw Things, Stable Diffusion in your pocket, 100% offline and free
Yes, Android devices tend to have bigger RAMs, making running 1024x1024 possible (this is not possible at all on iPhones, which could peak around 5GiB memory with my current implementation, some serious engineering required to bring that down on iPhone devices). The problem is I am not sure about speed. I would likely switch to NCNN (https://github.com/Tencent/ncnn) as the backend which have a decent Vulkan computing kernel support. It is definitely a possibility and there is a path to do that.
- What’s New in TensorFlow 2.10?
-
[Technical Article] OCR Upgrade
As the leading open-source inference framework in China and in the world, what we like are its almost zero cost cross-platform capability, high inference speed, and minimal deployment volume. (Project address: https://github.com/Tencent/ncnn)
-
Is there a functioning neural netowork or backbone written in pure C language only?
If you’re not planning on training the neural net on an embedded device and just do inference, this might interest you: https://github.com/Tencent/ncnn
volk
-
Volk makes my VkInstance NULL
Im learning Vulkan in attempt to create a renderer for a video game I plan on making. Following the spec https://registry.khronos.org/vulkan/specs/1.0/html/vkspec.html, I've reached the point to where I can create and destroy the VkInstance. I'm using GLFW for the windowing and was originally using for the Vulkan stuff, but turned to Volk https://github.com/zeux/volk to load Vulkan in the end. Reflecting that change, I replace the vulkan.h includes with volk.h, defined the platform macro for my platform, and unlinked Vulkan in my Makefile.
-
C/C++: ld: error: undefined symbol: vkEnumerateInstanceVersion
Do you link libVulkan-1.so statically in your project? On Android, only Vulkan 1.0 functions are exposed via this lib. Performance wise and to use any Vulkan functions above 1.0 you need to load all your Vulkan functions by yourself or (even better) use a loader library like volk
-
Boot Camp and Vulkan work for programming
no problem! This library might help you too https://github.com/zeux/volk
-
I have trouble creating window In Ubuntu
You also should not link to Vulkan directly (-lvulkan) but retrieve the function pointers to the Vulkan functions by yourself or using a loder library like volk.
-
Releasing a Standalone (*.exe) Vulcan Application
You can't statically link vulkan, you need to load vulkan-1.dll from the driver installation. You can use something like volk for this https://github.com/zeux/volk
-
How to use functions from Vulkan extensions from the SDK?
Use a Vulkan loader like Volk. https://github.com/zeux/volk
-
LunarG releases new Vulkan 1.3.204.0 SDKs with Vulkan Profiles Toolset
For developing with Vulkan all you need are the Vulkan Headers and some kind of static loader to link against or you use a dynamic loader like volk.
-
Vulkan Memory Allocator can't load some Vulkan functions?
I am using VMA as well in my renderer and I am not having any issues with it. As I am using Volk (https://github.com/zeux/volk) to locate and load all Vulkan function pointers. Thats why I need to tell VMA to not load any functions statically:
What are some alternatives?
XNNPACK - High-efficiency floating-point neural network inference operators for mobile, server, and Web
GLFW - A multi-platform library for OpenGL, OpenGL ES, Vulkan, window and input
rife-ncnn-vulkan - RIFE, Real-Time Intermediate Flow Estimation for Video Frame Interpolation implemented with ncnn library
Quake3e - Improved Quake III Arena engine
deepdetect - Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
VulkanMemoryAllocator - Easy to integrate Vulkan memory allocation library
netron - Visualizer for neural network, deep learning and machine learning models
Vulkan-Headers - Vulkan header files and API registry
darknet - Convolutional Neural Networks
waifu2x-ncnn-vulkan - waifu2x converter ncnn version, runs fast on intel / amd / nvidia / apple-silicon GPU with vulkan
RPi_64-bit_Zero-2-image - Raspberry Pi Zero 2 W 64-bit OS image with OpenCV, TensorFlow Lite and ncnn Framework.
torch-mlir - The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.