FourierKAN
efficient-kan
| FourierKAN | efficient-kan | |
|---|---|---|
| 2 | 4 | |
| 578 | 3,038 | |
| - | - | |
| 5.6 | 5.6 | |
| 10 days ago | 12 days ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
FourierKAN
- Fourier Kolmogorov-Arnold Networks
-
Kolmogorov-Arnold Networks
I quickly skimmed the paper, got inspired to simplify it, and created some Pytorch Layer :
https://github.com/GistNoesis/FourierKAN/
The core is really just a few lines.
In the paper they use some spline interpolation to represent 1d function that they sum. Their code seemed aimed at smaller sizes. Instead I chose a different representation, aka fourier coefficients that are used to interpolate the functions of individual coordinates.
It should give an idea of Kolmogorov-Arnold networks representation power, it should probably converge easier than their spline version but spline version have less operations.
Of course, if my code doesn't work, it doesn't mean theirs doesn't.
Feel free to experiment and publish paper if you want.
efficient-kan
- FLaNK-AIM Weekly 06 May 2024
- Pure-PyTorch Implementation of Kolmogorov-Arnold Network (Kan)
-
Kolmogorov-Arnold Networks
Nice implementation I've been playing with, https://github.com/Blealtan/efficient-kan alongside @GistNoesis's.
What are some alternatives?
kan-gpt - The PyTorch implementation of Generative Pre-trained Transformers (GPTs) using Kolmogorov-Arnold Networks (KANs) for language modeling
examples - Analyze the unstructured data with Towhee, such as reverse image search, reverse video search, audio classification, question and answer systems, molecular search, etc.
VectorDBBench - A Benchmark Tool for VectorDB
threlte - 3D framework for Svelte
CML_AMP_Intelligent-QA-Chatbot-with-NiFi-Pinecone-and-Llama2 - The prototype deploys an Application in CML using a Llama2 model from Hugging Face to answer questions augmented with knowledge extracted from the website. This prototype introduces Pinecone as a database for storing vectors for semantic search.
LLaMA-Factory - Unify Efficient Fine-Tuning of 100+ LLMs
llamafile - Distribute and run LLMs with a single file.
vega-lite - A concise grammar of interactive graphics, built on Vega.
openvino_notebooks - 📚 Jupyter notebook tutorials for OpenVINO™
angle-grinder - Slice and dice logs on the command line
apexcharts.js - 📊 Interactive JavaScript Charts built on SVG