efficient-kan
kan-gpt
| efficient-kan | kan-gpt | |
|---|---|---|
| 4 | 2 | |
| 3,038 | 614 | |
| - | - | |
| 5.6 | 7.4 | |
| 12 days ago | 5 days ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
efficient-kan
- FLaNK-AIM Weekly 06 May 2024
- Pure-PyTorch Implementation of Kolmogorov-Arnold Network (Kan)
-
Kolmogorov-Arnold Networks
Nice implementation I've been playing with, https://github.com/Blealtan/efficient-kan alongside @GistNoesis's.
kan-gpt
-
Kolmogorov-Arnold Networks
- Training script
I am currently working on training it on the WebText dataset to compare it to the original gpt2. Facing a few out-of-memory issues at the moment. Perhaps the vocab size (50257) is too large?
I'm open to contributions and would love to hear your thoughts!
https://github.com/AdityaNG/kan-gpt
What are some alternatives?
examples - Analyze the unstructured data with Towhee, such as reverse image search, reverse video search, audio classification, question and answer systems, molecular search, etc.
FourierKAN
VectorDBBench - A Benchmark Tool for VectorDB
threlte - 3D framework for Svelte
CML_AMP_Intelligent-QA-Chatbot-with-NiFi-Pinecone-and-Llama2 - The prototype deploys an Application in CML using a Llama2 model from Hugging Face to answer questions augmented with knowledge extracted from the website. This prototype introduces Pinecone as a database for storing vectors for semantic search.
LLaMA-Factory - Unify Efficient Fine-Tuning of 100+ LLMs
llamafile - Distribute and run LLMs with a single file.
vega-lite - A concise grammar of interactive graphics, built on Vega.
openvino_notebooks - 📚 Jupyter notebook tutorials for OpenVINO™
angle-grinder - Slice and dice logs on the command line
apexcharts.js - 📊 Interactive JavaScript Charts built on SVG
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.