Top 15 knowledge-distillation Open-Source Projects

• PaddleClas

  2 5,262 5.4 Python

  A treasure chest for visual classification and recognition powered by PaddlePaddle

  

• Pretrained-Language-Model

  1 2,961 6.1 Python

  Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

  

Project mention: Does anyone know a downloadable chatgpt model that supports conversation in Albanian? | /r/Programimi | 2023-05-16

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• neural-compressor

  3 1,971 9.8 Python

  SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

  

• DWPose

  3 1,907 7.4 Python

  "Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

  

Project mention: Solving "Filename too long" error when installing DW Pose in Automatic 1111 Stable Diffusion Web UI | /r/StableDiffusion | 2023-12-06

If you want to install DW Pose in the Stable Diffusion Web UI (Extensions > Install from URL: https://github.com/IDEA-Research/DWPose.git) on Windows, you could be facing some issue as the Git project contains long path names. This error is not systematic as it depends on where you have installed the Automatic 1111 Stable Diffusion Web UI.

• mmrazor

  4 1,374 2.8 Python

  OpenMMLab Model Compression Toolbox and Benchmark.

  

• knowledge

  13 1,270 6.2 TypeScript

  Knowledge is a tool for saving, searching, accessing, exploring and chatting with all of your favorite websites, documents and files. (by KnowledgeCanvas)

  

Project mention: Show HN: Personal Knowledge Base Visualization | news.ycombinator.com | 2024-03-20

https://github.com/KnowledgeCanvas/knowledge

• Awesome-Efficient-LLM

  1 801 9.4 Python

  A curated list for Efficient Large Language Models

Project mention: A Curated List for Efficient Large Language Models | news.ycombinator.com | 2023-07-15

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• efficient-gnns

  2 525 0.0 Python

  Code and resources on scalable and efficient Graph Neural Networks

• Lion

  1 192 8.9 Python

  Code for "Lion: Adversarial Distillation of Proprietary Large Language Models (EMNLP 2023)" (by YJiangcm)

Project mention: Anybody tried Lion: Adversarial Distillation of Closed-Source Large Language Model? | /r/LocalLLaMA | 2023-06-02

• EfficientAT

  1 188 6.7 Python

  This repository aims at providing efficient CNNs for Audio Tagging. We provide AudioSet pre-trained models ready for downstream training and extraction of audio embeddings.

Project mention: Show HN: Free AI-based music demixing in the browser | news.ycombinator.com | 2023-07-13

Interesting, I attempted to do the same as you but stopped just shy of BPM matching.

However I did get sound similarity working using an audio tagging neural net [1]. I chopped off the first and last 15 seconds of every song in my collection and ran them all through this analysis which produces a ~520 dimensional vector. I then targeted specific endings I wanted to match and used Euclidian distance to find the closest matching song beginning.

YMMV but I thought it actually worked pretty well, I just never got to automating the BPM matching. I can try to look for my old script if you're interested :)

[1] https://github.com/fschmid56/EfficientAT

• MoTIS

  2 115 1.6 Swift

  [NAACL 2022]Mobile Text-to-Image search powered by multimodal semantic representation models(e.g., OpenAI's CLIP) (by DRSY)

• FunMatch-Distillation

  1 79 1.8 Jupyter Notebook

  TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.

• ProSelfLC-AT

  4 58 1.8 HTML

  noisy labels; missing labels; semi-supervised learning; entropy; uncertainty; robustness and generalisation.

• ai_book

  1 19 8.7 Jupyter Notebook

  AI book for everyone

• Linki

  1 3 8.4 Python

  A tool to create distributed wikis

  

Project mention: Show HN: Linki, the Distributed Wiki | news.ycombinator.com | 2023-06-30

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

knowledge-distillation related posts

• Solving "Filename too long" error when installing DW Pose in Automatic 1111 Stable Diffusion Web UI

  1 project | /r/StableDiffusion | 6 Dec 2023

• How to Resolve DWPose/Onnxruntime Warning (or How to Run Multiple CUDA Versions Side-by-Side)

  1 project | /r/comfyui | 27 Nov 2023

• Intel Textual Inversion Training on Hugging Face

  1 project | /r/StableDiffusion | 22 Dec 2022

• [R] Robust Learning: the past and present. The DNN has strong fitting capability, but we find ...

  2 projects | /r/MachineLearning | 25 Nov 2022

• [R] ProSelfLC: Progressive Self Label Correction Towards A Low-Temperature Entropy State

  1 project | /r/MachineLearning | 26 Jul 2022

• Still worrying about model compression? MMRazor may work for you.

  1 project | /r/computervision | 30 Dec 2021

• Still worrying about model compression? MMRazor is all you need

  1 project | news.ycombinator.com | 30 Dec 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 10 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com