Python knowledge-distillation

Open-source Python projects categorized as knowledge-distillation
Edit details
Topics: quantization Pytorch pretrained-models pruning Distributed Systems
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 10 Python knowledge-distillation Projects

  • PaddleClas

    A treasure chest for visual classification and recognition powered by PaddlePaddle

  • Pretrained-Language-Model

    Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

    • Project mention: Does anyone know a downloadable chatgpt model that supports conversation in Albanian? | /r/Programimi | 2023-05-16

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • neural-compressor

    SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

  • DWPose

    "Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

    • Project mention: Solving "Filename too long" error when installing DW Pose in Automatic 1111 Stable Diffusion Web UI | /r/StableDiffusion | 2023-12-06

    If you want to install DW Pose in the Stable Diffusion Web UI (Extensions > Install from URL: https://github.com/IDEA-Research/DWPose.git) on Windows, you could be facing some issue as the Git project contains long path names. This error is not systematic as it depends on where you have installed the Automatic 1111 Stable Diffusion Web UI.

  • mmrazor

    OpenMMLab Model Compression Toolbox and Benchmark.

  • Awesome-Efficient-LLM

    A curated list for Efficient Large Language Models

    • Project mention: A Curated List for Efficient Large Language Models | news.ycombinator.com | 2023-07-15

  • efficient-gnns

    Code and resources on scalable and efficient Graph Neural Networks

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • Lion

    Code for "Lion: Adversarial Distillation of Proprietary Large Language Models (EMNLP 2023)" (by YJiangcm)

    • Project mention: Anybody tried Lion: Adversarial Distillation of Closed-Source Large Language Model? | /r/LocalLLaMA | 2023-06-02

  • EfficientAT

    This repository aims at providing efficient CNNs for Audio Tagging. We provide AudioSet pre-trained models ready for downstream training and extraction of audio embeddings.

    • Project mention: Show HN: Free AI-based music demixing in the browser | news.ycombinator.com | 2023-07-13

    Interesting, I attempted to do the same as you but stopped just shy of BPM matching.

    However I did get sound similarity working using an audio tagging neural net [1]. I chopped off the first and last 15 seconds of every song in my collection and ran them all through this analysis which produces a ~520 dimensional vector. I then targeted specific endings I wanted to match and used Euclidian distance to find the closest matching song beginning.

    YMMV but I thought it actually worked pretty well, I just never got to automating the BPM matching. I can try to look for my old script if you're interested :)

    [1] https://github.com/fschmid56/EfficientAT

  • Linki

    A tool to create distributed wikis

    • Project mention: Show HN: Linki, the Distributed Wiki | news.ycombinator.com | 2023-06-30
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python knowledge-distillation related posts

Index

What are some of the best open-source knowledge-distillation projects in Python? This list will help you:

Project Stars
1 PaddleClas 5,251
2 Pretrained-Language-Model 2,956
3 neural-compressor 1,950
4 DWPose 1,872
5 mmrazor 1,361
6 Awesome-Efficient-LLM 775
7 efficient-gnns 521
8 Lion 190
9 EfficientAT 178
10 Linki 3

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com