knowledge-distillation · GitHub Topics

PaddleClas 是一个为工业界和学术界所准备的图像识别任务工具集

image-classification knowledge-distillation autoaugment randaugment gridmask cutmix deit repvgg swin-transformer pretrained-models image-recognition

Python 5.7 k

1 个月前

dkozlov / awesome-knowledge-distillation

#计算机科学#Awesome Knowledge Distillation

knowledge-distillation teacher-student distillation model-compression 深度学习

3.72 k

2 个月前

huawei-noah / Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

knowledge-distillation model-compression quantization pretrained-models

Python 3.12 k

2 年前

jingyi0000 / VLM_survey

#计算机科学#Collection of AWESOME vision-language models for vision tasks

机器视觉深度学习 knowledge-distillation survey transfer-learning vision-language-model clip

2.86 k

2 个月前

IDEA-Research / DWPose

"Effective Whole-body Pose Estimation with Two-stages Distillation" (ICCV 2023, CV4Metaverse Workshop)

controlnet knowledge-distillation pose-estimation stable-diffusion-webui

Python 2.5 k

2 年前

intel / neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

low-precision pruning sparsity auto-tuning knowledge-distillation quantization quantization-aware-training post-training-quantization smoothquant large-language-models gptq int8

Python 2.46 k

2 天前

alibaba / EasyNLP

#自然语言处理#EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

transformers bert 自然语言处理 pretrained-models 深度学习 PyTorch fewshot-learning knowledge-distillation knowledge-pretraining text-image-retrieval text-to-image-synthesis 机器学习 text-classification transfer-learning

Python 2.16 k

8 个月前

haitongli / knowledge-distillation-pytorch

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

PyTorch knowledge-distillation 深度神经网络 cifar10 model-compression 机器视觉

Python 1.96 k

2 年前

horseee / Awesome-Efficient-LLM

#大语言模型#A curated list for Efficient Large Language Models

compression knowledge-distillation language-model 大语言模型 model-quantization efficient-llm

Python 1.8 k

1 个月前

microsoft / Cream

This is a collection of our NAS and Vision Transformer work.

nas automl vision-transformer rpe vit-compression efficiency knowledge-distillation

Python 1.79 k

1 年前

AberHu / Knowledge-Distillation-Zoo

Pytorch implementation of various Knowledge Distillation (KD) methods.

knowledge-distillation teacher-student model-compression distillation

Python 1.71 k

4 年前

open-mmlab / mmrazor

OpenMMLab Model Compression Toolbox and Benchmark.

nas pruning knowledge-distillation spos darts autoslim detection segmentation classification PyTorch quantization

Python 1.61 k

1 年前

yoshitomo-matsubara / torchdistill

#自然语言处理#A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemente...

knowledge-distillation PyTorch image-classification imagenet object-detection coco semantic-segmentation cifar10 cifar100 colab-notebook google-colab pascal-voc 自然语言处理 transformer glue text-classification

Python 1.53 k

5 天前

microsoft / NeuronBlocks

#自然语言处理#NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego

question-answering 深度学习 PyTorch 自然语言处理 text-classification 人工智能 dnn qna text-matching knowledge-distillation model-compression sequence-labeling

Python 1.46 k

2 年前

szagoruyko / attention-transfer

#计算机科学#Improving Convolutional Networks via Attention Transfer (ICLR 2017)

PyTorch knowledge-distillation attention 深度学习

Jupyter Notebook 1.46 k

7 年前

lxztju / pytorch_classification

利用pytorch实现图像分类的一个完整的代码，训练，预测，TTA，模型融合，模型部署，cnn提取特征，svm或者随机森林等进行分类，模型蒸馏，一个完整的代码

PyTorch image-classification 部署 svm knn cnn densenet resnext resnet Flask random-forest knowledge-distillation

Jupyter Notebook 1.44 k

2 年前

huawei-noah / Efficient-Computing

Efficient computing methods developed by Huawei Noah's Ark Lab

knowledge-distillation model-compression binary-neural-networks pruning quantization self-supervised

Jupyter Notebook 1.29 k

9 个月前

Tebmer / Awesome-Knowledge-Distillation-of-LLMs

#大语言模型#This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vert...

data-augmentation instruction-following knowledge-distillation 大语言模型 survey compression feedback multi-modal alignment

1.11 k

5 个月前