efficient-llm · GitHub Topics

horseee / Awesome-Efficient-LLM

#大语言模型#A curated list for Efficient Large Language Models

compression knowledge-distillation language-model 大语言模型 model-quantization efficient-llm

Python 1.86 k

3 个月前

mbzuai-oryx / MobiLlama

#大语言模型#[ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices

efficient-llm 大语言模型 slm mobile-llm tiny-llm

Python 660

4 个月前

hao-ai-lab / Consistency_LLM

[ICML 2024] CLLMs: Consistency Large Language Models

efficient-llm large-language-models

Python 403

10 个月前

yaya-sy / lillama

#大语言模型#[NAACL' 25 main] Lillama: Large Language Model Compression via Low-Rank Feature Distillation

distillation efficient-llm 大语言模型 llm-inference mamba pruning transformer

Python 10

5 个月前

fscdc / Efficient-AI

#大语言模型#There is a summary repo for Efficient AI direction. If you want to contribute to this repo, feel free to pr(pull request)!

efficient-llm generative-ai 大语言模型

1 年前

KevinZeng08 / efficient-large-model-papers

#大语言模型#A Curated Paper List for Efficient Large Models

大语言模型 llm-inference llm-serving papers efficient-llm

1 年前

Bit-by-Bit-Collective / BitNet-7B-KDE

Colab-friendly BitNet distillation engine: collect KD traces from a teacher, train a ternary Mini-BitNet, and dry-run 7B memory. Multi-provider + Drive/S3

bitnet colab-notebook efficient-llm knowledge-distillation 大语言模型 model-compression parquet PyTorch transformers

Python 0

10 天前