model-quantization · GitHub Topics

Efficient-ML / Awesome-Model-Quantization

#计算机科学#A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (pape...

深度学习 quantization Awesome Lists model-compression efficient-deep-learning model-quantization

2.13 k

3 个月前

horseee / Awesome-Efficient-LLM

#大语言模型#A curated list for Efficient Large Language Models

compression knowledge-distillation language-model 大语言模型 model-quantization efficient-llm

Python 1.71 k

7 天前

datawhalechina / awesome-compression

模型压缩的小白入门教程

knowledge-distillation model-compression model-pruning quantization compression model-quantization neural-architecture-search svd

289

6 天前

inferflow / inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

llama2 llamacpp llm-inference model-quantization multi-gpu-inference mixture-of-experts moe gemma falcon minicpm mistral bloom deepseek internlm baichuan2 mixtral qwen

C++ 242

1 年前

Efficient-ML / Awesome-Efficient-AIGC

#大语言模型#A list of papers, docs, codes about efficient AIGC. This repo is aimed to provide the info for efficient AIGC research, including language and vision, we are continuously improving the project. Welcom...

aigc diffusion-models distillation efficient-deep-learning generative-model large-language-models 大语言模型 model-compression model-quantization pruning Awesome Lists

183

4 个月前

sayakpaul / Adventures-in-TensorFlow-Lite

This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.

tensorflow-2 tensorflow-lite on-device-ml model-quantization post-training-quantization quantization-aware-training pruning inference

Jupyter Notebook 170

2 年前

RodolfoFerro / psychopathology-fer-assistant

[WINNER! 🏆] Psychopathology FER Assistant. Because mental health matters. My project submission for #TFWorld TF 2.0 Challenge at Devpost.

Python 树莓派 google-colab model-quantization Tensorflow tflite firebase-realtime-database Flask dash

Jupyter Notebook 78

2 年前

htqin / BiBench

[ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binarization.

benchmark model-compression binary-neural-networks model-quantization

Python 56

1 年前

htqin / QuantSR

[NeurIPS 2023 Spotlight] This project is the official implementation of our accepted NeurIPS 2023 (spotlight) paper QuantSR: Accurate Low-bit Quantization for Efficient Image Super-Resolution.

model-quantization super-resolution

Python 47

1 年前

nbasyl / OFQ

The official implementation of the ICML 2023 paper OFQ-ViT

icml model-compression model-quantization vision-transformer vision-transformers

Python 30

2 年前

seonglae / llama2gptq

#大语言模型#Chat to LLaMa 2 that also provides responses with reference documents over vector database. Locally available model using GPTQ 4bit quantization.

langchain quantization transformers model-quantization CUDA 聊天机器人 question-answering ChatGPT gpt llama-2 llama2

Python 29

2 年前

HaoranREN / TensorFlow_Model_Quantization

#计算机科学#A tutorial of model quantization using TensorFlow

model-quantization Tensorflow tensorflow-lite tflite 机器学习 quantization-aware-training

Python 12

4 年前

frickyinn / BiDense

PyTorch implementation of "BiDense: Binarization for Dense Prediction," A binary neural network for dense prediction tasks.

model-compression model-quantization

Python 6

7 个月前

dcarpintero / ai-engineering

AI Engineering: Annotated NBs to dive into Self-Attention, In-Context Learning, RAG, Knowledge-Graphs, Fine-Tuning, Model Optimization, and many more.

bert chunking embeddings fine-tuning generative-ai huggingface-transformers in-context-learning knowledge-graph langchain large-language-models llama3-1 model-quantization retrieval-augmented-generation self-attention transformer weights-and-biases ai-engineering

Jupyter Notebook 6

2 个月前

NANEXLABS / Nanex-AI

Enterprise multi-agent framework for secure, borderless data collaboration with zero-trust and federated learning-lightweight edge-ready.

人工智能 aiagent edge-computing federated-learning grpc-web iot-security model-quantization mqtt-protocol onnx-runtime tensorflow-lite zero-trust-security

Python 5

2 个月前

SRDdev / Model-Quantization

Quantization is a technique to reduce the computational and memory costs of running inference by representing the weights and activations with low-precision data types like 8-bit integer (int8) instea...

机器学习 model-quantization quantization

Jupyter Notebook 4

2 年前

dwain-barnes / LLM-GGUF-Auto-Converter

#大语言模型#Automated Jupyter notebook solution for batch converting Large Language Models to GGUF format with multiple quantization options. Built on llama.cpp with HuggingFace integration.

batch-processing CUDA gguf huggingface Jupyter Notebook llama-cpp 大语言模型 model-quantization

Jupyter Notebook 2

5 个月前

first-coding / VIT

This project distills a ViT model into a compact CNN, reducing its size to 1.24MB with minimal accuracy loss. ONNXRuntime with CUDA boosts inference speed, while FastAPI and Docker simplify deployment...

image-classification Python vision-transformer Docker FastAPI knowledge-distillation model-quantization onnx onnxruntime

Python 1

1 个月前

nnilayy / Spresense

Arduino classification embedded-machine-learning model-pruning model-quantization

C++ 1

2 年前

harshmorya / Assignment__HB1--1

This project explores generating high-quality images using depth maps and conditioning techniques like Canny edges, leveraging Stable Diffusion and ControlNet models. It focuses on optimizing image ge...

canny-edge-detection controlnet depth-map image-generation image-synthesis latent-diffusion-models model-quantization optimization PyTorch stable-diffusion unet

Python 0

8 个月前