peft · GitHub Topics

#自然语言处理#Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fine-tuning llama 大语言模型 peft transformers rlhf qlora quantization qwen instruction-tuning gpt lora large-language-models agent 人工智能 moe llama3 deepseek gemma 自然语言处理

Python 58.11 k

10 天前

huggingface / peft

#大语言模型#🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapter diffusion 大语言模型 parameter-efficient-learning Python PyTorch transformers lora fine-tuning peft

Python 19.56 k

2 天前

modelscope / ms-swift

#大语言模型#Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, GLM4.5, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, InternVL3.5, Ovis2.5, Llava, GLM4v, P...

大语言模型 lora llama sft deploy multimodal peft internvl liger qwen2-vl rft deepseek-r1 embedding grpo open-r1 megatron omni llama4 qwen3 qwen3-moe

Python 9.84 k

1 天前

yangjianxin1 / Firefly

#大语言模型#Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

gpt alpaca 大语言模型 baichuan llama lora qlora peft llama2 internlm chatglm qwen mistral mixtral Zephyr RTOS minicpm gemma llama3 qwen2

Python 6.55 k

1 年前

mymusise / ChatGLM-Tuning

#大语言模型#基于ChatGLM-6B + LoRA的Fintune方案

chatglm ChatGPT lora peft

Python 3.77 k

2 年前

hiyouga / ChatGLM-Efficient-Tuning

#大语言模型#Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

chatglm ChatGPT fine-tuning lora alpaca peft huggingface language-model transformers PyTorch rlhf chatglm2 qlora

Python 3.72 k

2 年前

zyds / transformers-code

手把手带你实战 Huggingface Transformers 课程视频同步更新在B站与YouTube

huggingface peft transformers

Jupyter Notebook 3.27 k

1 年前

stochasticai / xTuring

#大语言模型#Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJ...

深度学习 fine-tuning gpt-2 gpt-j llama 大语言模型 lora language-model alpaca finetuning adapter gen-ai generative-ai mistral peft quantization

Python 2.66 k

1 年前

ashishpatel26 / LLM-Finetuning

#大语言模型#LLM Finetuning with peft

falcon fine-tuning huggingface llama llama2 大语言模型 lora peft PyTorch text-generation

Jupyter Notebook 2.64 k

1 个月前

lxe / simple-llm-finetuner

#大语言模型#Simple UI for LLM Model Finetuning

人工智能 gpt-2 gpt-3 huggingface huggingface-transformers llama 大语言模型 peft PyTorch

Jupyter Notebook 2.07 k

2 年前

X-LANCE / SLAM-LLM

Speech, Language, Audio, Music Processing with Large Language Model

audio-processing 大语言模型 multimodal-large-language-models peft speech-processing

Python 889

9 天前

ModelCloud / GPTQModel

LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

gptq peft quantization sglang transformers vllm

Python 776

2 天前

dvgodoy / FineTuningLLMs

Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"

fine-tuning finetuning finetuning-llms hugging-face huggingface large-language-models llamacpp lora ollama peft PyTorch transformers

Jupyter Notebook 507

4 天前

mindspore-courses / step_into_llm

#自然语言处理#MindSpore online courses: Step into LLM

大语言模型自然语言处理 large-language-models bert ChatGPT gpt gpt2 instruction-tuning parallel-computing prompt-tuning rlhf chatglm chatglm2 llama llama2 moe peft

Jupyter Notebook 477

24 天前

zetavg / LLaMA-LoRA-Tuner

#计算机科学#UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.

alpaca llama lora 机器学习 google-colab gpt-j gpt 人工智能 peft language-model

Python 475

2 年前