parameter-efficient-fine-tuning

#计算机科学#[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

commonsense-reasoning 深度学习深度神经网络 instruction-tuning large-language-models large-vision-language-models lora parameter-efficient-fine-tuning parameter-efficient-tuning vision-and-language

Python 797

8 个月前

synbol / Awesome-Parameter-Efficient-Transfer-Learning

#Awesome#Collection of awesome parameter-efficient fine-tuning resources.

Awesome Lists 机器视觉 parameter-efficient-fine-tuning transfer-learning survey 深度学习 pre-trained-models transformer

558

3 个月前

Paranioar / Awesome_Matching_Pretraining_Transfering

#Awesome#The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insigh...

cross-modal-retrieval 教程 Awesome Lists image-text-matching image-text-retrieval large-language-models large-vision-language-models multimodal-pretraining parameter-efficient-fine-tuning vision-and-language multimodal-large-language-models 大语言模型 text-to-image-generation text-to-image-synthesis text-to-video-generation

423

6 个月前

liuqidong07 / MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

chatglm large-language-models mixture-of-experts multitask-learning parameter-efficient-fine-tuning peft

Python 167

1 年前

Chongjie-Si / Subspace-Tuning

#自然语言处理#A generalized framework for subspace tuning methods in parameter efficient fine-tuning.

adapter glue llama lora natural-language-generation 自然语言处理 natural-language-understanding parameter-efficient-fine-tuning pretrained-models commonsense-reasoning

Python 142

4 个月前

juzhengz / LoRI

LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation

continual-learning large-language-models lora model-merging parameter-efficient-fine-tuning

Python 124

2 个月前

ShiZhengyan / DePT

#自然语言处理#[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"

fine-tuning language-model large-language-models 自然语言处理 parameter-efficient-tuning peft prompt-tuning parameter-efficient-fine-tuning transfer-learning

Python 96

1 年前

architkaila / Fine-Tuning-LLMs-for-Medical-Entity-Extraction

Exploring the potential of fine-tuning Large Language Models (LLMs) like Llama2 and StableLM for medical entity extraction. This project focuses on adapting these models using PEFT, Adapter V2, and Lo...

entity-extraction fine-tuning-llm large-language-models medical-application parameter-efficient-fine-tuning

Python 76

2 年前

ziplab / SPT

[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.

parameter-efficient-fine-tuning peft adapter lora prompt-tuning transfer-learning

Python 70

2 年前

Paranioar / UniPT

[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"

cross-modal parameter-efficient-learning parameter-efficient-tuning transfer-learning parameter-efficient-fine-tuning

Python 68

8 个月前

miccunifi / KDPL

[ECCV 2024] - Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation

clip few-shot-learning knowledge-distillation parameter-efficient-fine-tuning prompt-learning vision-language-model

Python 58

7 个月前

astra-vision / FAMix

[CVPR 2024] Domain generalization by interpolating original feature styles with styles obtained using random descriptions in natural language

机器视觉 domain-generalization parameter-efficient-fine-tuning semantic-segmentation vision-language

Python 52

2 个月前

iboing / CorDA

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)

large-language-models parameter-efficient-fine-tuning

Python 46

5 个月前

umbertocappellazzo / PETL_AST

This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of...

adapter audio-processing lora parameter-efficient-fine-tuning prompt-tuning transfer-learning mixture-of-experts

Python 36

1 年前

OSU-MLB / ViT_PEFT_Vision

#计算机科学#[CVPR'25 (Highlight)] Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual Recognition

机器视觉深度学习 parameter-efficient-fine-tuning parameter-efficient-tuning pre-trained-model transfer-learning transformer vision-transformer visual-recognition

Jupyter Notebook 34

2 个月前

ltlhuuu / PSEC

[ICLR 2025] The offical implementation of "PSEC: Skill Expansion and Composition in Parameter Space", a new framework designed to facilitate efficient and flexible skill expansion and composition, ite...

continual-learning decision-making fine-tuning large-language-models lora pretrained-models reinforcement-learning Robotics transfer-learning parameter-efficient-fine-tuning imitation-learning multi-objective-optimization offline-reinforcement-learning

Python 27

4 个月前

astra-vision / ProLIP

An extremely simple method for validation-free efficient adaptation of CLIP-like VLMs that is robust to the learning rate.

parameter-efficient-fine-tuning vision-language-model

Shell 25

2 个月前