model-merging · GitHub Topics

arcee-ai / mergekit

#大语言模型#Tools for merging pretrained large language models.

llama 大语言模型 model-merging

Python 5.81 k

5 天前

EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.

attack-defense continual-learning ensemble-learning federated-learning generalization generative-model large-language-models model-merging multi-domain-learning multi-task-learning robustness diffusion-models few-shot-learning foundation-models meta-learning transfer-learning zero-shot-learning 大语言模型

432

4 天前

tanganke / fusion_bench

FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion

model-merging multi-tasking 深度神经网络机器学习 large-language-models

Python 141

7 天前

juzhengz / LoRI

LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation

continual-learning large-language-models lora model-merging parameter-efficient-fine-tuning

Python 124

2 个月前

bloomberg / dataless-model-merging

Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)

language-model model-merging

Python 89

2 年前

EnnengYang / AdaMerging

AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.

model-merging multi-task-learning

Python 83

8 个月前

ljleb / comfy-mecha

Executable Stable Diffusion merge recipes in comfyui

model-merging safetensors stable-diffusion

Python 76

7 天前

ljleb / sd-mecha

#大语言模型#Executable State Dict Recipes

大语言模型 model-merging stable-diffusion

Python 66

7 天前

zhangyikaii / LAMDA-ZhiJian

ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse

pre-trained-model toolbox knowledge-distillation model-merging parameter-efficient-tuning regularization

Python 51

2 年前

EnnengYang / RepresentationSurgery

Representation Surgery for Multi-Task Model Merging. ICML, 2024.

model-merging multi-task-learning

Python 45

8 个月前

nik-dim / tall_masks

Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]

model-merging

Python 45

8 个月前

tommasomncttn / mergenetic

#大语言模型#Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).

evolutionary-algorithms 大语言模型 model-merging

Jupyter Notebook 44

23 天前

declare-lab / della

#大语言模型#DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling

huggingface 大语言模型 model-merging transformer

Python 32

1 年前

Nithin-GK / MaxFusion

[ECCV'24] MaxFusion: Plug & Play multimodal generation in text to image diffusion models

diffusion-models multimodal plug-and-play txt2img model-merging

Jupyter Notebook 25

7 个月前

uiuctml / Localize-and-Stitch

#大语言模型#Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic

大语言模型 model-merging multi-task-learning

Python 25

5 个月前

naskio / mergeui

#大语言模型#All-in-one UI for merged LLMs in Hugging Face

huggingface 大语言模型 merge model-merging generative-ai large-language-models leaderboard 人工智能

Python 24

1 年前

zjunlp / ModelKinship

#自然语言处理#Exploring Model Kinship for Merging Large Language Models

人工智能 kinship large-language-models model-merging 自然语言处理

Python 24

2 个月前

danielm1405 / magmax

[ECCV 2024] MagMax: Leveraging Model Merging for Seamless Continual Learning (official repository)

continual-learning model-merging

Python 23

1 年前

kpup1710 / CAMEx

#计算机科学#[ICLR 2025] CAMEx: Curvature-Aware Merging of Experts

机器学习 mixture-of-experts model-merging

Python 20

4 个月前

flowritecom / flow-merge

flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popular merge methods such as model soups, SLERP, ties-MERGING or DAR...

大语言模型 model-merging

Python 19

4 个月前