lora · GitHub Topics

labmlai / annotated_deep_learning_paper_implementations

#计算机科学#59 篇深度学习论文的实现，并带有详细注释。包括 transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 强化学习 (ppo, dqn), capsnet, distillation, ... 🧠

深度学习 PyTorch Generative Adversarial Network transformers reinforcement-learning optimizers neural-networks transformer 机器学习 attention literate-programming lora

Python 62.19 k

10 天前

hiyouga / LLaMA-Factory

#自然语言处理#Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fine-tuning llama 大语言模型 peft transformers rlhf qlora quantization qwen instruction-tuning gpt lora large-language-models agent 人工智能 moe llama3 deepseek gemma 自然语言处理

Python 55.22 k

5 小时前

unslothai / unsloth

#大语言模型#Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.

fine-tuning llama 大语言模型 lora mistral gemma llama3 unsloth deepseek deepseek-r1 gemma3 text-to-speech tts qwen qwen3 agent 人工智能 openai PyTorch

Python 42.92 k

1 天前

datawhalechina / self-llm

#大语言模型#《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

大语言模型 chatglm internlm2 llama3 lora minicpm qwen qwen1-5 chatglm3 gemma-2b-it glm-4 qwen2 q-wen

Jupyter Notebook 22.14 k

2 小时前

huggingface / peft

#大语言模型#🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapter diffusion 大语言模型 parameter-efficient-learning Python PyTorch transformers lora

Python 19.17 k

5 天前

ymcui / Chinese-LLaMA-Alpaca

#自然语言处理#中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

大语言模型 plm pre-trained-language-models alpaca llama 自然语言处理 quantization large-language-models lora alpaca-2 llama-2

Python 18.89 k

16 天前

camenduru / stable-diffusion-webui-colab

#计算机科学#stable diffusion webui colab

stable-diffusion stable-diffusion-web-ui stable-diffusion-webui colab colab-notebook colaboratory dreambooth lora 人工智能 gradio 深度学习 image-generation img2img PyTorch txt2img ai-art t2v text2video

Jupyter Notebook 15.91 k

10 个月前

microsoft / LoRA

#计算机科学#Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

gpt-2 adaptation language-model gpt-3 low-rank PyTorch 深度学习 roberta deberta lora

Python 12.45 k

7 个月前

modelscope / ms-swift

#大语言模型#Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, GLM4.5, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Ovis2, InternVL3, Llava,...

大语言模型 lora llama sft deploy multimodal peft internvl liger qwen2-vl rft deepseek-r1 embedding grpo open-r1 megatron omni llama4 qwen3 qwen3-moe

Python 8.98 k

4 小时前

LianjiaTech / BELLE

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

bloom instruction-set llama open-models gpt-q instruct-gpt gpt-evaluation chinese-nlp lora instruct-finetune

HTML 8.21 k

9 个月前

cloneofsimo / lora

Using Low-rank adaptation to quickly fine-tune diffusion models.

diffusion lora stable-diffusion dreambooth fine-tuning

Jupyter Notebook 7.4 k

1 年前

yangjianxin1 / Firefly

#大语言模型#Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

gpt alpaca 大语言模型 baichuan llama lora qlora peft llama2 internlm chatglm qwen mistral mixtral Zephyr RTOS minicpm gemma llama3 qwen2

Python 6.5 k

9 个月前

lyogavin / airllm

#大语言模型#AirLLM 70B inference with single 4GB GPU

chinese-nlp finetune generative-ai instruct-gpt instruction-set llama 大语言模型 lora open-models Open Source qlora

Jupyter Notebook 5.86 k

3 个月前

Akegarasu / lora-scripts

SD-Trainer. LoRA & Dreambooth training scripts & GUI use kohya-ss's trainer, for diffusion model.

dreambooth finetune lora stable-diffusion

Python 5.53 k

2 个月前

meshtastic / firmware

Meshtastic 设备固件。Meshtastic 是一种基于LoRa 协议的开源无线通信技术，旨在实现低功耗、长距离的通信

gps lora hiking ttgo-tbeam heltec meshtastic ttgo ESP32 nrf52 mesh-networks off-grid mesh pico rp2040 stm32

C++ 5.21 k

3 小时前

ExpressLRS / ExpressLRS

ESP32/ESP8285-based High-Performance Radio Link for RC applications

rc lora ESP8266 ESP32 fpv quadcopter remote-control sx1280 sx1276 drone lr1121

C++ 4.28 k

1 天前

1technophile / OpenMQTTGateway

MQTT gateway for ESP8266 or ESP32 with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermo...

MQTT gateway openhab2 home-automation Home Assistant wemos-d1 rcswitch Arduino bridge nodemcu ESP8266 arduino-uno ESP32 xiaomi ble lora PlatformIO

C++ 3.82 k

13 小时前

mymusise / ChatGLM-Tuning

#大语言模型#基于ChatGLM-6B + LoRA的Fintune方案

chatglm ChatGPT lora peft

Python 3.76 k

2 年前

OpenPipe / ART

Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen2.5, Qwen3, Llama, Kimi, and more!

大语言模型 lora reinforcement-learning agent agentic-ai grpo rl kimi-ai qwen qwen3

Python 3.71 k

5 小时前

hiyouga / ChatGLM-Efficient-Tuning

#大语言模型#Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

chatglm ChatGPT fine-tuning lora alpaca peft huggingface language-model transformers PyTorch rlhf chatglm2 qlora

Python 3.71 k

2 年前