lora · GitHub Topics

labmlai / annotated_deep_learning_paper_implementations

#计算机科学#59 篇深度学习论文的实现，并带有详细注释。包括 transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 强化学习 (ppo, dqn), capsnet, distillation, ... 🧠

深度学习 PyTorch Generative Adversarial Network transformers reinforcement-learning optimizers neural-networks transformer 机器学习 attention literate-programming lora

Python 61.06 k

10 个月前

hiyouga / LLaMA-Factory

#大语言模型#Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fine-tuning language-model llama 大语言模型 peft transformers rlhf qlora quantization chatglm qwen instruction-tuning mistral gpt lora large-language-models agent 人工智能 moe llama3

Python 52.27 k

3 天前

unslothai / unsloth

#大语言模型#Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.

finetuning fine-tuning llama 大语言模型 lora mistral qlora gemma llama3 unsloth deepseek deepseek-r1 gemma3 llama-4 llama4 text-to-speech tts qwen qwen3

Python 40.54 k

3 天前

ymcui / Chinese-LLaMA-Alpaca

#自然语言处理#中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

大语言模型 plm pre-trained-language-models alpaca llama 自然语言处理 quantization large-language-models lora alpaca-2 llama-2

Python 18.86 k

1 年前

huggingface / peft

#大语言模型#🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

adapter diffusion 大语言模型 parameter-efficient-learning Python PyTorch transformers lora

Python 18.77 k

4 天前

datawhalechina / self-llm

#大语言模型#《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

大语言模型 chatglm internlm2 llama3 lora minicpm qwen qwen1-5 chatglm3 gemma-2b-it glm-4 qwen2 q-wen

Jupyter Notebook 18.31 k

3 天前

camenduru / stable-diffusion-webui-colab

#计算机科学#stable diffusion webui colab

stable-diffusion stable-diffusion-web-ui stable-diffusion-webui colab colab-notebook colaboratory dreambooth lora 人工智能 gradio 深度学习 image-generation img2img PyTorch txt2img ai-art t2v text2video

Jupyter Notebook 15.87 k

8 个月前

microsoft / LoRA

#计算机科学#Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

gpt-2 adaptation language-model gpt-3 low-rank PyTorch 深度学习 roberta deberta lora

Python 12.08 k

6 个月前

LianjiaTech / BELLE

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

bloom instruction-set llama open-models gpt-q instruct-gpt gpt-evaluation chinese-nlp lora instruct-finetune

HTML 8.17 k

8 个月前

modelscope / ms-swift

#大语言模型#Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Ovis2, InternVL3, Llava, GLM4v, ...

大语言模型 lora llama sft deploy multimodal peft internvl liger qwen2-vl rft deepseek-r1 embedding grpo open-r1 megatron omni llama4 qwen3 qwen3-moe

Python 8.09 k

1 天前

cloneofsimo / lora

Using Low-rank adaptation to quickly fine-tune diffusion models.

diffusion lora stable-diffusion dreambooth fine-tuning

Jupyter Notebook 7.36 k

1 年前

yangjianxin1 / Firefly

#大语言模型#Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

gpt alpaca 大语言模型 baichuan llama lora qlora peft llama2 internlm chatglm qwen mistral mixtral Zephyr RTOS minicpm gemma llama3 qwen2

Python 6.45 k

8 个月前

lyogavin / airllm

#大语言模型#AirLLM 70B inference with single 4GB GPU

chinese-nlp finetune generative-ai instruct-gpt instruction-set llama 大语言模型 lora open-models Open Source qlora

Jupyter Notebook 5.79 k

1 个月前

Akegarasu / lora-scripts

SD-Trainer. LoRA & Dreambooth training scripts & GUI use kohya-ss's trainer, for diffusion model.

dreambooth finetune lora stable-diffusion

Python 5.41 k

4 天前

meshtastic / firmware

Meshtastic 设备固件。Meshtastic 是一种基于LoRa 协议的开源无线通信技术，旨在实现低功耗、长距离的通信

gps lora hiking ttgo-tbeam heltec meshtastic ttgo ESP32 nrf52 mesh-networks off-grid mesh pico rp2040 stm32

C++ 4.89 k

17 分钟前

ExpressLRS / ExpressLRS

ESP32/ESP8285-based High-Performance Radio Link for RC applications

rc lora ESP8266 ESP32 fpv quadcopter remote-control sx1280 sx1276 drone lr1121

C++ 4.16 k

16 小时前

1technophile / OpenMQTTGateway

MQTT gateway for ESP8266 or ESP32 with bidirectional 433mhz/315mhz/868mhz, Infrared communications, BLE, Bluetooth, beacons detection, mi flora, mi jia, LYWSD02, LYWSD03MMC, Mi Scale, TPMS, BBQ thermo...