GitHub 中文社区
回车: Github搜索    Shift+回车: Google搜索
论坛
排行榜
趋势
登录

©2025 GitHub中文社区论坛GitHub官网网站地图GitHub官方翻译

  • X iconGitHub on X
  • Facebook iconGitHub on Facebook
  • Linkedin iconGitHub on LinkedIn
  • YouTube iconGitHub on YouTube
  • Twitch iconGitHub on Twitch
  • TikTok iconGitHub on TikTok
  • GitHub markGitHub’s organization on GitHub
ModelTC

ModelTC / lightllm

星标3.23 k
复刻255


问题
 
Loading

关于

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

深度学习gptllama大语言模型model-serving自然语言处理openai-triton
创建时间

2023-07-22

是否国产

否

  修改时间

2025-05-19T08:11:26Z


语言

  • Python99.4%
  • Shell0.5%
  • Dockerfile0.1%


该仓库已收录但尚未编辑。项目介绍及使用教程请前往 GitHub 阅读 README


0 条讨论

登录后发表评论

ModelTC 的其他开源项目

MQBench
@ModelTC

Model Quantization Benchmark

Python803
1 个月前
United-Perception
@ModelTC

United Perception

Python432
2 年前

您可能感兴趣的

grok-1
@xai-org

大模型Grok-1开源

Python50.27 k
9 个月前
vllm
@vllm-project

#大语言模型#A high-throughput and memory-efficient inference and serving engine for LLMs

gpt大语言模型PyTorchllmopsmlops
Python47.63 k
4 小时前
Open-Sora
@hpcaitech

Open-Sora: 完全开源的高效复现类Sora视频生成方案

Python26.46 k
20 天前
ollama
@ollama

#大语言模型#本地化搭建和运行 Llama2 和其他大模型

llama大语言模型llama2llmsGo
Go141.03 k
8 小时前
OpenHands
@All-Hands-AI

#大语言模型#🙌 OpenHands: Code Less, Make More

agent人工智能大语言模型ChatGPTclaude-ai
Python54.45 k
5 小时前
devika
@stitionai

Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. D...

Python18.77 k
8 个月前
MediaCrawler
@NanmiCoder

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 百度贴吧评论回复爬虫 | 知乎问答文章|评论爬虫

Python22.7 k
16 小时前
hiyouga/LLaMA-Factory
LLaMA-Factory
@hiyouga

#大语言模型#Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fine-tuninglanguage-modelllama大语言模型peft
Python49.23 k
13 小时前
NVIDIA Corporation
TensorRT-LLM
NVIDIA Corporation@NVIDIA

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-L...

C++10.45 k
11 天前
Open-Sora-Plan
@PKU-YuanGroup

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Python11.96 k
2 个月前
litellm
@BerriAI

#大语言模型#Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

anthropiclangchain大语言模型llmopsopenai
Python22.88 k
2 小时前
Hugging Face
text-generation-inference
Hugging Face@huggingface

#自然语言处理#Large Language Model Text Generation Inference

bloom自然语言处理PyTorchinferencegpt
Python10.14 k
17 小时前
skyvern
@Skyvern-AI

#大语言模型#Automate browser-based workflows with LLMs and Computer Vision

API自动化browsercomputergpt
Python13.39 k
3 小时前
llm-action
@liguodongiot

#大语言模型#本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

大语言模型llm-inferencellm-servingllm-trainingllmops
HTML17.62 k
19 天前
MetaGPT
@FoundationAgents

#大语言模型#MetaGPT:为 GPT 分配不同的角色,协作处理更复杂的任务。MetaGPT输入一句话的老板需求,输出用户故事 / 竞品分析 / 需求 / 数据结构 / APIs / 文件等

agentgpt大语言模型metagptmulti-agent
Python55.7 k
4 天前
mlc-llm
@mlc-ai

#大语言模型#Universal LLM Deployment Engine with ML Compilation

大语言模型machine-learning-compilationlanguage-modeltvm
Python20.63 k
19 天前
sglang
@sgl-project

#大语言模型#SGLang is a fast serving framework for large language models and vision language models.

CUDAinferencellamallava大语言模型
Python14.47 k
2 小时前
MoneyPrinterTurbo
@harry0703

#大语言模型#利用AI大模型,一键生成高清短视频 Generate short videos with one click using AI LLM.

shortvideo自动化ChatGPTmoviepyPython
Python33.8 k
4 天前
triton
@triton-lang

Development repository for the Triton language and compiler

翻译 - Triton 语言和编译器的开发库

MLIR15.57 k
3 天前
flash-attention
@Dao-AILab

Fast and memory-efficient exact attention

Python17.42 k
12 小时前