#大语言模型#SGLang is a fast serving framework for large language models and vision language models.
Python 17.63 k
2 小时前
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-L...
C++ 11.51 k1
3 小时前
Prebuilt DeepSpeed wheels for Windows with NVIDIA GPU support. Supports GTX 10 - RTX 50 series. Compiled with pytorch 2.7, 2.8 and cuda 12.8
2
17 天前
Repository for Campbells-Luggs-Blackwells family history web site
HTML 0
3 年前
Pytorch Operation for distributed gemm in nvidia blackwell gpus
Cuda 0
2 个月前