CUDA · GitHub Topics

#大语言模型#vLLM 是一个高效的开源库，用于加速大语言模型推理，通过优化内存管理和分布式处理实现高吞吐量和低延迟。

gpt 大语言模型 PyTorch llmops mlops model-serving transformer llm-serving inference llama amd rocm CUDA inferentia trainium tpu xpu hpu deepseek qwen

Python 53.63 k

2 小时前

hashcat / hashcat

最快、最先进的密码还原破解工具

hashcat password cracking gpgpu opencl C hashes CUDA

C 23.11 k

14 小时前

NVIDIA / nvidia-docker

Build and run Docker containers leveraging NVIDIA GPUs

nvidia-docker Docker CUDA gpu

Makefile 17.41 k

2 年前

NVlabs / instant-ngp

#计算机科学#Instant neural graphics primitives: lightning fast NeRF and more

神经网络机器学习 CUDA nerf computer-graphics 机器视觉 3d-reconstruction signed-distance-functions function-approximation real-time realtime real-time-rendering

Cuda 16.82 k

4 天前

sgl-project / sglang

#大语言模型#SGLang is a fast serving framework for large language models and vision language models.

CUDA inference llama llava 大语言模型 llm-serving moe PyTorch transformer vlm llama3 deepseek deepseek-v3 deepseek-r1 qwen3 llama4 blackwell llama5 openai kimi

Python 16.44 k

5 小时前

kaldi-asr / kaldi

kaldi-asr/kaldi is the official location of the Kaldi project.

kaldi C++CUDA Shell speech-recognition speech-to-text speaker-verification speaker-id speech

Shell 15.01 k

9 天前

vosen / ZLUDA

ZLUDA 使得原本为英伟达GPU设计的 CUDA 应用程序能够在AMD和Intel GPU上运行而无需修改

CUDA Rust

Rust 12.82 k

10 小时前

isl-org / Open3D

#计算机科学#Open3D: A Modern Library for 3D Data Processing

mesh-processing computer-graphics OpenGL C++Python reconstruction odometry 可视化 registration 机器学习 3D Point cloud rendering GUI 3d-perception gpu arm CUDA PyTorch Tensorflow

C++ 12.61 k

11 小时前

tracel-ai / burn

#计算机科学#burn 是一个Rust的深度学习框架

autodiff 深度学习机器学习 Rust scientific-computing ndarray tensor 神经网络 PyTorch cross-platform kernel-fusion onnx WebAssembly webgpu CUDA metal rocm vulkan

Rust 12.4 k

7 小时前

srush / GPU-Puzzles

#计算机科学#Solve puzzles. Learn CUDA.

CUDA 机器学习 puzzles

Jupyter Notebook 11.33 k

1 年前

NVIDIA / TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-L...

blackwell CUDA moe PyTorch llm-serving

C++ 11.17 k1

1 天前

numba / numba

NumPy aware dynamic Python compiler using LLVM

Python NumPy LLVM 编译器 CUDA parallel numba

Python 10.55 k

8 天前

cupy / cupy

NumPy & SciPy for GPU

CUDA cudnn cublas cusolver nccl Python NumPy cupy curand cusparse gpu SciPy tensor rocm

Python 10.38 k

2 天前

Oneflow-Inc / oneflow

#计算机科学#OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

深度学习机器学习深度神经网络 distributed 神经网络 CUDA

C++ 9.36 k

16 天前

rapidsai / cudf

cuDF - GPU DataFrame Library

gpu rapids cudf arrow CUDA pandas dataframe dask 数据分析数据科学 pydata C++Python

C++ 9.09 k

1 天前

replicate / cog

#计算机科学#Containers for machine learning

containers CUDA 深度学习 Docker 机器学习 PyTorch Tensorflow 人工智能

Go 8.75 k

1 天前

catboost / catboost

#计算机科学#A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computa...