ascend · GitHub Topics

Syllo / nvtop

#效率工具集合#GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm

监控 Nvidia gpu ncurses intel Linux command-line-tool adreno amd Apple ascend huawei

C 9.21 k

2 个月前

gpustack / gpustack

#大语言模型#Simple, scalable AI model deployment on GPU clusters

ascend CUDA deepseek distributed-inference genai inference llama llamacpp 大语言模型 maas metal openai qwen rocm vllm mindie llm-inference llm-serving local-ai heterogeneous-cluster

Python 2.92 k

4 天前

Project-HAMi / HAMi

Heterogeneous AI Computing Virtualization Middleware(Project under CNCF)

vgpu gpu-virtualization device-plugin gpu-management kubernetes-gpu-cluster ascend cambricon gpu-shareable Kubernetes metax Nvidia hygon iluvatar mthreads cncf gpu-acceleration vgpu-hypervisor

Go 1.79 k

3 天前

nndeploy / nndeploy

Easy-to-use, high-performance, multi-platform inference deployment framework

ascend easy-to-use hpc mnn model-deployment openvino parallel tensorrt yolo

C++ 942

5 天前

vllm-project / vllm-ascend

#大语言模型#Community maintained hardware plugin for vLLM on Ascend

ascend inference 大语言模型 llm-serving llmops mlops model-serving transformer vllm

Python 758

1 天前

LSH9832 / edgeyolo

#计算机科学#an edge-real-time anchor-free object detector with decent performance

anchor-free 机器视觉 object-detector 深度学习 edge-computing object-detection onnx yolo PyTorch tensorrt mnn ascend

Python 494

9 天前

Ascend / pytorch

#计算机科学#Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch

ascend 深度学习 PyTorch

Python 374

5 天前

modelbox-ai / modelbox

#计算机科学#A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，NPU加速。

mediapipe 深度学习 pipeline inference PyTorch cloud-service gpu Tensorflow 框架人工智能 ascend CUDA rockchip

C++ 156

1 年前