npu · GitHub Topics

OAID / Tengine

#计算机科学#Tengine is a lite, high performance, modular inference engine for embedded device

翻译 - Tengine是适用于嵌入式设备的精简，高性能，模块化推理引擎

arm 机器学习人工智能 cnn Tensorflow PyTorch onnx x86-64 mips CUDA tensorrt acl npu RISC-V container

C++ 4.46 k

2 个月前

microsoft / ai-dev-gallery

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

directml .NET genai npu onnx phi3 qnn stable-diffusion Windows Windows UI Library (WinUI)人工智能 onnxruntime onnxruntime-genai Visual Studio winappsdk developer-tools mistral Whisper WPF C#

C# 1.01 k

15 小时前

usefulsensors / useful-transformers

Efficient Inference of Transformer models

C++neural-networks npu openai-whisper rockchip transformer-models

C++ 433

9 个月前

Xilinx / mlir-aie

An MLIR-based toolchain for AMD AI Engine-enabled devices.

LLVM mlir Python iron npu

MLIR 372

4 天前

embedeep / Free-TPU

#计算机科学#Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

免费 tpu npu zynq fpga lstm PyTorch rnn caffe darknet 深度学习 hardware

Shell 258

2 年前

AXERA-TECH / ax-samples

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

arm 人工智能神经网络 npu onnx yolov5 yolov6 yolov8 yolov10 yolo11 yolox

CMake 254

1 个月前

onnx / turnkeyml

#大语言模型#Local LLM Server with NPU Acceleration

人工智能 benchmark gpu onnx toolchain 大语言模型 npu onnxruntime-genai amd

Python 171

6 天前

NotPunchnox / rkllama

#大语言模型#Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

人工智能 client-server 大语言模型 npu offline orangepi Python rockchip llm-inference client llm-apps Server

Python 153

3 天前

Pelochus / ezrknpu

#大语言模型#Easy usage of Rockchip's NPUs found in RK3588 and similar chips

大语言模型 neural-networks npu rockchip

Shell 148

1 个月前

embedeep / FREE-TPU-V3plus-for-FPGA

FREE TPU V3plus for FPGA is the free version of a commercial AI processor (EEP-TPU) for Deep Learning EDGE Inference

accelerator 人工智能 npu tpu tpu-acceleration transformer zynq caffe fpga lstm PyTorch

V 145

2 年前

thousrm / universal_NPU-CNN_accelerator

hardware design of universal NPU(CNN accelerator) for various convolution neural network

cnn hardware-design npu Verilog

Verilog 118

2 个月前

powerserve-project / PowerServe

#大语言模型#High-speed and easy-use LLM serving framework for local deployment

llama 大语言模型 llm-inference llm-serving npu qwen smartphone

C++ 101

1 个月前

Qengineering / YoloV5-NPU

#计算机科学#YoloV5 NPU for the RK3566/68/88

深度学习 npu yolov5

C++ 98

10 个月前

sipeed / MaixCDK

C/C++ development kit for Sipeed Maix ecosystem boards

人工智能 maixpy npu vision

C 78

4 天前

neuralize-ai / edgerunner

#安卓#Simplified AI runtime integration for mobile app development

Android coreml cross-platform gpu inference iOS 移动 npu on-device-ai qnn tflite C++神经网络

C++ 65

5 个月前

Qengineering / YoloV8-NPU

#计算机科学#YoloV8 NPU for the RK3566/68/88

深度学习 npu yolov8

C++ 56

10 个月前

thnak / yolov7-rknn

Run your yolov7 object detection with Rockchip NPU platforms (RK3566, RK3568, RK3588, RK3588S, RV1103, RV1106, RK3562).

yolov7 rockchip npu object-detection

Python 52

1 年前

larrylart / codrive

Advanced driver-assistance system with Google Coral Edge TPU Dev Board / USB Accelerator, Intel Movidius NCS (neural compute stick), Myriad 2/X VPU, Gyrfalcon 2801 Neural Accelerator, NVIDIA Jetson N...

google-coral npu Nvidia jetson-nano

C 46

5 年前