onnxruntime

#安卓#Open source real-time translation app for Android that runs locally

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

📄 Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.

#计算机科学#Java 深度学习框架

🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

#计算机科学#OpenMMLab Model Deployment Framework

Local AI API Platform

#计算机科学#QualityScaler - image/video AI upscaler app

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

TTS with kokoro and onnx runtime

Lightweight nudity detection

#人脸识别#Robust realtime face and facial landmark tracking on CPU with Unity integration

Voice activity detector (VAD) for the browser with a simple API

#计算机科学#Fast ML inference & training for ONNX models in Rust

#计算机科学#Realtime human head pose estimation with ONNXRuntime and OpenCV.

#大语言模型#Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.