GitHub 中文社区
回车: Github搜索    Shift+回车: Google搜索
论坛
排行榜
趋势
登录

©2025 GitHub中文社区论坛GitHub官网网站地图GitHub官方翻译

  • X iconGitHub on X
  • Facebook iconGitHub on Facebook
  • Linkedin iconGitHub on LinkedIn
  • YouTube iconGitHub on YouTube
  • Twitch iconGitHub on Twitch
  • TikTok iconGitHub on TikTok
  • GitHub markGitHub’s organization on GitHub
集合主题趋势排行榜
#

ai-inference

Website
Wikipedia
bentoml/BentoML
https://static.github-zh.com/github_avatars/bentoml?size=40
bentoml / BentoML

#大语言模型#The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

model-servingmlopsllmopsgenerative-aillm-inferencemodel-inference-serviceinference-platform深度学习llm-serving机器学习Pythonmultimodalml-engineering大语言模型ai-inference
Python 8.02 k
2 天前
https://static.github-zh.com/github_avatars/uxlfoundation?size=40
uxlfoundation / scikit-learn-intelex

#计算机科学# Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application

oneapiscikit-learn机器学习数据分析Pythonswrepobig-dataanalyticsai-inferencegpu
Python 1.3 k
3 天前
https://static.github-zh.com/github_avatars/nndeploy?size=40
nndeploy / nndeploy

Your Local AI Workflow | 你本地的AI工作流

easy-to-usehpcai-agentai-inferencecreativemulti-platform
C++ 1.16 k
2 天前
https://static.github-zh.com/github_avatars/uxlfoundation?size=40
uxlfoundation / oneDAL

#计算机科学#oneAPI Data Analytics Library (oneDAL)

onedal数据分析oneapi机器学习Hacktoberfestswrepobig-dataanalyticsai-inferenceC++数据科学
C++ 639
3 天前
https://static.github-zh.com/github_avatars/intel?size=40
intel / dffml

#数据仓库#The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.

机器学习data-flowasyncioevent-basedflow-based-programmingdag数据集swrepoai-inferenceanalytics框架LibrarymodelspipelinesPython
Python 254
1 年前
https://static.github-zh.com/github_avatars/blace-ai?size=40
blace-ai / blace-ai

Cross-platform c++ sdk & model hub for easy ai inference

ai-inferenceC++ai-sdklibtorchonnxruntime
C++ 49
4 天前
https://static.github-zh.com/github_avatars/philips-software?size=40
philips-software / go-hsdp-api

Client library to interact with various APIs used within Philips in a simple and uniform way

iamLoggingfhirpkiauditingai-inferenceInternet of things
Go 32
6 个月前
https://static.github-zh.com/github_avatars/superjamie?size=40
superjamie / rocswap

#大语言模型#llama.cpp + ROCm + llama-swap

人工智能ai-inferenceamdamd-gpuamdgpullamacpp大语言模型llm-inferencerocm
Dockerfile 21
7 个月前
https://static.github-zh.com/github_avatars/tinyBigGAMES?size=40
tinyBigGAMES / JetInfero

Local LLM Inference Library

llama-cppwin64pascallocal-inferenceai-inferenceLibrary
Pascal 12
7 个月前
https://static.github-zh.com/github_avatars/open-vela?size=40
open-vela / apps_mlearning_tflite-micro

Customed version of Google's tflite-micro

ai-inference
C++ 8
1 个月前
https://static.github-zh.com/github_avatars/redbco?size=40
redbco / infermesh

GPU-aware inference mesh for large-scale AI serving

ai-inferencedistributed-systemsfault-tolerancehigh-availabilityinference-engineml-infrastructuremodel-servingobservabilityRustservice-mesh
Rust 7
4 天前
https://static.github-zh.com/github_avatars/vinsblack?size=40
vinsblack / professional-nano-vllm-enterprise

#计算机科学#Enterprise evolution of nano-vLLM - Currently in development. Built with respect on @GeeeekExplorer's foundation.

llm-inferenceOpen Sourceproduction-readyPyTorchai-inference机器学习
Python 5
2 个月前
https://static.github-zh.com/github_avatars/valvebara?size=40
valvebara / valvebara

No more Hugging Face cost leaks.

ai-inferencebillinghuggingfaceNextVercel
TypeScript 3
8 个月前
https://static.github-zh.com/github_avatars/arbitrary-number?size=40
arbitrary-number / arbitrary-number

#计算机科学#Arbitrary Numbers

ai-inferenceCUDA深度学习gpu机器学习model-servingnumerical-computingNvidiaPythonPyTorchTensorflow
Python 2
18 天前
https://static.github-zh.com/github_avatars/dhanushk-offl?size=40
dhanushk-offl / ai-inference-backend-boilerplate

A powerful, faster, scalable full-stack boilerplace for AI inference using Node.js, Python, Redis, and Docker

人工智能ai-inferencebackend-apiboilerplate-templateNode.jsRedistransformer
JavaScript 2
4 个月前
https://static.github-zh.com/github_avatars/ayutaz?size=40
ayutaz / uPiper

Unity TTS plugin: Piper neural synthesis + OpenJTalk Japanese + Unity AI Inference Engine. Windows/Mac/Linux/Android ready. High-quality voices for games & apps.

ai-inferencetext-to-speechttsUnity
C# 1
7 天前
https://static.github-zh.com/github_avatars/KDsudheera?size=40
KDsudheera / greenhouse-ai-fancontroller

#计算机科学#🌱 Intelligent IoT greenhouse fan controller using AI/ML for automated climate control. Features ESP32 + DHT22 sensors, real-time Firebase integration, Flutter mobile app with TensorFlow Lite on-devic...

ai-inferenceedge-aiembedded-systemsESP32FirebaseFlutterInternet of things机器学习mobile-appPlatformIOrelaytensorflow-lite
Dart 1
12 天前
https://static.github-zh.com/github_avatars/hanax-ai?size=40
hanax-ai / Citadel-Beta

Citadel AI OS – Enterprise AI Runtime Environment for Inference, Agents, and Business Operations

ai-inferenceFastAPIgovernancemulti-agentPythonrag
JavaScript 0
2 个月前
https://static.github-zh.com/github_avatars/calinux-py?size=40
calinux-py / UniUi

UniUi uses AI to allow you to talk directly to your system.

人工智能ai-inferenceai-integrationinterfaceopenaiopenai-api
JavaScript 0
3 个月前
https://static.github-zh.com/github_avatars/PREMSAI3717?size=40
PREMSAI3717 / professional-nano-vllm-enterprise

#计算机科学#Professional nano-vLLM Enterprise enhances the original nano-vLLM, transforming it into a robust, production-ready LLM engine. Explore its features on GitHub! 🚀✨

ai-inferencellm-inference机器学习Open Sourceproduction-readyPyTorch
Python 0
2 个月前
loading...