GitHub 中文社区
回车: Github搜索    Shift+回车: Google搜索
论坛
排行榜
趋势
登录

©2025 GitHub中文社区论坛GitHub官网网站地图GitHub官方翻译

  • X iconGitHub on X
  • Facebook iconGitHub on Facebook
  • Linkedin iconGitHub on LinkedIn
  • YouTube iconGitHub on YouTube
  • Twitch iconGitHub on Twitch
  • TikTok iconGitHub on TikTok
  • GitHub markGitHub’s organization on GitHub
集合主题趋势排行榜
#

llm-gateway

Website
Wikipedia
https://static.github-zh.com/github_avatars/BerriAI?size=40
BerriAI / litellm

#大语言模型#Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

anthropiclangchain大语言模型llmopsopenaiai-gatewayazure-openaibedrockgatewayopenai-proxyvertex-aillm-gateway
Python 24.08 k
20 小时前
https://static.github-zh.com/github_avatars/katanemo?size=40
katanemo / archgw

The AI-native proxy server for agents. Arch handles the pesky low-level work in building agentic apps like calling specific tools, routing prompts to the right agents, clarifying vague inputs, unifyin...

gatewaygenerative-aillm-inference大语言模型promptproxyproxy-serverllmopsopenaiRouting (disambiguation)ai-gatewayllm-gatewayllm-routingenvoyenvoyproxy
Rust 2.72 k
2 天前
https://static.github-zh.com/github_avatars/APIParkLab?size=40
APIParkLab / APIPark

🦄云原生、超高性能 AI&API网关,LLM API 管理、分发系统、开放平台,支持所有AI API,不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 请求和返回,API申请与审批,调用统计、负载均衡、多模型灾备。一键部署,开箱即用...

APIgateway人工智能ai-gatewayllm-gatewayapi-platformclaudedeveloper-portalopenaideepseekqwen
TypeScript 1.2 k
21 天前
https://static.github-zh.com/github_avatars/langdb?size=40
langdb / ai-gateway

#大语言模型#Govern, Secure, and Optimize your AI Traffic. AI Gateway provides unified interface to all LLMs using OpenAI API format with a focus on performance and reliability. Built in Rust.

agentsanthropicbedrockclaudeclickhousedeepseekgeminilangchain大语言模型model-context-protocolopenaiRusttracingai-gatewayllm-gateway
Rust 592
3 天前
https://static.github-zh.com/github_avatars/langfuse?size=40
langfuse / oss-llmops-stack

#大语言模型#Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability,...

ai-gatewaygateway大语言模型llm-evaluationllm-gatewayllm-observabilityllmops监控openai-proxyprompt-management自托管ycombinatorOpen Source
104
4 个月前
https://static.github-zh.com/github_avatars/masaic-ai-platform?size=40
masaic-ai-platform / open-responses

#大语言模型#Open AI platform in your local. Supports Ollama, OpenRouter, Gemini, OpenAI, Deepseek etc.

ai-agentsmulti-agent-systemsai-platform聊天机器人deepseekgeminigroq大语言模型llm-gatewaylocal-aiobservabilityollamaOpen Sourceopenairag
Kotlin 85
7 天前
https://static.github-zh.com/github_avatars/LianjiaTech?size=40
LianjiaTech / bella-openapi

#大语言模型#Bella OpenAPI是一个提供了丰富的AI调用能力的API网关,可类比openrouter,与之不同的是除了提供聊天补全(chat-completion)能力外,还提供了文本向量化(text-embedding)、语音识别(ASR)、语音合成(TTS)、文生图、图生图等多种AI能力,同时集成了计费、限流和资源管理功能。且集成的所有能力都经过了大规模生产环境的验证。

ai-gatewayazure-openaibedrock大语言模型llm-gatewayllmopsopenaiopenai-proxydeepseekvolcengine
Java 41
3 天前
https://static.github-zh.com/github_avatars/teilomillet?size=40
teilomillet / hapax

#大语言模型#The reliability layer between your code and LLM providers.

anthropicinfrastructureInfrastructure as code大语言模型监控observabilityopenaillm-observabilityllmopsOpen Sourcellm-gateway
Go 18
5 个月前
https://static.github-zh.com/github_avatars/bluewave-labs?size=40
bluewave-labs / LangRoute

#大语言模型#This is a robust and configurable LLM proxy server built with Node.js, Express, and PostgreSQL. It acts as an intermediary between your applications and various Large Language Model (LLM) providers

大语言模型llm-gatewayproxy
TypeScript 18
3 个月前
https://static.github-zh.com/github_avatars/cloud-apim?size=40
cloud-apim / otoroshi-llm-extension

#大语言模型#Connect, setup, secure and seamlessly manage LLM models using an Universal/OpenAI compatible API

人工智能ai-gatewayAPI大语言模型mcpWebAssemblyllm-gateway
Scala 11
13 天前
https://static.github-zh.com/github_avatars/burgonet-eu?size=40
burgonet-eu / gateway

Burgonet Gateway is an enterprise LLM gateway that provides secure access and compliance controls for AI systems

人工智能llm-gatewayllmops
Rust 6
5 个月前
https://static.github-zh.com/github_avatars/Tanantor?size=40
Tanantor / langgate

#大语言模型#Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.

人工智能ai-gatewayaiopsanthropicazure-openaibedrockenvoyFastAPIgatewaylangchainlangchain-python大语言模型llm-gatewayllmopsmlopsopenaiopenai-proxyregistryvertex-ai
Python 5
5 天前
https://static.github-zh.com/github_avatars/shengyanli1982?size=40
shengyanli1982 / llmproxy

#大语言模型#🧭🧭 An intelligent load balancer with smart scheduling that unifies diverse LLMs.

ai-gatewayAzuregatewaylangchain大语言模型llm-gatewayllmopsopenaiopenai-apivertex-aiagentllmapimoaoptimizationproxyproxy-serveragentic-aiprompt-engineering
Rust 4
5 天前
https://static.github-zh.com/github_avatars/knnlabs?size=40
knnlabs / Conduit

#大语言模型#A unified API gateway for multiple LLM providers with OpenAI-compatible endpoints

gateway大语言模型llm-gatewayopenai-proxy
C# 2
4 天前
https://static.github-zh.com/github_avatars/charmitro?size=40
charmitro / ai-proxy

#大语言模型#A lightweight proxy for LLM API calls with guardrails, metrics, and monitoring. A vibe coding experiment.

api-proxyGoGrafanaguardrails大语言模型llm-gateway监控observabilityopenaiprometheusVibe coding
Go 2
1 个月前
https://static.github-zh.com/github_avatars/claymore666?size=40
claymore666 / MCPConnectionHub

MCP Connection Hub - A unified Model Context Protocol Gateway

ai-gatewayAPIasync命令行界面DockerFastAPIfunction-callinglangchainllm-gatewayllm-tools微服务model-context-protocolopenai-apiplugin-systemPythonRedissqlalchemy
Python 1
2 个月前
https://static.github-zh.com/github_avatars/frontllm?size=40
frontllm / frontllm-sdk

#大语言模型#FrontLLM is your public gateway to LLMs. Request LLM directly from your front-end code. No backend needed.

人工智能大语言模型llm-frameworkllm-gatewayopenaigateway-api
TypeScript 1
16 天前
https://static.github-zh.com/github_avatars/Mamakkhao?size=40
Mamakkhao / ai-models-integration

#大语言模型# AI Models Integration repository! This project provides seamless integration with various state-of-the-art AI models

聊天机器人ChatGPT机器视觉dashboarddeveloper-portaldeveloper-toolsgeminiGmailllm-gatewayopenai-apiopenai-gymreinforcement-learning-environments
0
3 个月前
https://static.github-zh.com/github_avatars/2jang?size=40
2jang / ollama-chutesai-proxy

#大语言模型#Ollama-compatible API proxy server with Chutes.ai's LLM services.

aiohttpapi-proxyAPIasyncio大语言模型llm-gatewayollamaproxyPython
Python 0
21 天前
https://static.github-zh.com/github_avatars/viniViado?size=40
viniViado / LLMSecOps

#大语言模型#LLMSecOps focuses on integrating security practices within the lifecycle of machine learning models. It ensures that models are robust against threats while maintaining compliance and performance stan...

人工智能Awesome Listsgenerative-ai大语言模型llm-gatewayllm-inferenceprompt-injection安全
0
4 天前
loading...