GitHub 中文社区
回车: Github搜索    Shift+回车: Google搜索
论坛
排行榜
趋势
登录

©2025 GitHub中文社区论坛GitHub官网网站地图GitHub官方翻译

  • X iconGitHub on X
  • Facebook iconGitHub on Facebook
  • Linkedin iconGitHub on LinkedIn
  • YouTube iconGitHub on YouTube
  • Twitch iconGitHub on Twitch
  • TikTok iconGitHub on TikTok
  • GitHub markGitHub’s organization on GitHub
集合主题趋势排行榜
#

llm-gateway

Website
Wikipedia
https://static.github-zh.com/github_avatars/Kong?size=40
Kong / kong

Kong 是一个云原生API 网关,提供反向代理、路由、负载平衡、健康检查、身份验证等功能

APInginxluajit微服务api-managementServerlessapisreverse-proxycloud-nativeDevOpsKuberneteskubernetes-ingress-controllerkubernetes-ingress人工智能ai-gatewayllm-gatewayopenai-proxyllm-ops
Lua 41.42 k
7 天前
https://static.github-zh.com/github_avatars/BerriAI?size=40
BerriAI / litellm

#大语言模型#Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

anthropiclangchain大语言模型llmopsopenaiai-gatewayazure-openaibedrockgatewayopenai-proxyvertex-aillm-gatewaylitellmmcp-gateway
Python 26.65 k
4 小时前
coaidev/coai
https://static.github-zh.com/github_avatars/coaidev?size=40
coaidev / coai

#大语言模型#🚀 Next Generation AI One-Stop Internationalization Solution. 🚀 下一代 AI 一站式 B/C 端解决方案,支持 OpenAI,Midjourney,Claude,讯飞星火,Stable Diffusion,DALL·E,ChatGLM,通义千问,腾讯混元,360 智脑,百川 AI,火山方舟,新必应,Gemini,Moonshot 等...

ChatGPTGoReactAPIchatcross-platformgeminiopenaiproxyai-gatewayllm-gateway
TypeScript 8.5 k
1 个月前
https://static.github-zh.com/github_avatars/katanemo?size=40
katanemo / archgw

The smart edge and AI gateway for agents. Arch is a high-performance proxy server that handles the low-level work in building agents like applying guardrails, routing prompts to the right agent, and u...

gatewaygenerative-aillm-inference大语言模型promptproxyproxy-serverllmopsopenaiRouting (disambiguation)ai-gatewayllm-gatewayllm-routingenvoyenvoyproxyai-gateway-supportllm-proxy
Rust 3.43 k
3 天前
https://static.github-zh.com/github_avatars/APIParkLab?size=40
APIParkLab / APIPark

🦄云原生、超高性能 AI&API网关,LLM API 管理、分发系统、开放平台,支持所有AI API,不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 请求和返回,API申请与审批,调用统计、负载均衡、多模型灾备。一键部署,开箱即用...

APIgateway人工智能ai-gatewayllm-gatewayapi-platformclaudedeveloper-portalopenaideepseekqwen
TypeScript 1.3 k
8 天前
https://static.github-zh.com/github_avatars/langdb?size=40
langdb / ai-gateway

#大语言模型#Govern, Secure, and Optimize your AI Traffic. AI Gateway provides unified interface to all LLMs using OpenAI API format with a focus on performance and reliability. Built in Rust.

agentsanthropicbedrockclaudeclickhousedeepseekgeminilangchain大语言模型model-context-protocolopenaiRusttracingai-gatewayllm-gateway
Rust 631
1 天前
https://static.github-zh.com/github_avatars/maximhq?size=40
maximhq / bifrost

#大语言模型#The Fastest LLM Gateway with built in OTel observability and MCP gateway

gateway大语言模型llm-gatewaymcpmcp-clientmcp-server
Go 237
17 小时前
https://static.github-zh.com/github_avatars/langfuse?size=40
langfuse / oss-llmops-stack

#大语言模型#Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability,...

ai-gatewaygateway大语言模型llm-evaluationllm-gatewayllm-observabilityllmops监控openai-proxyprompt-management自托管ycombinatorOpen Source
107
5 个月前
https://static.github-zh.com/github_avatars/masaic-ai-platform?size=40
masaic-ai-platform / open-responses

#大语言模型#Open AI platform in your local. Supports Ollama, OpenRouter, Gemini, OpenAI, Deepseek etc.

ai-agentsmulti-agent-systemsai-platform聊天机器人deepseekgeminigroq大语言模型llm-gatewaylocal-aiobservabilityollamaOpen Sourceopenairag
Kotlin 91
3 天前
https://static.github-zh.com/github_avatars/LianjiaTech?size=40
LianjiaTech / bella-openapi

#大语言模型#Bella OpenAPI是一个提供了丰富的AI调用能力的API网关,可类比openrouter,与之不同的是除了提供聊天补全(chat-completion)能力外,还提供了文本向量化(text-embedding)、语音识别(ASR)、语音合成(TTS)、文生图、图生图等多种AI能力,同时集成了计费、限流和资源管理功能。且集成的所有能力都经过了大规模生产环境的验证。

ai-gatewayazure-openaibedrock大语言模型llm-gatewayllmopsopenaiopenai-proxydeepseekvolcengine
Java 76
7 天前
https://static.github-zh.com/github_avatars/bluewave-labs?size=40
bluewave-labs / LangRoute

#大语言模型#This is a robust and configurable LLM proxy server built with Node.js, Express, and PostgreSQL. It acts as an intermediary between your applications and various Large Language Model (LLM) providers

大语言模型llm-gatewayllm-proxyproxy
TypeScript 23
1 天前
https://static.github-zh.com/github_avatars/teilomillet?size=40
teilomillet / hapax

#大语言模型#The reliability layer between your code and LLM providers.

anthropicinfrastructureInfrastructure as code大语言模型监控observabilityopenaillm-observabilityllmopsOpen Sourcellm-gateway
Go 19
7 个月前
https://static.github-zh.com/github_avatars/fabiojbg?size=40
fabiojbg / LLMApiGateway

#大语言模型#A personal LLM gateway with fault-tolerant capabilities for calls to LLM models from any provider with OpenAI-compatible APIs. Advanced features like retry, model sequencing, and body parameter inject...

fault-tolerancegateway大语言模型openai-apiopenrouterproxyroocodellm-gatewayllm-proxy
Python 15
2 天前
https://static.github-zh.com/github_avatars/Lightning-AI?size=40
Lightning-AI / litAI

#大语言模型#Chat with any AI model in one line of Python. Build agents, AI apps that just work - with tool use, auto retries, fallback, logging, and unified billing. Pure Python. Full control. Zero magic.

ai-gateway聊天机器人大语言模型llm-gatewayllm-inferenceopenaiopenai-proxyagents人工智能API
Python 13
20 小时前
https://static.github-zh.com/github_avatars/shengyanli1982?size=40
shengyanli1982 / llmproxy

#大语言模型#🧭🧭 An intelligent load balancer with smart scheduling that unifies diverse LLMs.

ai-gatewayAzuregatewaylangchain大语言模型llm-gatewayllmopsopenaiopenai-apivertex-aiagentllmapimoaoptimizationproxyproxy-serveragentic-aiprompt-engineering
Rust 12
3 天前
https://static.github-zh.com/github_avatars/cloud-apim?size=40
cloud-apim / otoroshi-llm-extension

#大语言模型#Connect, setup, secure and seamlessly manage LLM models using an Universal/OpenAI compatible API

人工智能ai-gatewayAPI大语言模型mcpWebAssemblyllm-gateway
Scala 12
14 天前
https://static.github-zh.com/github_avatars/ozanunal0?size=40
ozanunal0 / Prometheus-Gateway

#大语言模型#An open-source, security-first LLM Gateway designed to provide a unified, secure, and observable entry point to any Large Language Model.

APICybersecurityFastAPI大语言模型llm-gatewayprometheusPython安全genai
Python 8
22 天前
https://static.github-zh.com/github_avatars/hypersigilhq?size=40
hypersigilhq / hypersigil

#大语言模型#Prompt management gateway with a UI for AI-powered applications. Enables non-technical users to test, refine, and deploy prompts seamlessly across multiple AI providers.

大语言模型llm-evaluationllm-gatewayprompt-engineeringprompt-toolkitprompt-tuning
TypeScript 6
14 小时前
https://static.github-zh.com/github_avatars/burgonet-eu?size=40
burgonet-eu / gateway

Burgonet Gateway is an enterprise LLM gateway that provides secure access and compliance controls for AI systems

人工智能llm-gatewayllmops
Rust 6
6 个月前
https://static.github-zh.com/github_avatars/Tanantor?size=40
Tanantor / langgate

#大语言模型#Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.

人工智能ai-gatewayaiopsanthropicazure-openaibedrockenvoyFastAPIgatewaylangchainlangchain-python大语言模型llm-gatewayllmopsmlopsopenaiopenai-proxyregistryvertex-ai
Python 4
20 天前
loading...