llm-routing · GitHub Topics

The smart edge and AI gateway for agents. Arch is a high-performance proxy server that handles the low-level work in building agents like applying guardrails, routing prompts to the right agent, and u...

gateway generative-ai llm-inference 大语言模型 prompt proxy proxy-server llmops openai Routing (disambiguation)ai-gateway llm-gateway llm-routing envoy envoyproxy ai-gateway-support llm-proxy

Rust 3.43 k

4 天前

junchenzhi / Awesome-LLM-Ensemble

A curated list of Awesome-LLM-Ensemble papers for the survey "Harnessing Multiple Large Language Models: A Survey on LLM Ensemble"

ensemble ensemble-learning llm-agents 大语言模型 multi-agent-systems large-language-models llm-routing moe routing-algorithm

102

25 天前

valaises / llm-portal

Unified interface server for various LLM providers with OpenAI API format

FastAPI litellm llm-routing 大语言模型

Python 1

2 个月前