llmops · GitHub Topics

#大语言模型#vLLM 是一个高效的开源库，用于加速大语言模型推理，通过优化内存管理和分布式处理实现高吞吐量和低延迟。

gpt 大语言模型 PyTorch llmops mlops model-serving transformer llm-serving inference llama amd rocm CUDA inferentia trainium tpu xpu hpu deepseek qwen

Python 53.63 k

2 小时前

pathwaycom / llm-app

#大语言模型#Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...

聊天机器人 hugging-face 大语言模型 llm-local llm-prompting llm-security llmops pathway real-time vector-index open-ai vector-database retrieval-augmented-generation 机器学习 rag

Jupyter Notebook 28 k

1 天前

BerriAI / litellm

#大语言模型#Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

anthropic langchain 大语言模型 llmops openai ai-gateway azure-openai bedrock gateway openai-proxy vertex-ai llm-gateway litellm mcp-gateway

Python 26.65 k

5 小时前

ComposioHQ / composio

#大语言模型#Composio equips your AI agents & LLMs with 100+ high-quality integrations via function calling

人工智能 Python agents aiagents function-calling developer-tools gpt-4 gpt-4o 大语言模型 llmops TypeScript JavaScript ai-agents Hacktoberfest hacktoberfest2024 mcp sse

TypeScript 25.59 k

13 小时前

jina-ai / serve

#计算机科学#Jina 是一个基于深度学习的搜索框架，支持各种类型如图片，视频，长文本，PDF等。

neural-search cloud-native 深度学习机器学习框架 gRPC Kubernetes multimodal mlops pipeline FastAPI generative-ai Docker jaeger llmops OpenTelemetry cncf 微服务 orchestration prometheus

Python 21.68 k

4 个月前

mlflow / mlflow

#计算机科学#MLflow 是一个开源框架，旨在管理整个机器学习生命周期。它可以在不同的平台上训练模型并为模型提供服务，让你能够使用相同的一组工具，而不管试验是在计算机本地、远程计算目标上、虚拟机上

机器学习人工智能 mlflow Apache Spark model-management agentops agents evaluation langchain llm-evaluation llmops observability Open Source openai prompt-engineering mlops

Python 21.4 k

4 小时前

liguodongiot / llm-action

#大语言模型#本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

大语言模型 llm-inference llm-serving llm-training llmops

HTML 19.8 k

21 天前

TransformerOptimus / SuperAGI

#大语言模型#<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

agi 人工智能 autonomous-agents Python agents gpt-4 openai artificial-general-intelligence superagi 大语言模型 llmops Next pinecone Hacktoberfest

Python 16.59 k

6 个月前

raga-ai-hub / RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal...

agents llmops agentic-ai-development agentic-ai

Python 16.03 k

16 天前

langfuse / langfuse

#大语言模型#🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

analytics 大语言模型 llmops large-language-models openai 自托管 ycombinator 监控 observability Open Source langchain llama-index evaluation prompt-engineering prompt-management playground llm-evaluation llm-observability autogen

TypeScript 14.47 k

1 小时前

comet-ml / opik

#大语言模型#Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Open Source langchain openai playground prompt-engineering llama-index 大语言模型 llm-evaluation llm-observability llmops

Python 11.93 k

10 小时前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.63 k

2 天前

explodinggradients / ragas

#大语言模型#Supercharge Your LLM Application Evaluations 🚀

大语言模型 llmops evaluation

Python 10.14 k

2 天前

Netflix / metaflow

#大语言模型#Build, Manage and Deploy AI/ML Systems

机器学习数据科学 model-management 人工智能 ml-platform ml-infrastructure Python mlops datascience high-performance-computing Kubernetes Amazon Web Services Azure Google 云大语言模型 llmops agents generative-ai

Python 9.33 k

2 天前

dataelement / bisheng

#大语言模型#一个大模型应用开发平台，赋能和加速大模型应用开发落地，帮助用户以最佳体验进入下一代应用开发模式。

agent 人工智能聊天机器人 rag workflow enterprise genai gpt langchian llama 大语言模型 llmdevops llmops OCR openai orchestration Python React finetune sft

TypeScript 9.24 k

8 小时前

tensorzero / tensorzero

#大语言模型#TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.

人工智能深度学习 gpt 大语言模型 llmops 机器学习 Rust mlops anthropic llama openai generative-ai ai-engineering Python ml-engineering large-language-models genai

Rust 9.17 k

5 小时前

Portkey-AI / gateway

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

gateway generative-ai llmops 大语言模型 prompt-engineering ai-gateway langchain llama-index openai router Hacktoberfest

TypeScript 9.04 k

2 天前

bentoml / BentoML

#大语言模型#The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

model-serving mlops llmops generative-ai llm-inference model-inference-service inference-platform 深度学习 llm-serving 机器学习 Python multimodal ml-engineering 大语言模型 ai-inference

Python 7.93 k

1 天前

promptfoo / promptfoo

#大语言模型#Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with comma...