llmops · GitHub Topics

#大语言模型#A high-throughput and memory-efficient inference and serving engine for LLMs

gpt 大语言模型 PyTorch llmops mlops model-serving transformer llm-serving inference llama amd rocm CUDA inferentia trainium tpu xpu hpu deepseek qwen

Python 49.62 k

15 小时前

ComposioHQ / composio

#大语言模型#Composio equips your AI agents & LLMs with 100+ high-quality integrations via function calling

人工智能 Python agents aiagents function-calling developer-tools gpt-4 gpt-4o 大语言模型 llmops TypeScript JavaScript ai-agents Hacktoberfest hacktoberfest2024

Python 25.5 k

1 天前

pathwaycom / llm-app

#大语言模型#Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, a...

聊天机器人 hugging-face 大语言模型 llm-local llm-prompting llm-security llmops pathway real-time vector-index open-ai vector-database retrieval-augmented-generation 机器学习 rag

Jupyter Notebook 25.37 k

1 个月前

BerriAI / litellm

#大语言模型#Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

anthropic langchain 大语言模型 llmops openai ai-gateway azure-openai bedrock gateway openai-proxy vertex-ai llm-gateway

Python 24.05 k

7 小时前

jina-ai / serve

#计算机科学#Jina 是一个基于深度学习的搜索框架，支持各种类型如图片，视频，长文本，PDF等。

neural-search cloud-native 深度学习机器学习框架 gRPC Kubernetes multimodal mlops pipeline FastAPI generative-ai Docker jaeger llmops OpenTelemetry cncf 微服务 orchestration prometheus

Python 21.61 k

3 个月前

liguodongiot / llm-action

#大语言模型#本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

大语言模型 llm-inference llm-serving llm-training llmops

HTML 18.54 k

12 小时前

TransformerOptimus / SuperAGI

#大语言模型#<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

agi 人工智能 autonomous-agents Python agents gpt-4 openai artificial-general-intelligence superagi 大语言模型 llmops Next pinecone Hacktoberfest

Python 16.41 k

5 个月前

raga-ai-hub / RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal...

agents llmops agentic-ai-development agentic-ai

Python 16.19 k

5 天前

langfuse / langfuse

#大语言模型#🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

analytics 大语言模型 llmops large-language-models openai 自托管 ycombinator 监控 observability Open Source langchain llama-index evaluation prompt-engineering prompt-management playground llm-evaluation llm-observability autogen

TypeScript 12.61 k

2 小时前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.35 k

6 天前

comet-ml / opik

#大语言模型#Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Open Source langchain openai playground prompt-engineering llama-index 大语言模型 llm-evaluation llm-observability llmops

Python 9.75 k

36 分钟前

explodinggradients / ragas

#大语言模型#Supercharge Your LLM Application Evaluations 🚀

大语言模型 llmops evaluation

Python 9.5 k

3 天前

Netflix / metaflow

#大语言模型#Build, Manage and Deploy AI/ML Systems

机器学习数据科学 model-management 人工智能 ml-platform ml-infrastructure Python mlops datascience high-performance-computing Kubernetes Amazon Web Services Azure Google 云大语言模型 llmops agents generative-ai

Python 8.89 k

2 天前

dataelement / bisheng

#大语言模型#一个大模型应用开发平台，赋能和加速大模型应用开发落地，帮助用户以最佳体验进入下一代应用开发模式。

agent 人工智能聊天机器人 rag workflow enterprise genai gpt langchian llama 大语言模型 llmdevops llmops OCR openai orchestration Python React finetune sft

TypeScript 8.84 k

2 天前

Portkey-AI / gateway

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

gateway generative-ai llmops 大语言模型 prompt-engineering ai-gateway langchain llama-index openai router Hacktoberfest

TypeScript 8.04 k

2 天前

bentoml / BentoML

#大语言模型#The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

model-serving mlops llmops generative-ai llm-inference 深度学习 llm-serving 机器学习 Python multimodal ml-engineering 大语言模型

Python 7.78 k

2 天前

promptfoo / promptfoo

#大语言模型#Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command ...

大语言模型 prompt-engineering prompts llmops prompt-testing Testing rag evaluation evaluation-framework llm-eval llm-evaluation llm-evaluation-framework 持续集成 CI/CD pentesting red-teaming vulnerability-scanners

TypeScript 7.19 k

1 天前

tensorzero / tensorzero

#大语言模型#TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluation, and experimentation.

人工智能深度学习 gpt 大语言模型 llmops 机器学习 Rust mlops anthropic llama openai generative-ai ai-engineering Python ml-engineering large-language-models genai

Rust 7.05 k

16 小时前

evidentlyai / evidently

#大语言模型#Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.