llm-monitoring · GitHub Topics

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

llm-tools prompt-engineering prompt-management llm-evaluation llm-framework rag-evaluation llm-observability llm-as-a-judge llm-monitoring llm-platform llm-playground llmops-platform

Python 3.16 k

2 天前

bluewave-labs / flagwise

#大语言模型#Monitor, detect, and analyze security threats and Shadow AI in your LLM applications with comprehensive analytics and real-time alerting.

大语言模型 ai-analytics ai-governance ai-observability llm-monitoring llm-security

JavaScript 30

13 天前

pyladiesams / eval-llm-based-apps-jan2025

#大语言模型#Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

大语言模型 llmops workshop llm-eval llm-evaluation-framework llm-evaluation-metrics llm-monitoring

Jupyter Notebook 7

4 个月前

brokle-ai / brokle

AI Observability Platform – Advanced monitoring and analytics for LLM applications with intelligent gateway. 40+ AI-specific metrics, real-time insights, OpenAI-compatible.

ai-analytics ai-gateway ai-observability 人工智能 Go llm-monitoring Next openai-api real-time-analytics

Go 2

4 天前

BMolapisi / flagwise

#大语言模型#FlagWise 🐙 detects Shadow AI and monitors LLM traffic in real time, exposing unauthorized or risky model use for security, compliance, and audit across enterprise systems.

ai-analytics ai-governance ai-observability 大语言模型 llm-monitoring llm-security

Python 1

21 天前