model-monitoring · GitHub Topics

DataTalksClub / mlops-zoomcamp

#计算机科学#Free MLOps course from DataTalks.Club

机器学习 mlops model-deployment model-monitoring workflow-orchestration

Jupyter Notebook 13.1 k

1 个月前

evidentlyai / evidently

#大语言模型#Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

data-drift Jupyter Notebook pandas-dataframe 机器学习 model-monitoring html-report mlops 数据科学 Hacktoberfest data-quality data-validation generative-ai 大语言模型 llmops

Jupyter Notebook 6.45 k

20 小时前

traceloop / openllmetry

#大语言模型#Open-source observability for your LLM application, based on OpenTelemetry

llmops observability OpenTelemetry 监控 datascience 机器学习 model-monitoring opentelemetry-python Python good-first-issue help-wanted artifical-intelligence generative-ai 大语言模型 Open Source

Python 6.15 k

1 天前

deepchecks / deepchecks

#计算机科学#Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and model...

机器学习 model-validation data-validation mlops 数据科学 Python Jupyter Notebook model-monitoring data-drift html-report 深度学习 PyTorch pandas-dataframe

Python 3.86 k

2 个月前

NannyML / nannyml

#计算机科学#nannyml: post-deployment data science in python

机器学习 mlops performance-monitoring 数据科学监控 Python data-drift model-monitoring 数据分析可视化深度学习 Jupyter Notebook

Python 2.09 k

19 天前

traceloop / openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

datascience llmops 监控机器学习 model-monitoring observability OpenTelemetry opentelemetry-javascript TypeScript JavaScript generative-ai Next Open Source

TypeScript 344

3 天前

MAIF / eurybia

#计算机科学#⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

Python data-validation drift html-report 机器学习 data-drift model-monitoring production-machine-learning

Jupyter Notebook 212

9 个月前

squaredev-io / whitebox

#计算机科学#[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes

机器学习监控 observability Python explainability explainable-ai ml-monitoring mlflow mlops accuracy confusion-matrix recall model-monitoring Kubernetes xai

Python 183

2 年前

traceloop / hub

#大语言模型#High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

人工智能 datascience generative-ai 大语言模型 llmops 机器学习 model-monitoring observability Open Source OpenTelemetry Rust

Rust 116

15 天前

aws-samples / amazon-sagemaker-mlops-workshop

#计算机科学#MLOps workshop with Amazon SageMaker

sagemaker tensorflow2 机器学习 model-monitoring amazon-sagemaker

Jupyter Notebook 105

4 个月前

evidentlyai / ml_observability_course

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

data-drift data-quality data-quality-checks llmops machine-learning-operations ml-monitoring ml-observability ml-pipelines mlops model-monitoring production-machine-learning

Jupyter Notebook 92

2 年前

NimbleBoxAI / nbox

#计算机科学#The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸

数据科学机器学习 ml-infrastructure ml-platform mlops model-deployment model-management model-monitoring model-serving

Python 87

2 年前

VectorInstitute / cyclops

#计算机科学#A toolkit for evaluating and monitoring AI models in clinical settings

clinical-data healthcare model-monitoring data-drift 机器学习深度学习 evaluation clinical-research electronic-health-record electronic-medical-record

Python 85

2 天前

awesome-mlops / awesome-ml-monitoring

#计算机科学#A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀

mlops aiops DataOps datascience 机器学习 concept-drift data-cleaning data-drift data-management data-monitoring data-quality 数据科学深度学习 model-explainability model-management model-monitoring

1 年前

aporia-ai / inferencedb

#计算机科学#🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)

机器学习 model-serving kafka s3 model-monitoring mlops

Python 81

3 年前

rstudio / vetiver-python

Version, share, deploy, and monitor models.

mlops model-monitoring model-versioning Python

Python 68

4 个月前

Arize-ai / client_python

A python library to send data to Arize AI!

ml-monitoring model-monitoring ai-monitoring performance-monitoring data-quality-monitoring ml-observability ai-observability model-explainability ai-roi

Python 56

20 小时前

jomariya23156 / full-stack-on-prem-cv-mlops

#计算机科学#"1 config, 1 command from Jupyter Notebook to serve Millions of users", Full-stack On-Premises MLOps system for Computer Vision from Data versioning to Model monitoring and drift detection.