llm-evaluation-metrics · GitHub Topics

The LLM Evaluation Framework

evaluation-metrics evaluation-framework llm-evaluation llm-evaluation-framework llm-evaluation-metrics

Python 8.01 k

3 天前

The one-stop repository for large language model (LLM) unlearning. Supports TOFU, MUSE, WMDP, and many unlearning methods. All features: benchmarks, methods, evaluations, models etc. are easily extens...

privacy-protection benchmarks llm-evaluation-metrics 大语言模型 Open Source

Python 287

24 天前

cvs-health / langfair

#大语言模型#LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

人工智能 bias bias-detection fairness fairness-ai fairness-ml fairness-testing large-language-models 大语言模型 responsible-ai Python ai-safety llm-evaluation llm-evaluation-framework llm-evaluation-metrics

Python 215

4 天前

zhuohaoyu / KIEval

#大语言模型#[ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

explainable-ai 大语言模型 llm-evaluation llm-evaluation-framework llm-evaluation-metrics 机器学习

Python 36

1 年前

pyladiesams / eval-llm-based-apps-jan2025

#大语言模型#Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

大语言模型 llmops workshop llm-eval llm-evaluation-framework llm-evaluation-metrics llm-monitoring

Jupyter Notebook 7

1 个月前

attogram / ollama-multirun

A bash shell script to run a single prompt against any or all of your locally installed ollama models, saving the output and performance statistics as easily navigable web pages.

人工智能 ollama llm-evaluation ollama-interface Bash ollama-app llm-evaluation-metrics llm-eval static-site-generator

Shell 6

1 天前

ronniross / llm-confidence-scorer

#数据仓库#A set of auxiliary systems designed to provide a measure of estimated confidence for the outputs generated by Large Language Models.

大语言模型 llm-evaluation llm-evaluation-framework llm-evaluation-metrics llm-training dataset 数据集

Python 2

21 天前

ritwickbhargav80 / quick-llm-model-evaluations

This repo is for an streamlit application that provides a user-friendly interface for evaluating large language models (LLMs) using the beyondllm package.

llm-evaluation-metrics 大语言模型 retrieval-augmented-generation Streamlit

Python 0

10 个月前

nhsengland / evalsense

#大语言模型#Tools for systematic large language model evaluations

llm-evaluation llm-evaluation-metrics 大语言模型 evaluation-framework evaluation-metrics llm-evaluation-framework

Python 0

23 天前