llm-ops · GitHub Topics

Kong 是一个云原生API 网关，提供反向代理、路由、负载平衡、健康检查、身份验证等功能

API nginx luajit 微服务 api-management Serverless apis reverse-proxy cloud-native DevOps Kubernetes kubernetes-ingress-controller kubernetes-ingress 人工智能 ai-gateway llm-gateway openai-proxy llm-ops

Lua 41.42 k

7 天前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.63 k

2 天前

julep-ai / julep

#大语言模型#Deploy serverless AI workflows at scale. Firebase for AI agents

agents ai-agents ai-agents-framework ai-memory ai-platform 人工智能 developer-tools 大语言模型 llm-ops Python aiagents

Python 5.63 k

1 天前

truefoundry / cognita

#大语言模型#RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

人工智能深度学习 generative-ai llmops 机器学习 mlops model-deployment Python rag retrieval-augmented-generation TypeScript agent application data fine-tuning 框架大语言模型 llm-ops

Python 4.17 k

5 个月前

Marker-Inc-Korea / AutoRAG

#大语言模型#AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

analysis automl benchmarking document-parser embeddings evaluation 大语言模型 llm-evaluation llm-ops Open Source ops optimization pipeline Python qa rag rag-evaluation retrieval-augmented-generation

Python 4.15 k

1 个月前

lastmile-ai / aiconfig

#大语言模型#AIConfig is a config-based framework to build generative AI applications.

人工智能 developer-tools generative-ai 大语言模型 llm-ops

Python 1.04 k

1 年前

EmbeddedLLM / JamAIBase

#大语言模型#The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on...

agents 人工智能 ai-agents-framework baas 聊天机器人 lancedb 大语言模型 llm-ops Python Serverless backend-as-a-service ChatGPT orchestration rag retrieval-augmented-generation workflow Svelte Spreadsheet llama3-1

Python 1.03 k

2 个月前

athina-ai / athina-evals

Python SDK for running evaluations on LLM generated responses

evaluation evaluation-framework evaluation-metrics llm-eval llm-evaluation llm-ops llmops

Python 289

2 个月前

astronomer / ask-astro

#大语言模型#An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

airflow 大语言模型 llm-ops

Python 254

16 天前

chatchat-space / LangGraph-Chatchat

#大语言模型#

agent agents FastAPI langchain langchain-python langgraph 大语言模型 llm-ops

Python 133

5 个月前

friendliai / friendli-client

#大语言模型#[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

generative-ai 大语言模型 llm-inference llmops serving gpt gpt3 inference llama2 llm-serving inference-engine inference-server 人工智能 llm-ops mistral 机器学习 mlops stable-diffusion

Python 48

1 个月前

Trainy-ai / konduktor

#大语言模型#cluster/scheduler health monitoring for GPU jobs on k8s

人工智能深度学习 gpu gpu-monitoring job-scheduler Kubernetes k8s-cluster 大语言模型 llm-ops 机器学习 ml-infrastructure ml-platform resource-management health-check metrics-gathering observability

JavaScript 47

6 个月前

YeonwooSung / MLOps

#大语言模型#Miscellaneous codes and writings for MLOps

人工智能 Amazon Web Services 大语言模型 llm-inference llm-ops mlops multimodal bentoml triton-inference-server apache-iceberg Docker Kubernetes Apache Spark rag vector-database vectordb

Jupyter Notebook 13

4 天前

langgenius / dify-conversation

[🚧🚧🚧WIP🚧🚧 🚧]Rework of webapp-conversation

llm-ops

TypeScript 8

2 年前

AndrMoura / streamlit-chatbot-analytics

#大语言模型#Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

analytics 聊天机器人 chatbot-application chatbots langchain llama3 大语言模型 llm-ops ollama Streamlit llm-observability

Python 7

1 年前

prompt-foundry / typescript-sdk

#大语言模型#The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

prompt-engineering prompt-management prompt-testing TypeScript llm-eval llm-evaluation open-ai gpt gpt-3 gpt-4 大语言模型 llm-ops llmops

TypeScript 6

1 年前

GlyphyAI / liteswarm

#大语言模型#Lightweight Agent Framework for building AI apps with any LLM

ai-agents 大语言模型 llm-ops multi-agent multi-agent-systems

Python 5

6 个月前

matdev83 / llm-accounting

A Python package for tracking and analyzing LLM usage across different models and applications. It is primarily designed as a library for integration into development process of LLM-based agentic work...

agentic-ai agentic-ai-development agentic-workflow 大语言模型 mlops llm-observability llm-ops

Python 4

24 天前