llm-ops · GitHub Topics

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.35 k

6 天前

julep-ai / julep

#大语言模型#Deploy serverless AI workflows at scale. Firebase for AI agents

agents ai-agents ai-agents-framework ai-memory ai-platform 人工智能 developer-tools 大语言模型 llm-ops Python aiagents

Python 5.55 k

2 天前

truefoundry / cognita

#大语言模型#RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

人工智能深度学习 generative-ai llmops 机器学习 mlops model-deployment Python rag retrieval-augmented-generation TypeScript agent application data fine-tuning 框架大语言模型 llm-ops

Python 4.1 k

4 个月前

Marker-Inc-Korea / AutoRAG

#大语言模型#AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

analysis automl benchmarking document-parser embeddings evaluation 大语言模型 llm-evaluation llm-ops Open Source ops optimization pipeline Python qa rag rag-evaluation retrieval-augmented-generation

Python 4.03 k

1 个月前

lastmile-ai / aiconfig

#大语言模型#AIConfig is a config-based framework to build generative AI applications.

人工智能 developer-tools generative-ai 大语言模型 llm-ops

Python 1.03 k

1 年前

EmbeddedLLM / JamAIBase

#大语言模型#The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on...

agents 人工智能 ai-agents-framework baas 聊天机器人 lancedb 大语言模型 llm-ops Python Serverless backend-as-a-service ChatGPT orchestration rag retrieval-augmented-generation workflow Svelte Spreadsheet llama3-1

Python 1.02 k

17 天前

athina-ai / athina-evals

Python SDK for running evaluations on LLM generated responses

evaluation evaluation-framework evaluation-metrics llm-eval llm-evaluation llm-ops llmops

Python 281

9 天前

astronomer / ask-astro

#大语言模型#An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

airflow 大语言模型 llm-ops

Python 227

3 个月前

chatchat-space / LangGraph-Chatchat

#大语言模型#

agent agents FastAPI langchain langchain-python langgraph 大语言模型 llm-ops

Python 121

3 个月前

friendliai / friendli-client

#大语言模型#Friendli: the fastest serving engine for generative AI

generative-ai 大语言模型 llm-inference llmops serving gpt gpt3 inference llama2 llm-serving inference-engine inference-server 人工智能 llm-ops mistral 机器学习 mlops stable-diffusion

Python 47

5 个月前

Trainy-ai / konduktor

#大语言模型#cluster/scheduler health monitoring for GPU jobs on k8s

人工智能深度学习 gpu gpu-monitoring job-scheduler Kubernetes k8s-cluster 大语言模型 llm-ops 机器学习 ml-infrastructure ml-platform resource-management health-check metrics-gathering observability

JavaScript 47

5 个月前

YeonwooSung / MLOps

#大语言模型#Miscellaneous codes and writings for MLOps

人工智能 Amazon Web Services 大语言模型 llm-inference llm-ops mlops multimodal bentoml triton-inference-server apache-iceberg Docker Kubernetes Apache Spark rag vector-database vectordb

Jupyter Notebook 12

13 天前

langgenius / dify-conversation

[🚧🚧🚧WIP🚧🚧 🚧]Rework of webapp-conversation

llm-ops

TypeScript 8

2 年前

AndrMoura / streamlit-chatbot-analytics

#大语言模型#Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

analytics 聊天机器人 chatbot-application chatbots langchain llama3 大语言模型 llm-ops ollama Streamlit llm-observability

Python 6

1 年前

prompt-foundry / typescript-sdk

#大语言模型#The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

prompt-engineering prompt-management prompt-testing TypeScript llm-eval llm-evaluation open-ai gpt gpt-3 gpt-4 大语言模型 llm-ops llmops

TypeScript 6

9 个月前

GlyphyAI / liteswarm

#大语言模型#Lightweight Agent Framework for building AI apps with any LLM

ai-agents 大语言模型 llm-ops multi-agent multi-agent-systems

Python 5

5 个月前

tied-inc / eval-track

#大语言模型#LLM-ML-Observability Toolkits and Serivces

大语言模型 llm-ops 机器学习 observability

TypeScript 2

5 个月前

flavienbwk / repochat-action

#大语言模型#Deploy an AI-powered chatbot for your repo in under 2 minutes.

聊天机器人 DevOps Actions 大语言模型 ai-ops llm-ops

JavaScript 2

9 个月前

matdev83 / llm-accounting

A Python package for tracking and analyzing LLM usage across different models and applications. It is primarily designed as a library for integration into development process of LLM-based agentic work...

agentic-ai agentic-ai-development agentic-workflow 大语言模型 mlops llm-observability llm-ops

Python 2

5 天前

willwoodward / woodwork-engine

#大语言模型#An AI Agent IaC tool that aims to make developing and deploying AI Agents easier.

人工智能 ai-agent ai-agent-framework ai-ops 大语言模型 llm-ops mlops Python python-package

Python 1

5 天前