mlops · GitHub Topics

#大语言模型#vLLM 是一个高效的开源库，用于加速大语言模型推理，通过优化内存管理和分布式处理实现高吞吐量和低延迟。

gpt 大语言模型 PyTorch llmops mlops model-serving transformer llm-serving inference llama amd rocm CUDA inferentia trainium tpu xpu hpu deepseek qwen

Python 53.57 k

1 小时前

GokuMohandas / Made-With-ML

#自然语言处理#学习如何设计、开发、部署、和迭代生产级机器学习应用

机器学习深度学习 PyTorch 自然语言处理数据科学 Python mlops data-engineering data-quality 大语言模型 ray distributed-training

Jupyter Notebook 41.41 k

1 年前

apache / airflow

#计算机科学#Apache Airflow 是一个workflow工作流调度、编排、监控平台

Python 41.3 k

3 小时前

qdrant / qdrant

#搜索#高性能、可扩展的向量搜索引擎

神经网络搜索引擎 knn-algorithm hnsw vector-search nearest-neighbor-search image-search embeddings-similarity recommender-system vector-search-engine mlops search-engines neural-search similarity-search vector-database 机器学习 search ai-search ai-search-engine

Rust 25 k

2 小时前

HumanSignal / label-studio

#数据仓库#Label Studio 是一个用于机器学习模型训练的数据标注工具，支持标注图像、音频、文本、视频等多种类型。

JavaScript 23.97 k

31 分钟前

jina-ai / serve

#计算机科学#Jina 是一个基于深度学习的搜索框架，支持各种类型如图片，视频，长文本，PDF等。

neural-search cloud-native 深度学习机器学习框架 gRPC Kubernetes multimodal mlops pipeline FastAPI generative-ai Docker jaeger llmops OpenTelemetry cncf 微服务 orchestration prometheus

Python 21.68 k

4 个月前

mlflow / mlflow

#计算机科学#MLflow 是一个开源框架，旨在管理整个机器学习生命周期。它可以在不同的平台上训练模型并为模型提供服务，让你能够使用相同的一组工具，而不管试验是在计算机本地、远程计算目标上、虚拟机上

机器学习人工智能 mlflow Apache Spark model-management agentops agents evaluation langchain llm-evaluation llmops observability Open Source openai prompt-engineering mlops

Python 21.39 k

4 小时前

EthicalML / awesome-production-machine-learning

#Awesome#A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

机器学习 mlops interpretability explainability responsible-ai 深度学习 machine-learning-operations ml-ops ml-operations privacy-preserving privacy-preserving-machine-learning data-mining production-machine-learning Awesome Lists

18.87 k

22 天前

Avaiga / taipy

Turns Data and AI algorithms into production-ready web applications in no time.

Python 18.42 k

6 小时前

argoproj / argo-workflows

#计算机科学#Kubernetes 工作流引擎

workflow Kubernetes Argo dag knative airflow 机器学习 argo-workflows workflow-engine Hacktoberfest cloud-native cncf GitOps mlops batch-processing data-engineering pipelines

Go 15.87 k

1 天前

stas00 / ml-engineering

#大语言模型#Machine Learning Engineering Open Book

PyTorch slurm large-language-models 大语言模型机器学习 scalability transformers machine-learning-engineering mlops 人工智能 inference training

Python 14.59 k

1 天前

microsoft / nni

#计算机科学#An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

automl 深度学习 neural-architecture-search hyperparameter-optimization distributed bayesian-optimization automated-machine-learning 机器学习数据科学 Tensorflow PyTorch 神经网络深度神经网络 model-compression feature-engineering nas Python hyperparameter-tuning mlops

Python 14.24 k

1 年前

weaviate / weaviate

#搜索#Weaviate 是一个开源矢量数据库，它同时存储对象和矢量，允许将矢量搜索与结构化过滤与云原生数据库的容错和可扩展性相结合，所有这些都可以通过 GraphQL、REST 和各种语言客户端访问。

Go 14.05 k

3 小时前

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.

data-pipelines dagster workflow 数据科学 workflow-automation Python scheduler data-orchestrator etl analytics data-engineering mlops orchestration data-integration metadata

Python 13.67 k

14 小时前

visenger / awesome-mlops

#计算机科学#A curated list of references for MLOps

机器学习 mlops 数据科学 engineering federated-learning DevOps 软件工程人工智能

13.24 k

8 个月前

DataTalksClub / mlops-zoomcamp

#计算机科学#Free MLOps course from DataTalks.Club

机器学习 mlops model-deployment model-monitoring workflow-orchestration

Jupyter Notebook 13.1 k

1 个月前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.62 k

1 天前

aws / amazon-sagemaker-examples

#计算机科学#Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

sagemaker Amazon Web Services reinforcement-learning 机器学习深度学习 Example Jupyter Notebook mlops 数据科学 training inference

Jupyter Notebook 10.62 k

8 天前

great-expectations / great_expectations

Always know what to expect from your data.

Python 10.61 k

5 小时前

kedro-org / kedro

#计算机科学#Kedro 是一个用于构建可重现、可维护和模块化的数据科学代码的Python框架。它借鉴了软件工程的理念并将其应用于机器学习

pipeline kedro Hacktoberfest mlops experiment-tracking Python 机器学习 machine-learning-engineering

Python 10.47 k

1 天前