mlops · GitHub Topics

#大语言模型#A high-throughput and memory-efficient inference and serving engine for LLMs

gpt 大语言模型 PyTorch llmops mlops model-serving transformer llm-serving inference llama amd rocm CUDA inferentia trainium tpu xpu hpu deepseek qwen

Python 49.62 k

15 小时前

apache / airflow

#计算机科学#Apache Airflow 是一个workflow工作流调度、编排、监控平台

Python 40.56 k

3 小时前

GokuMohandas / Made-With-ML

#自然语言处理#学习如何设计、开发、部署、和迭代生产级机器学习应用

机器学习深度学习 PyTorch 自然语言处理数据科学 Python mlops data-engineering data-quality 大语言模型 ray distributed-training

Jupyter Notebook 38.91 k

10 个月前

qdrant / qdrant

#搜索#高性能、可扩展的向量搜索引擎

神经网络搜索引擎 knn-algorithm hnsw vector-search nearest-neighbor-search image-search embeddings-similarity recommender-system vector-search-engine mlops search-engines neural-search similarity-search vector-database 机器学习 search ai-search ai-search-engine

Rust 24.15 k

18 小时前

HumanSignal / label-studio

#数据仓库#Label Studio is a multi-type data labeling and annotation tool with standardized output format

JavaScript 22.52 k

19 小时前

jina-ai / serve

#计算机科学#Jina 是一个基于深度学习的搜索框架，支持各种类型如图片，视频，长文本，PDF等。

neural-search cloud-native 深度学习机器学习框架 gRPC Kubernetes multimodal mlops pipeline FastAPI generative-ai Docker jaeger llmops OpenTelemetry cncf 微服务 orchestration prometheus

Python 21.61 k

3 个月前

EthicalML / awesome-production-machine-learning

#Awesome#A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

机器学习 mlops interpretability explainability responsible-ai 深度学习 machine-learning-operations ml-ops ml-operations privacy-preserving privacy-preserving-machine-learning data-mining production-machine-learning Awesome Lists

18.6 k

15 天前

Avaiga / taipy

Turns Data and AI algorithms into production-ready web applications in no time.

Python 18.12 k

2 天前

argoproj / argo-workflows

#计算机科学#Kubernetes 工作流引擎

workflow Kubernetes Argo dag knative airflow 机器学习 argo-workflows workflow-engine Hacktoberfest cloud-native cncf GitOps mlops batch-processing data-engineering pipelines

Go 15.72 k

2 天前

microsoft / nni

#计算机科学#An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

automl 深度学习 neural-architecture-search hyperparameter-optimization distributed bayesian-optimization automated-machine-learning 机器学习数据科学 Tensorflow PyTorch 神经网络深度神经网络 model-compression feature-engineering nas Python hyperparameter-tuning mlops

Python 14.21 k

1 年前

stas00 / ml-engineering

#大语言模型#Machine Learning Engineering Open Book

PyTorch slurm large-language-models 大语言模型机器学习 scalability transformers machine-learning-engineering mlops 人工智能 inference training

Python 14.03 k

6 天前

weaviate / weaviate

#搜索#Weaviate 是一个开源矢量数据库，它同时存储对象和矢量，允许将矢量搜索与结构化过滤与云原生数据库的容错和可扩展性相结合，所有这些都可以通过 GraphQL、REST 和各种语言客户端访问。

Go 13.64 k

6 小时前

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.

data-pipelines dagster workflow 数据科学 workflow-automation Python scheduler data-orchestrator etl analytics data-engineering mlops orchestration data-integration metadata

Python 13.38 k

2 天前

visenger / awesome-mlops

#计算机科学#A curated list of references for MLOps

机器学习 mlops 数据科学 engineering federated-learning DevOps 软件工程人工智能

13.16 k

7 个月前

DataTalksClub / mlops-zoomcamp

#计算机科学#Free MLOps course from DataTalks.Club

机器学习 mlops model-deployment model-monitoring workflow-orchestration

Jupyter Notebook 12.76 k

6 天前

bentoml / OpenLLM

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.35 k

6 天前

aws / amazon-sagemaker-examples

#计算机科学#Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

sagemaker Amazon Web Services reinforcement-learning 机器学习深度学习 Example Jupyter Notebook mlops 数据科学 training inference

Jupyter Notebook 10.55 k

3 个月前

great-expectations / great_expectations

Always know what to expect from your data.

pipeline-tests dataquality datacleaning datacleaner 数据科学 data-profiling pipeline pipeline-testing cleandata dataunittest eda exploratory-data-analysis data-quality data-engineering mlops

Python 10.48 k

2 天前

kedro-org / kedro

#计算机科学#Kedro 是一个用于构建可重现、可维护和模块化的数据科学代码的Python框架。它借鉴了软件工程的理念并将其应用于机器学习

pipeline kedro Hacktoberfest mlops experiment-tracking Python 机器学习 machine-learning-engineering

Python 10.39 k

2 天前

wandb / wandb

#计算机科学#The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

机器学习 experiment-track 深度学习 Keras Tensorflow PyTorch hyperparameter-search reinforcement-learning mlops 数据科学 collaboration hyperparameter-optimization reproducibility hyperparameter-tuning data-versioning model-versioning ml-platform jax 人工智能

Python 9.98 k

1 天前