bentoml · GitHub Topics

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.35 k

6 天前

bentoml / Yatai

#计算机科学#Model Deployment at Scale on Kubernetes 🦄️

bentoml Kubernetes mlops model-deployment model-serving 机器学习

TypeScript 812

1 年前

aarnphm / whispercpp

Pybind11 bindings for Whisper.cpp

bazel Nix pybind11 Whisper whisper-cpp bentoml Python

C++ 332

6 个月前

Pythondeveloper6 / Awesome-MLOPS

All the available resources to master MLOPS from scratch

aws-sagemaker azure-ml dvc Git kubeflow mlflow zenml automl pycaret bentoml Docker FastAPI mlops gradio shape Streamlit Django

313

1 年前

bentoml / gallery

#计算机科学#BentoML Example Projects 🎨

机器学习 model-serving model-management model-deployment aws-sagemaker Serverless aws-lambda gcp-cloud-functions azure-machine-learning 数据科学 machine-learning-workflow gallery bentoml

Python 138

5 个月前

yuqwu / Replace-Anything

A simple web application that lets you replace any part of an image with an image generated based on your description.

人工智能 bentoml huggingface-diffusers inpainting Python segment-anything stable-diffusion

Python 116

2 年前

Nneji123 / Serving-Machine-Learning-Models

#计算机科学#This repository contains instructions, template source code and examples on how to serve/deploy machine learning models using various frameworks and applications such as Docker, Flask, FastAPI, BentoM...

Docker 机器学习 Actions bentoml CSS 部署 dvc FastAPI Flask Heroku heroku-deployment HTML kivymd mlflow mlops Streamlit Web app

CSS 53

2 年前

dtemir / fellowship-prediction

Analyzes your GitHub Profile and presents you with a report on how likely you are to become the next MLH Fellow!

bentoml Python Flask React Heroku Firebase

Jupyter Notebook 50

4 年前

ahmedbesbes / audiolizr

#自然语言处理#A bentoML-powered API to transcribe audio and make sense of it

bentoml openai openai-whisper transformers Docker 自然语言处理 speech-recognition t5 torch pytube

Python 39

2 年前

swiss-ai-center / a-guide-to-mlops

A simple yet complete guide to MLOps tools and practices - from a conventional way to a modern approach of working with ML projects.

best-practices 机器学习 mlops bentoml cml dvc

Dockerfile 31

4 个月前

kingabzpro / Deploying-Llama-3.3-70B

Serve Llama 3.3 70B (with AWQ quantization) using vLLM and deploy it on BentoCloud.

bentoml cloud FastAPI llama3-3 mlops vllm

Python 31

5 个月前

MemoonaTahira / MLZoomcamp2022

#计算机科学#My repo for the Machine Learning Engineering bootcamp 2022 by DataTalks.Club

bentoml 深度学习部署 Docker 机器学习 machine-learning-engineering Python aws-ec2 aws-fargate aws-lambda kserve Kubernetes tflite

Jupyter Notebook 21

2 年前

jerife / MLOps-on-kubernetes

#计算机科学#MLOps Implementing "Brain Computer Interface" on Kubernetes

机器学习 mlops model-serving signal-processing Google 云 google-kubernetes-engine bentoml gke Grafana kubeflow kubeflow-pipelines Kubernetes mlflow prometheus wandb weights-and-biases 深度学习

Python 13

3 年前

ttop32 / KoGPT2novel

#自然语言处理#Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어

gpt2 fastai bentoml transformer huggingface Docker finetune 部署 Web okteto 自然语言处理 korean PyTorch fine-tuning

Jupyter Notebook 12

3 年前

YeonwooSung / MLOps

#大语言模型#Miscellaneous codes and writings for MLOps

人工智能 Amazon Web Services 大语言模型 llm-inference llm-ops mlops multimodal bentoml triton-inference-server apache-iceberg Docker Kubernetes Apache Spark rag vector-database vectordb

Jupyter Notebook 12

13 天前

bentoml / diffusers-examples

API serving for your diffusers models

bentoml diffusers model-deployment model-serving

Python 11

1 年前

vaibhavsatpathy / psAI-clOps

End to End MLOps

mlops tensorflow2 bentoml mlflow neural-networks

Python 10

4 年前

getlegist / versailles

#计算机科学#🏛 ML Inference Pipeline for Legist

bentoml 机器学习 huggingface

Python 9

4 年前

dudeperf3ct / Model-Deployment

Deploying machine learning model using 10+ different deployment tools

mlops bentoml FastAPI Kubernetes serverless-framework kserve

Python 8

3 年前

cheat-tos / serving

DKT Project Served by Airflow / BentoML / Docker Swarm

airflow Docker dockerswarm bentoml

Python 8

4 年前