model-inference · GitHub Topics

#大语言模型#Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

大语言模型 llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops mistral mlops llama3-1

Python 11.35 k

6 天前

wangxb96 / Awesome-EdgeAI

#Awesome#Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"

data-preprocessing edge-ai edge-computing 机器学习 model-compression model-inference Awesome Lists 深度学习 model-deployment

5 个月前

bentoml / CLIP-API-service

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

ai-applications clip cloud-native mlops model-inference model-serving

Jupyter Notebook 65

1 年前

wangxb96 / Awesome-EdgeAI

#Awesome#Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"

data-preprocessing edge-ai edge-computing 机器学习 model-compression model-inference Awesome Lists 深度学习 model-deployment

5 个月前

array2d / deepx

Large-scale Auto-Distributed Training/Inference Unified Framework | Memory-Compute-Control Decoupled Architecture | Multi-language SDK & Heterogeneous Hardware Support

distributed-training high-performance-computing model-inference model-serving

C++ 51

14 天前

EmbeddedLLM / embeddedllm

#大语言模型#EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU

大语言模型 llm-inference directml directx-12 gemma llama mistral llm-serving model-inference npu Windows cpu openvino

Python 39

8 个月前

DAVIDNYARKO123 / edge-tpu-silva

#计算机科学#Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on an Edge TPU USB.

edge-computing first-person-shooter 机器学习 model-inference object-detection 树莓派

Python 29

1 年前

kdeps / kdeps

#大语言模型#Build AI Agents that runs free forever. Kdeps is an all-in-one AI framework for building purpose-built Dockerized full-stack AI applications (FE and BE) that includes open-source LLM models out-of-the...

API 人工智能 dockerized huggingface 大语言模型 multimodal Open Source Nvidia CUDA Docker llama mistral fine-tuning mlops model-inference llmops agents ai-agents llm-agent mcp

Go 22

4 天前

hegongshan / Storage-for-AI-Paper

#计算机科学#Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)

深度学习 mlsys PyTorch Tensorflow checkpoint data-preprocessing data-loading data-preparation dataloader model-inference model-training

5 天前

Koldim2001 / Image_captioning

#自然语言处理#Генерация описаний к изображениям с помощью различных архитектур нейронных сетей

attention-mechanism 机器视觉 image-captioning lstm model-deployment model-inference 自然语言处理 Streamlit Website word-embeddings

Jupyter Notebook 18

2 年前

brian-kipkoech-tanui / sagemaker-ML-workflow

Image Classifiers are used in the field of computer vision to identify the content of an image and it is used across a broad variety of industries, from advanced technologies like autonomous vehicles ...

Amazon Web Services aws-ec2 aws-lambda aws-s3 endpoint image-classification JSON model-inference Python sagemaker

HTML 4

2 年前

ChaitanyaC22 / Udacity-AWS-MLE-ND-Project2-Build-a-ML-Workflow-For-Scones-Unlimited-On-Amazon-SageMaker

The primary objective of this project was to build and deploy an image classification model for Scones Unlimited, a scone-delivery-focused logistic company, using AWS SageMaker.

Amazon Web Services aws-ec2 aws-iam aws-lambda aws-s3 aws-sagemaker 部署 endpoint image-classification lambda-functions model-inference Python JSON

HTML 4

2 年前

debajitadhikary / EmoVision

#计算机科学#😊📸 Real-Time Facial Emotion Recognition using Deep Learning 🤖🧠

人工智能 cnn 机器视觉 cudnn 深度学习 emotion-detection emotion-recognition facial-expression-recognition Git gpu-computing 机器学习 model-inference Nvidia OpenCV real-time Tensorflow neural-networks

Python 4

2 个月前

SayamAlt / Cyberbullying-Classification-using-fine-tuned-DistilBERT

#自然语言处理#Successfully fine-tuned a pretrained DistilBERT transformer model that can classify social media text data into one of 4 cyberbullying labels i.e. ethnicity/race, gender/sexual, religion and not cyber...

data-exploration exploratory-data-analysis 大语言模型 model-inference 自然语言处理 text-classification text-preprocessing

Jupyter Notebook 1

1 年前

SayamAlt / Symptoms-Disease-Text-Classification

#自然语言处理#Successfully developed a fine-tuned BERT transformer model which can accurately classify symptoms to their corresponding diseases upto an accuracy of 89%.

exploratory-data-analysis model-inference 自然语言处理 text-classification text-preprocessing

Jupyter Notebook 1

1 年前

kwame-mintah / gcp-cloud-run-function-model-inference

A cloud run function to invoke a prediction against a machine learning model that has been trained outside of a cloud provider.

cloud-functions Google 云 model-inference FastAPI

Python 1

5 个月前

SayamAlt / Financial-News-Sentiment-Analysis

#自然语言处理#Successfully developed a fine-tuned DistilBERT transformer model which can accurately predict the overall sentiment of a piece of financial news up to an accuracy of nearly 81.5%.

model-inference 自然语言处理 sentiment-analysis text-preprocessing

Jupyter Notebook 1

1 年前

AlvinHon / distributed-model-inference

Example distributed system for ML model inference by using Kafka, including spring boot REST+JPA server with Java consumer program

jpa kafka model-inference Spring Boot

Java 1

9 个月前

itancio / churn

#计算机科学#

机器学习 model-inference Python Streamlit

Python 1

8 个月前

thehrsr / CAR-DAMAGE-DETECTION

#计算机科学#This project is a web-based application that uses a pre-trained Mask R-CNN model to detect and classify car damage types (scratch, dent, shatter, dislocation) from images. Users can upload an image of...

人工智能机器视觉深度学习 Flask 图像处理 image-segmentation 机器学习 mask-rcnn model-inference object-detection Python Tensorflow Web app

Jupyter Notebook 1

10 个月前