heterogeneous-cluster · GitHub Topics

#大语言模型#Simple, scalable AI model deployment on GPU clusters

ascend CUDA deepseek distributed-inference genai inference llama llamacpp 大语言模型 maas metal openai qwen rocm vllm mindie llm-inference llm-serving local-ai heterogeneous-cluster

Python 3.7 k

4 天前

Fahadfk / AI_deployment

#大语言模型#Comprehensive guide to FastAPI, Pydantic, and SQLAlchemy for AI engineers. Learn API design, validation, and ORM workflows with practical examples and setup 🐙

ai-agent ChatGPT creative generative-ai heterogeneous-cluster hpc huggingface llama3 大语言模型 llm-inference local-ai maas 机器学习 metal openai Python rag

6 天前