#自然语言处理#LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Python 3.3 k
5 天前
https://wavespeed.ai/ Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
Python 1.27 k
3 个月前
#计算机科学#A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
Python 550
5 天前
Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.
Python 134
5 天前
Learn and experiment with new techniques and programming languages with a focus on ML
Jupyter Notebook 7
9 个月前