pytorch-labs / float8_experimental

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

A batched offline inference oriented version of segment-anything

#计算机科学#Puzzles for learning Triton

大模型Grok-1开源

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Garnet 是一个微软开源的高性能的缓存服务器，可兼容现有的Redis Client

#大语言模型#Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete...

PyTorch native quantization and sparsity for training and inference

DSPy: The framework for programming—not prompting—language models

Tactical RMM Agent

Videos Transcription and Translation with Faster Whisper and ChatGPT

EDM2 and Autoguidance -- Official PyTorch implementation

A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files

#自然语言处理#Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

一个微观交通仿真软件，用于模拟城市交通流动，支持道路车辆、公共交通、行人等多种交通方式

#IOS#Voice & Video Calling and Text Chat App for iOS

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.