fp8

#计算机科学#A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory ut...

#计算机科学#Microsoft Automatic Mixed Precision Library

An innovative library for efficient LLM inference via low-bit quantization

Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.

#大语言模型#JAX Scalify: end-to-end scaled arithmetics

Cog Single GPU Quantized Implementation of Step-Video-T2V

#计算机科学#A modular, accelerator‑ready ML framework that speaks float8/16/32/64, imports models via ONNX, and trains Transformer‑class networks entirely in Go.

FP8 dtypes enumeration in python