fp8

#计算机科学#A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory ut...

#计算机科学#Microsoft Automatic Mixed Precision Library

An innovative library for efficient LLM inference via low-bit quantization

Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x faster on consumer devices.

#大语言模型#JAX Scalify: end-to-end scaled arithmetics

Narrow precision floating point types

#计算机科学#A modular, accelerator-ready machine learning framework built in Go that speaks float8/16/32/64. Designed with clean architecture, strong typing, and native concurrency for scalable, production-ready ...

Cog Single GPU Quantized Implementation of Step-Video-T2V

Python implementations for multi-precision quantization in computer vision and sensor fusion workloads, targeting the XR-NPE Mixed-Precision SIMD Neural Processing Engine. The code includes visual ine...

FP8 dtypes enumeration in python

Bulk Flux1 Dev FP8 ComfyUI image generator from CSV prompts