Arm, Intel, and Nvidia proposed a specification for an 8-bit floating point (FP8) format that could provide a common interchangeable format that works for both AI training and inference and allow AI models to operate and perform consistently across hardware platforms.
Find the technical paper titled " FP8 Formats For Deep Learning" here. Published Sept 2022.
Abstract:
"FP8 is a natural p...
» read more
