AI/ML training traditionally has been performed using floating point data formats, primarily because that is what was available. But this usually isn't a viable option for inference on the edge, where more compact data formats are needed to reduce area and power.
Compact data formats use less space, which is important in edge devices, but the bigger concern is the power needed to move around...
» read more
