AI is seen as a massive computation problem, but that is not the case, at least with the way that the problem is structured today. It is a data movement problem. This not only limits performance but represents most of the energy consumption.
In addition, the industry spends most of its time and effort making small improvements that optimize aspects of the existing architecture, when what is ...
» read more