Memory For AI At The Edge

Why new LPDDR releases make them the memories of choice for many applications.

popularity

Inferencing at the edge has very different needs than training large language models or large-scale inferencing in AI data centers. Many edge devices run on a battery. They’re price-sensitive, and they are constrained by the physical area of the device. As a result, the amount of memory that can be packed into these devices is also limited. Steve Woo, Rambus fellow and distinguished inventor, talks about different DRAM options, why the latest LPDDR versions are garnering so much attention on the edge, how they compare with other types of DRAM, and how it can be packaged to provide more capacity.



Leave a Reply


(Note: This name will be displayed publicly)