NPU Acceleration For Multimodal LLMs


Transformer-based models have rapidly spread from text to speech, vision, and other modalities. This has created challenges for the development of Neural Processing Units (NPUs). NPUs must now efficiently support the computation of weights and propagation of activations through a series of attention blocks. Increasingly, NPUs must be able to process models with multiple input modalities with ac... » read more

The Future Of AI For Games


Earlier this month, I had the pleasure of attending the inaugural AI and Games Conference at Goldsmiths in London, for which Arm was an associate sponsor. Hosted by Dr. Tommy Thompson, and borrowing its name from his AI and Games YouTube channel, the day really delivered on the promise of bringing experts and enthusiasts (and subscribers) together for interesting talks on the intersecti... » read more

Research Bits: Dec. 11


Photonic AI processor Researchers from Massachusetts Institute of Technology (MIT), Enosemi, and Periplous developed a fully integrated photonic processor that can perform all the key computations of a deep neural network optically on the chip. The chip is fabricated using commercial foundry processes and uses three layers of devices that perform linear and nonlinear operations. A particula... » read more

Automotive Design: How AI Is Transforming The Art Of Simulation


The automotive sector is about to experience a major wave of innovation as artificial intelligence (AI) is applied to design simulation, according to experts. The technology makes it possible to reduce the time needed to run the analyses for crash-test simulations — one of the most data-heavy exercises in automotive design — from several days to minutes. Read more here to learn about a p... » read more

Semiconductor Test Faces Technology Shifts In The AI Era


The surge in data-rich applications shows no signs of slowing down, fueling significant evolution within the global semiconductor industry. This insatiable demand for data necessitates a comprehensive ecosystem involving sensors and systems to capture data, networks to transmit it, and storage and processing power to analyze it. Successful deployment of these applications relies on the devel... » read more

AI Predictive Modeling Tools Move Into Critical Role To Leverage AI, ML


The semiconductor industry, as always, is at the forefront of transformational technological innovation, driving escalating complexity of manufacturing processes that extend time-to-market delivery, inflate research and development costs, and lead to expensive delays when problems arise. As manufacturers navigate these challenges, the need for comprehensive prediction of manufacturing proble... » read more

Redefining XPU Memory For AI Data Centers Through Custom HBM4: Part 2


This is the second in a three-part series from Alphawave Semi on HBM4 and gives insights into HBM implementation challenges. Click here for part 1, for an overview on HBM, and in part 3, we will introduce details of a custom HBM implementation. Implementing a 2.5D System-in-Package (SiP) with High Bandwidth Memory (HBM) is a complex process that spans across architecture definition, designi... » read more

Enhancing Compute Security Architecture For New-Age Applications


New-age AI-powered applications are becoming increasingly essential in our daily lives. Continuing to do so requires that these applications and services meet three primary challenges: Achieving high performance for complex compute tasks. Ensuring cost-effectiveness and seamless integration with existing infrastructure. Maintaining robust security and privacy measures. Historicall... » read more

The Future Of Technology: Generative AI In China


China's investment in Gen-AI is projected to surge with an estimated 86% CAGR over the next five years. This growth is driven by a focus on technological self-sufficiency, from applications to chips, and a strong emphasis on locally developed technology. Key areas of development include: AI Chip Development: Addressing the need for powerful AI infrastructure. Dataset Localization: S... » read more

Advancing AI At The IoT Edge


In a highly connected world, there is a need for more intelligent and secure computation locally and preferably on the very devices that capture data, whether it be raw or compressed video, images, or voice. End markets continue to expect compute costs to trend down, at a time when computation demands are increasing, as is evident from recently popularized AI paradigms such as large language mo... » read more

← Older posts Newer posts →