LLMs On The Edge


Nearly all the data input for AI so far has been text, but that's about to change. In the future, that input likely will include video, voice, as well as other types of data, causing a massive increase in the amount of data that needs to be modeled and the compute resources necessary to make it all work. This is hard enough in hyperscale data centers, which are sprouting up everywhere to handle... » read more

Mobile Chip Challenges In The AI Era


Leading smart phone vendors are struggling to keep pace with the rising compute and power demands of localized generative AI, standard phone functions, and the need to move more data back and forth between handsets and the cloud. In addition to edge functions, such as facial recognition and other on-device apps, phones must accommodate a continuous stream of new communications protocols, and... » read more

A New Era Of Edge AI: E-Series GPU IP


Welcome to the Age of Parallel Compute The age of parallel compute has arrived. The emergence of artificial intelligence is having profound implications on hardware development in every single market. Data centres are being built with massive compute resources to handle the demands of training and connected inference. At the edge, embedded hardware system designers are dealing with the chal... » read more

eMMC: The Embedded Storage Powering On-Device AI


In today's world of increasingly intelligent devices, efficient and reliable storage is paramount. Embedded MultiMediaCard (eMMC) has emerged as a crucial component that acts as the internal solid-state non-volatile storage for a wide range of devices handling on-device AI processing. Think of it as a compact, high-performing internal drive built directly into your phone, smart camera, or other... » read more

AI Native: What Does It Mean For Embedded Processing?


Artificial intelligence (AI) continues transforming how users interact with technology. AI-powered chatbots like ChatGPT, along with advancements in data analytics and mobile technology, have contributed to high expectations among tech users. Consumers want and expect faster, more personalized, and smarter experiences — whether they're controlling a smart home device or speaking to a chatbot ... » read more

Transforming Industrial IoT With Edge AI And AR


The Internet of Things (IoT) has evolved significantly from its early days of centralized cloud processing. Initially, IoT applications relied heavily on cloud-based data processing, where data from various devices was collected, processed, and analyzed in the cloud before insights were sent back to the devices. While effective, this approach has limitations, particularly in environments requir... » read more

STCO for Dense Edge Architectures using 3D Integration and NVM (imec,, et al.)


A new technical paper titled "System-Technology Co-Optimization for Dense Edge Architectures using 3D Integration and Non-Volatile Memory" was published by researchers at imec, INESC-ID, Université Libre de Bruxelles, et al. "In this paper, we present an system-technology co-optimization (STCO) framework that interfaces with workload-driven system scaling challenges and physical design-enab... » read more

Paving The Way For Sustainable AI


Real-time requirements and the need for power-efficiency, security and privacy drives AI-processing at the edge. Key benefits of Edge AI include: -Low latency and real-time response -High power efficiency -Improved security and data privacy -Reduced cost A complementary set of AI-specific products and solutions, an end-to-end ML platform as well as an extensive application kno... » read more

Insights From The AI Hardware & Edge AI Summit


By Ashish Darbari, Fabiana Muto, and Nicky Khodadad In today's rapidly changing technology landscape, artificial intelligence (AI) is more than a buzzword. It is transforming businesses and societies. From advances in scalable AI methodology to urgent calls for sustainability, the AI Hardware & Edge AI Summit recently held in London, sparked vibrant discussions that will determine the fu... » read more

On-Device Speaker Identification For Digital Television (DTV)


In recent years, the way we interact with our TVs has changed. Multiple button presses to navigate an on-screen keyboard have been replaced with direct interaction through our voices. While this has resulted in significant improvements to the Digital Television (DTV) user experience, more can be done to provide immersive and engaging experiences. Imagine you say, “recommend me a film” or... » read more

← Older posts