Processor Tradeoffs For AI Workloads


AI is forcing fundamental shifts in chips used in data centers and in the tools used to design them, but it also is creating gaps between the speed at which that technology advances and the demands from customers. These shifts started gradually, but they have accelerated and multiplied over the past year with the rollout of ChatGPT and other large language models. There is suddenly much more... » read more

Developing Energy-Efficient AI Accelerators For Intelligent Edge Computing And Data Centers


Artificial intelligence (AI) accelerators are deployed in data centers and at the edge to overcome conventional von Neumann bottlenecks by rapidly processing petabytes of information. Even as Moore’s law slows, AI accelerators continue to efficiently enable key applications that many of us increasingly rely on, from ChatGPT and advanced driver assistance systems (ADAS) to smart edge device... » read more

Tradeoffs In DSP Design


More intelligence is now required in the front-, mid-, and back-haul for 5G/6G communication, requiring a mix of high performance, low power, and enough flexibility to accommodate constantly changing protocols and algorithms. One solution to these conflicting goals involves reconfigurable DSPs, in which the processing element is hardwired like an ASIC but still configurable for a variety of app... » read more

Managing Voltage Variation


Engineers make many tradeoffs when designing SoC’s to better meet design specifications. Power, Performance and Area (PPA) are the primary goals and all three impact the cost of the implementation. For example, higher power and performance can both require more expensive packaging for power and signal integrity as well as cooling. The larger the die area the fewer die per wafer which drives u... » read more

Virtualization: A Must-Have For Embedded AI In Automotive SoCs


Virtualization, the process of abstracting physical hardware by creating multiple virtual machines (VMs) with independent operating systems and tasks, has been in computing since the 1960s. Now, with the need to optimize the utilization of large AI and DSP blocks in automotive SoCs, along with the need for increased functional safety in autonomous driving, virtualization is coming to power- an... » read more

AI Transformer Models Enable Machine Vision Object Detection


The object detection required for machine vision applications such as autonomous driving, smart manufacturing, and surveillance applications depends on AI modeling. The goal now is to improve the models and simplify their development. Over the years, many AI models have been introduced, including YOLO, Faster R-CNN, Mask R-CNN, RetinaNet, and others, to detect images or video signals, interp... » read more

Semiconductor Industry Is Pulling AI Across A Diversity Of End Uses And Applications


Earlier this month, I had the pleasure of joining a group of industry peers during SEMICON West and the Design Automation Conference in San Francisco for an enlightening panel discussion that we organized titled, “How AI Is Reinventing the Semiconductor Industry Inside and Out.” Moderated by Gartner, I was joined on the panel by senior executives from Advantest, Synopsys and the TinyML Foun... » read more

Reducing Chip Test Costs With AI-Based Pattern Optimization


The old adage “time is money” is highly applicable to the production testing of semiconductor devices. Every second that a wafer or chip is under test means that the next part cannot yet be tested. The slower the test throughput, the more automatic test equipment (ATE) is needed to meet production throughput demands. This is a huge issue for chip producers, since high pin counts, blazingly ... » read more

A Packet-Based Architecture For Edge AI Inference


Despite significant improvements in throughput, edge AI accelerators (Neural Processing Units, or NPUs) are still often underutilized. Inefficient management of weights and activations leads to fewer available cores utilized for multiply-accumulate (MAC) operations. Edge AI applications frequently need to run on small, low-power devices, limiting the area and power allocated for memory and comp... » read more

DAC 2023: Megatrends And The Road Ahead For Design Automation


As Silicon Valley is in the midst of the heat wave the world is experiencing, the recent Design Automation Conference and its exhibition discussed hot technologies. Three megatrends defined the current situation – artificial intelligence (AI), chiplets, and integration. To me, the more exciting aspect of DAC was the discussion of what is ahead for EDA in the decade to come, and for that, the ... » read more

← Older posts Newer posts →