Multi-Layer Processing Boosts Inference Throughput/Watt


The focus in discussion of inference throughput is often on the computations required. For example, YOLOv3, a power real time object detection and recognition model, requires 227 BILLION MACs (multiply-accumulates) to process a single 2 Mega Pixel image! This is with the Winograd Transformation; it’s more than 300 Billion without it. And there is a lot of discussion of the large size ... » read more

AI: Where’s The Money?


A one-time technology outcast, Artificial Intelligence (AI) has come a long way. Now there’s groundswell of interest and investments in products and technologies to deliver high performance visual recognition, matching or besting human skills. Equally, speech and audio recognition are becoming more common and we’re even starting to see more specialized applications such as finding optimized... » read more

Inference Acceleration: Follow The Memory


Much has been written about the computational complexity of inference acceleration: very large matrix multiplies for fully-connected layers and huge numbers of 3x3 convolutions across megapixel images, both of which require many thousands of MACs (multiplier-accumulators) to achieve high throughput for models like ResNet-50 and YOLOv3. The other side of the coin is managing the movement of d... » read more

The Other Side Of Makimoto’s Wave


Custom hardware is undergoing a huge resurgence across a variety of new applications, pushing the semiconductor industry to the other side of Makimoto's Wave. Tsugio Makimoto, the technologist who identified the chip industry’s 10-year cyclical swings between standardization and customization, predicted there always will be room in ASICs for general-purpose processors. But it's becoming mo... » read more

Pushing AI Into The Mainstream


Artificial intelligence is emerging as the driving force behind many advancements in technology, even though the industry has merely scratched the surface of what may be possible. But how deeply AI penetrates different market segments and technologies, and how quickly it pushes into the mainstream, depend on a variety of issues that still must be resolved. In addition to a plethora of techni... » read more

AI Accelerator Gyrfalcon Soars Post Stealth


Milpitas, Calif.-based startup Gyrfalcon Technology Inc. (GTI), which emerged from semi-stealth mode in September, recently announced the datacenter-focused second generation of its neural-network accelerator, which was first aimed at the endpoint. GTI is not alone: The endpoint market is growing. By 2022, 25% of endpoint devices will execute AI algorithms (inference for neural network appli... » read more

Building AI SoCs


Ron Lowman, strategic marketing manager at Synopsys, looks at where AI is being used and how to develop chips when the algorithms are in a state of almost constant change. That includes what moves to the edge versus the data center, how algorithms are being compressed, and what techniques are being used to speed up these chips and reduce power. https://youtu.be/d32jtdFwpcE    ... » read more

Processors Are Exciting Again


Today is a very exciting time in the world of processor architectures. Domain-specific processor architectures are now fully realized as the best answers to the challenges of low power and high performance for many applications. Advancements in artificial intelligence are leading the way to exciting new experiences and products today and in our future. There have been more advances in deep lear... » read more

AI, ML Chip Choices


Flex Logix’s Cheng Wang talks about which types of chips work best for neural networks, AI and machine learning. https://youtu.be/k7OdP7B10o8 » read more

Intelligence At The Edge Is Transforming Our World


Innovation comes in all forms in technology, from software and hardware to displays all the way to the human-machine interface. As devices and systems become more intelligent, the onus on humans to learn the machine’s ways is shifting. Until now, interaction with smart devices has largely relied on our ability to manipulate the machines; to learn their language to input and extract the inform... » read more