Artificial Intelligence: Let Us Get The Math Right First!


Artificial intelligence is a hot topic these days and therefore doesn’t require a repeat of the current and future potential uses for AI. For most people, it means technology advancements on the software side. But if you ask people who are very close to this technology domain, building your own optimized hardware chips is where a significant part of the competitive edge lies. A few days ba... » read more

Do Large Batches Always Improve Neural Network Throughput?


Common benchmarks like ResNet-50 generally have much higher throughput with large batch sizes than with batch size =1. For example, the Nvidia Tesla T4 has 4x the throughput at batch=32 than when it is processing in batch=1 mode. Of course, larger batch sizes have a tradeoff: latency increases which may be undesirable in real-time applications. Why do larger batches increase throughput... » read more

Machine Learning Drives High-Level Synthesis Boom


High-level synthesis (HLS) is experiencing a new wave of popularity, driven by its ability to handle machine-learning matrices and iterative design efforts. The obvious advantage of HLS is the boost in productivity designers get from working in C, C++ and other high-level languages rather than RTL. The ability to design a layout that should work, and then easily modify it to test other confi... » read more

Accelerating Endpoint Inferencing


Chipmakers are getting ready to debut inference chips for endpoint devices, even though the rest of the machine-learning ecosystem has yet to be established. Whatever infrastructure does exist today is mostly in the cloud, on edge-computing gateways, or in company-specific data centers, which most companies continue to use. For example, Tesla has its own data center. So do most major carmake... » read more

Designing In The Cloud


Amazon AWS was launched back in 2006. Web based services such as Netflix and Expedia were early adopters, and AWS has grown rapidly, bringing in competition from Google (GCP), Microsoft (Azure) and others. It has taken a while for the design community to embrace the ‘cloud’ as some of the needs and concerns of design teams are different.  Cloud vendors have recognized this untapped market ... » read more

In Automotive, A Move From Microcontrollers To Massively Complex SoCs


Cars and custom, high-end chips. It’s a topic coming up more frequently these days. The most prominent example is Tesla’s FSD computer, described by Elon Musk as “the best chip in the world…objectively” during the company’s April Autonomy Day. When it comes to chips, Tesla is alone only when it comes to hyperbole, at least based on browsing job postings for big carmakers and supplie... » read more

Ethernet NIC For Fast Data Path


A bit of validation once in a while is good for all of us – that’s pretty true whether you are the one providing it or, conversely, the one receiving it. Most of the time it seems to be me that is giving out validation rather than getting it. Like the other day when my wife tried on a new dress and asked me, “How do I look?” Now, of course, we all know there is only one way to answer a ... » read more

Speeding Up AI


Robert Blake, president and CEO of Achronix, sat down with Semiconductor Engineering to talk about AI, which processors work best where, and different approaches to accelerate performance. SE: How is AI affecting the FPGA business, given the constant changes in algorithms and the proliferation of AI almost everywhere? Blake: As we talk to more and more customers deploying new products and... » read more

DAC 2019: Day 3


Two keynotes get day three of DAC started. The first by John Cohn, Massachusetts Institute of Technology & IBM Watson AI Lab. "I am a nerd. Look back 100 years in processing. We have gone from mechanical computing to where we are today, but it has not been a smooth curve. There are smooth places and then discontinuities. This is when what you were working on no longer works. How we make tho... » read more

Holes In AI Security


Mike Borza, principal security technologist in Synopsys’ Solutions Group, explains why security is lacking in AI, why AI is especially susceptible to Trojans, and why small changes in training data can have big impacts on many devices. » read more

← Older posts Newer posts →