Do Large Batches Always Improve Neural Network Throughput?


Common benchmarks like ResNet-50 generally have much higher throughput with large batch sizes than with batch size =1. For example, the Nvidia Tesla T4 has 4x the throughput at batch=32 than when it is processing in batch=1 mode. Of course, larger batch sizes have a tradeoff: latency increases which may be undesirable in real-time applications. Why do larger batches increase throughput... » read more

Machine Learning Drives High-Level Synthesis Boom


High-level synthesis (HLS) is experiencing a new wave of popularity, driven by its ability to handle machine-learning matrices and iterative design efforts. The obvious advantage of HLS is the boost in productivity designers get from working in C, C++ and other high-level languages rather than RTL. The ability to design a layout that should work, and then easily modify it to test other confi... » read more

Accelerating Endpoint Inferencing


Chipmakers are getting ready to debut inference chips for endpoint devices, even though the rest of the machine-learning ecosystem has yet to be established. Whatever infrastructure does exist today is mostly in the cloud, on edge-computing gateways, or in company-specific data centers, which most companies continue to use. For example, Tesla has its own data center. So do most major carmake... » read more

Designing In The Cloud


Amazon AWS was launched back in 2006. Web based services such as Netflix and Expedia were early adopters, and AWS has grown rapidly, bringing in competition from Google (GCP), Microsoft (Azure) and others. It has taken a while for the design community to embrace the ‘cloud’ as some of the needs and concerns of design teams are different.  Cloud vendors have recognized this untapped market ... » read more

In Automotive, A Move From Microcontrollers To Massively Complex SoCs


Cars and custom, high-end chips. It’s a topic coming up more frequently these days. The most prominent example is Tesla’s FSD computer, described by Elon Musk as “the best chip in the world…objectively” during the company’s April Autonomy Day. When it comes to chips, Tesla is alone only when it comes to hyperbole, at least based on browsing job postings for big carmakers and supplie... » read more

Speeding Up AI


Robert Blake, president and CEO of Achronix, sat down with Semiconductor Engineering to talk about AI, which processors work best where, and different approaches to accelerate performance. SE: How is AI affecting the FPGA business, given the constant changes in algorithms and the proliferation of AI almost everywhere? Blake: As we talk to more and more customers deploying new products and... » read more

Ethernet NIC For Fast Data Path


A bit of validation once in a while is good for all of us – that’s pretty true whether you are the one providing it or, conversely, the one receiving it. Most of the time it seems to be me that is giving out validation rather than getting it. Like the other day when my wife tried on a new dress and asked me, “How do I look?” Now, of course, we all know there is only one way to answer a ... » read more

Holes In AI Security


Mike Borza, principal security technologist in Synopsys’ Solutions Group, explains why security is lacking in AI, why AI is especially susceptible to Trojans, and why small changes in training data can have big impacts on many devices. » read more

Toshiba Verifies Thermal Contribution In Motor Control Driver ICs


High output current ICs usually generate a lot of heat from the driver transistor, which affects the surrounding circuits. Therefore, it is important to take into account the transient heat based on the output current level when designing applications such as engine throttles or on/off switches for engine bulbs. In this whitepaper, the Toshiba team discusses how they used the Eldo circuit simul... » read more

Securing The Mobile IoT


It’s 2019. Security fears, locked ecosystems, and lack of technology are keeping IoT products within WiFi networks, and not reaching their full potential. As an industry, we must provide IoT solutions that are simple and keep consumers--and their data--secure.The mobile IoT is the next frontier in the connected device market, providing out-of-the-box connectivity with security from silicon... » read more

← Older posts Newer posts →