Author's Latest Posts


Is The Transformer Era Over?


The idea of transformer networks has existed since the seminal publication of the Attention is All You Need paper by Google researchers in June 2017.  And while transformers quickly gained traction within the ML research community, and in particular demonstrated superlative results in vision applications (ViT paper), transformer networks were definitely not a topic of trendy conversation ar... » read more

Vision Transformers Change The AI Acceleration Rules


Transformers were first introduced by the team at Google Brain in 2017 in their paper, "Attention is All You Need". Since their introduction, transformers have inspired a flurry of investment and research which have produced some of the most impactful model architectures and AI products to-date, including ChatGPT which is an acronym for Chat Generative Pre-trained Transformer. Transformers a... » read more

What’s The Difference Between An NPU And A GPNPU?


To understand the difference between an NPU (neural processing unit) and a GPNPU (general-purpose neural processing unit) let’s start with the NPU, a processing engine that accelerates machine learning (ML) workloads in System on Chip (SoC) designs. Click here to read more. » read more