Generative AI In Chip Manufacturing


Generative AI is a natural-language or text-based query, predicting patterns based on a massive set of data. While most of the attention has been focused on chatbots and copilots, it also can be used to identify small, transient aberrations in semiconductor manufacturing that are otherwise difficult to find. Jon Herlocker, vice president and general manager of software analytics at Cohu, talks ... » read more

AI In A/MS IC Design: Between Buzzword And Productivity Boost


In the past few years, AI has burst onto the public stage in grand style. This ongoing trend is apparent in the rising number of AI applications in everyday life. But more and more, it can also be seen in a broad range of technical niches, where the main motivation is AI’s promise of continuously increasing efficiency. One such niche that has seen decades of attempts to achieve greater eff... » read more

AI Moves Out Of The Cloud And Onto The Edge


The impact of AI to date, in the cloud, is undisputed, but the question we must answer going forward is whether we can only expect more of the same or whether there is a fundamental shift looming that will change everything. Today, we will explore historical data to find patterns repeated through the ages to help us see what I will attempt to prove is imminent. A brief history of time… keepi... » read more

Next Generation AI: Transitioning Inference From The Cloud To The Edge


AI inference deployments are increasingly focused on the edge as manufacturers seek the consistent latency, enhanced privacy, and reduced operational costs they can’t achieve in cloud-based deployments. While cloud-based platforms provide incredible computational power and enable widely adopted services, the dependence on network connectivity inherently creates variability, cost and security ... » read more

Rethinking The Role Of CPUs In AI: A Practical RAG Implementation


In many enterprise environments, engineers and technical staff need to find information quickly. They search internal documents such as hardware specifications, project manuals, and technical notes. These materials are often scattered, making traditional search inefficient. These documents are often confidential or proprietary. This constraint prevents these documents from being processed by... » read more

Limited by Power


AI is seen as a massive computation problem, but that is not the case, at least with the way that the problem is structured today. It is a data movement problem. This not only limits performance but represents most of the energy consumption. In addition, the industry spends most of its time and effort making small improvements that optimize aspects of the existing architecture, when what is ... » read more

AI Buildout Makes HPC Simulation More Challenging


Simulations of semiconductors and systems are becoming bigger, more complex, and increasingly necessary, mirroring everything that is happening to the hardware itself — particularly in AI data centers. The move beyond monolithic chips to multi-die assemblies now requires solving some thorny multi-physics challenges, such as thermal and power delivery, which are increasingly difficult to mo... » read more

Resilient And Optimized GenAI Systems


AI and data center systems are being pushed to their limits, with soaring complexity, nonstop inference workloads, and rising energy demands. Addressing these pressures requires more than incremental improvements, it calls for collaboration across the ecosystem. That’s why proteanTecs has joined forces with Arm, bringing our real-time monitoring technology into Arm’s Neoverse Compute Subsys... » read more

Chip Innovation Will Bridge The Gap For USA Data Center Power


Heading to meetings in Silicon Valley, I often drive through Santa Clara, passing boxy buildings with few windows. They are data centers for local customers willing to pay for low latency. Data centers cluster in Santa Clara because that city's power has been the cheapest in Silicon Valley. The San Jose Mercury News recently reported that two data centers in Santa Clara are empty, waiting for a... » read more

Charting The Course For A Truly Multi-Modal Device Edge


The world is witnessing an AI tsunami. While the initial waves of this technological shift focused heavily on the cloud, a powerful new surge is now building at the edge. This rapid infusion of artificial intelligence is set to redefine IoT devices and applications, from sophisticated smart homes to highly efficient industrial environments. This evolution, however, has created significant fr... » read more

← Older posts Newer posts →