Scaling GenAI Training And Inference Chips With Runtime Monitoring


GenAI’s rapid growth is pushing the limits of semiconductor technology, demanding breakthroughs in performance, power efficiency, and reliability. Training and inference workloads for models like GPT-4 and GPT-5 require massive computational resources, leading to skyrocketing costs, energy consumption, and hardware failures. Traditional optimization methods, such as static guard bands and per... » read more

AI: A New Tool For Hackers, And For Preventing Attacks


Semiconductor Engineering sat down to discuss hardware security challenges, including new threat models from AI-based attacks, with Nicole Fern, principal security analyst at Keysight; Serge Leef, AI-For-Silicon strategist at Microsoft; Scott Best, senior director for silicon security products at Rambus; Lee Harrison, director of Tessent Automotive IC Solutions at Siemens EDA; Mohit Arora, seni... » read more

Mobile Chip Challenges In The AI Era


Leading smart phone vendors are struggling to keep pace with the rising compute and power demands of localized generative AI, standard phone functions, and the need to move more data back and forth between handsets and the cloud. In addition to edge functions, such as facial recognition and other on-device apps, phones must accommodate a continuous stream of new communications protocols, and... » read more

Transforming The Semiconductor Industry: Future Roadmap For Generative AI On The Edge


In the third of a three-part series, Expedera, in conjunction with the Global Semiconductor Alliance’s Emerging Technologies (EmTech) group explores “Transforming the Semiconductor Industry: Future Roadmap for Generative AI on the Edge”. This white paper explores key applications for Generative AI and the features they enable, as well as an examination of how model growth and differing mo... » read more

Allegro X AI for Generative System Design


PCB design is the act of realizing a schematic into a physical form. Currently, human designers use electronic design automation (EDA) software to combine component placement and routing to realize the electrical connectivity on a manufacturable PCB. Computer-aided design (CAD) tools have been used in the design flow since the 1970s and are now an essential part of the designer’s toolkit. Som... » read more

Unlocking Generative AI On The Edge Across The Semiconductor Value Chain


In the second of a three-part series, Expedera, in conjunction with the Global Semiconductor Alliance’s Emerging Technologies (EmTech) group, explores “Unlocking Generative AI on the Edge across the Semiconductor Value Chain”. Included in this white paper is an examination of how members of the value chain (including IP providers, EDA vendors, fabless chip makers, foundries, OSATs, OEMs, ... » read more

The Impact of Generative AI on the Edge for the Semiconductor Industry


In the first of a three-part series, Expedera, in conjunction with the Global Semiconductor Alliance’s Emerging Technologies (EmTech) group, explores “The Impact of Generative AI on the Edge for the Semiconductor Industry”. In this white paper, the working group explores the evolution of Generative AI (GenAI), and how the rapidly evolving semiconductor industry can enable GenAI innovation... » read more

AI Infrastructure At A Crossroads


By Ramin Farjadrad and Syrus Ziai There is a big push to achieve greater scale, performance and sustainability to fuel the AI revolution. More speed, more memory bandwidth, less power — these are the holy grails. Naturally, the one-two punch of StarGate and DeepSeek last week has raised many questions in our ecosystem and with our various stakeholders. Can DeepSeek be real? And if so, w... » read more

Co-Packaged Optics To Train/Run GenAI Models in Data Centers (IBM)


A new technical paper titled "Next generation Co-Packaged Optics Technology to Train & Run Generative AI Models in Data Centers and Other Computing Applications" was published by researchers at IBM. Abstract "We report on the successful design and fabrication of optical modules using a 50 micron pitch polymer waveguide interface, integrated for low loss, high density optical data transf... » read more

Deploying Generative AI At Scale With Flexibility And Speed


As the types of content that generative AI (GenAI) can process expands to advanced video, images, audio, and text, the race to innovate is creating new hurdles for developers. Discover how to overcome the challenges surrounding scalability and speed of GenAI development to offer cutting-edge experiences. Read more here and learn: How to run and scale GenAI workloads efficiently. Tech... » read more

← Older posts