tag: data centers

Chip Industry Week In Review
By The SE Staff - 07 Feb, 2025 - Comments: 0

The chip industry is well on its way to hit $1 trillion in revenue by the end of its decade. Several analyst firms released 2024 annual results and 2025 predictions: Worldwide semiconductor revenue reached $626 billion in 2024, an 18% increase versus 2023, according to preliminary Gartner report. Memory revenue grew about 70%  2024 versus 2023. The firm forecasts that HBM will make up 19%... » read more

Gold In The Machine: Scaling Infrastructure For The Age Of AI
By Jenn Mullen - 30 Jan, 2025 - Comments: 0

During the gold rush, hopeful prospectors flooded the west to make their fortunes in gold. Today, technology pioneers are looking to stake their claim in the realm of artificial intelligence (AI). Price Waterhouse Cooper (PWC) estimates that 45% of total global economic gains by 2030 will be driven by AI as more sectors embrace the productivity and product enhancement benefits of AI. PWC’s ... » read more

AI Infrastructure At A Crossroads
By Ramin Farjadrad - 30 Jan, 2025 - Comments: 0

By Ramin Farjadrad and Syrus Ziai There is a big push to achieve greater scale, performance and sustainability to fuel the AI revolution. More speed, more memory bandwidth, less power — these are the holy grails. Naturally, the one-two punch of StarGate and DeepSeek last week has raised many questions in our ecosystem and with our various stakeholders. Can DeepSeek be real? And if so, w... » read more

Is Liquid Cooling The Future Of Your Data Center?
By Veena Parthan - 16 Jan, 2025 - Comments: 0

The data center industry is facing unprecedented challenges. With chip densities skyrocketing, high-performance computing is being pushed to its limits, all while energy costs are soaring and environmental concerns are escalating. Securing approvals for new data center facilities has become more complex, often plagued by community objections and grid supply issues. However, amidst these hurd... » read more

Co-Packaged Optics To Train/Run GenAI Models in Data Centers (IBM)
By Technical Paper Link - 27 Dec, 2024 - Comments: 0

A new technical paper titled "Next generation Co-Packaged Optics Technology to Train & Run Generative AI Models in Data Centers and Other Computing Applications" was published by researchers at IBM. Abstract "We report on the successful design and fabrication of optical modules using a 50 micron pitch polymer waveguide interface, integrated for low loss, high density optical data transf... » read more

Integrating Ethernet, PCIe, And UCIe For Enhanced Bandwidth And Scalability For AI/HPC Chips
By Madhumita Sanyal - 12 Dec, 2024 - Comments: 0

By Madhumita Sanyal and Aparna Tarde Multi-die architectures are becoming a pivotal solution for boosting performance, scalability, and adaptability in contemporary data centers. By breaking down traditional monolithic designs into smaller, either heterogeneous or homogeneous dies (also known as chiplets), engineers can fine-tune each component for specific functions, resulting in notable im... » read more

Why PCIe And CXL Are Essential Interconnects For The AI Era
By Lou Ternullo - 12 Dec, 2024 - Comments: 0

As the demand for AI and machine learning accelerates, the need for faster and more flexible data interconnects has never been more critical. Traditional data center architectures face several challenges in enabling efficient and scalable infrastructure to meet the needs of emerging AI use cases. The wide variety of AI use cases translate into different types of workloads. Some require high ... » read more

Redefining XPU Memory For AI Data Centers Through Custom HBM4: Part 2
By Archana Cheruliyil - 09 Dec, 2024 - Comments: 0

This is the second in a three-part series from Alphawave Semi on HBM4 and gives insights into HBM implementation challenges. Click here for part 1, for an overview on HBM, and in part 3, we will introduce details of a custom HBM implementation. Implementing a 2.5D System-in-Package (SiP) with High Bandwidth Memory (HBM) is a complex process that spans across architecture definition, designi... » read more

Redefining XPU Memory For AI Data Centers Through Custom HBM4: Part 1
By Archana Cheruliyil - 26 Nov, 2024 - Comments: 1

This is the first of a three-part series on HBM4 and gives an overview of the HBM standard. Part 2 will provide insights on HBM implementation challenges, and part 3 will introduce the concept of a custom HBM implementation. Relentless growth in data consumption Recent advances in deep learning have had a transformative effect on artificial intelligence (AI) and the ever-increasing volume of ... » read more

One Chip Vs. Many Chiplets
By Ed Sperling - 20 Nov, 2024 - Comments: 1

Experts at the Table: Semiconductor Engineering sat down to discuss the growing list of challenges at advanced nodes and in advanced packages, with Jamie Schaeffer, vice president of product management at GlobalFoundries; Dechao Guo, director of advanced logic technology R&D at IBM; Dave Thompson, vice president at Intel; Mustafa Badaroglu, principal engineer at Qualcomm; and Thomas Ponnusw... » read more

← Older posts

  • Sponsors

About

Navigation

Connect With Us

Copyright ©2013-2025 SMG   |  Terms of Service  |  Privacy Policy