category: A Bit About Memory

category: Auto, Security & Edge AI

Maximize Uptime And Improve TCO: RAS And Telemetry In HBM4 For Data Centers
By Raj Uppala - 14 Aug, 2025 - Comments: 0

As AI workloads scale and data center operations become increasingly complex, it is critical to keep the infrastructure up and running. Total Cost of Ownership (TCO) is a key metric that includes not only the upfront cost of hardware but also the ongoing expenses of power, cooling, maintenance, and—most importantly—downtime. A single memory failure in a hyperscale AI cluster can cascade int... » read more

Scaling In The AI Era: The Role Of PCI Express 7.0 Switches In Next-Gen Data Centers
By Lou Ternullo - 17 Jul, 2025 - Comments: 0

As artificial intelligence (AI) workloads continue to scale in complexity and volume, the infrastructure that supports them must evolve just as rapidly. At the heart of this transformation lies PCI Express 7.0 (PCIe 7.0), a next-generation interconnect standard that is redefining how data moves within high-performance computing (HPC) and AI-driven data centers. PCIe 7.0 doubles the raw bit r... » read more

Meeting The Performance Demands Of The Next-Gen Client PC Market
By Carlos Weissenberg - 12 Jun, 2025 - Comments: 0

The client PC market is undergoing a transformative shift. As AI becomes a cornerstone of modern computing, the architecture of client systems—particularly notebooks and desktops—is being reimagined to support the immense data processing needs of these workloads. From real-time inferencing to generative applications, AI is redefining what performance means in a personal computer. With th... » read more

HBM4 Elevates AI Training Performance To New Heights
By Nidish Kamath - 15 May, 2025 - Comments: 0

Generative and Agentic AI are pushing an extremely rapid evolution of computing technology. With leading-edge LLMs now in excess of a trillion parameters, training takes an enormous amount of computing capacity, and state-of-the-art training clusters can employ more than 100,000 GPUs. High Bandwidth Memory (HBM) provides the vast memory bandwidth and capacity needed for these demanding AI train... » read more

Delivering Breakthrough Performance And Power Efficiency With PCIe 6
By Lou Ternullo - 10 Apr, 2025 - Comments: 0

PCI Express (PCIe) has been the backbone of high-speed data transfer in computing systems for nearly two decades. With each iteration, PCIe has not only increased data bandwidth but also introduced innovations aimed at enhancing power efficiency—a critical factor in today's energy-conscious computing environment. PCIe 6 introduced significant technical improvements that optimize power consump... » read more

Enabling Next-Generation Automotive Zonal Architecture With MIPI
By Raj Uppala - 13 Mar, 2025 - Comments: 0

The evolution of automotive architecture has followed three key stages: distributed architecture, domain-centralized architecture, and emerging zonal architecture. Each stage reflects advancements in functionality, complexity, and efficiency. Distributed architecture, prevalent in early vehicles, relied on numerous function-specific Electronic Control Units (ECUs). While effective for modularit... » read more

Optimizing Data Center TCO With CXL And Compression
By Raj Uppala - 13 Feb, 2025 - Comments: 0

In the ever-evolving landscape of data centers, Total Cost of Ownership (TCO) remains a critical metric. It encompasses all costs associated with data center infrastructure throughout its lifecycle, including initial purchase, installation, utilization, maintenance, energy consumption, and eventual replacement. By understanding and optimizing TCO, hyperscalers can make informed decisions that e... » read more

Choosing The Right Memory Solution For AI Accelerators
By Tim Messegee - 16 Jan, 2025 - Comments: 0

To meet the increasing demands of AI workloads, memory solutions must deliver ever-increasing performance in bandwidth, capacity, and efficiency. From the training of massive large language models (LLMs) to efficient inference on endpoint devices, choosing the right memory technology is critical for chip designers. This blog explores three leading memory solutions—HBM, LPDDR, and GDDR—and t... » read more

Why PCIe And CXL Are Essential Interconnects For The AI Era
By Lou Ternullo - 12 Dec, 2024 - Comments: 0

As the demand for AI and machine learning accelerates, the need for faster and more flexible data interconnects has never been more critical. Traditional data center architectures face several challenges in enabling efficient and scalable infrastructure to meet the needs of emerging AI use cases. The wide variety of AI use cases translate into different types of workloads. Some require high ... » read more

Extending The DDR5 Roadmap With MRDIMM
By Zaman Mollah - 14 Nov, 2024 - Comments: 0

Given the voracious memory bandwidth and capacity demands of Gen AI and other advanced workloads, we’ve seen a rapid progression through the generations of DDR5 memory. Multiplexed Registered DIMMs (MRDIMMs) offer a new memory module architecture capable of extending the DDR5 roadmap and expanding the capabilities of server main memory. MRDIMM reuses the lion’s share of existing DDR5 infras... » read more

← Older posts Newer posts →

  • Sponsors

About

Navigation

Connect With Us

Copyright ©2013-2026 SMG   |  Terms of Service  |  Privacy Policy