Understanding The Total Cost Of Ownership In HPC And AI Systems


Cost is often the deciding factor when it comes to purchasing decisions at an organization, particularly those dealing with high-tech investments. When organizations evaluate proposals for new procurements, the initial capital cost of the system often receives significant attention. A great deal of preparation and planning goes into the decision to make a large purchase. While this is a critica... » read more

Challenges and Best Practices for TCO Models of Technical Computing Resources for Engineering Modeling and Simulation Workflows


Many organizations focus heavily on the system’s initial capital cost when developing criteria and reviewing proposals for new procurements. While this is crucial for evaluating ROI, research shows that the initial purchase cost accounts for only half of the total expenses over the system’s useful life. This data point highlights the importance of understanding the total cost of ownership (... » read more

CXL: The Future Of Memory Interconnect?


Momentum for sharing memory resources between processor cores is growing inside of data centers, where the explosion in data is driving the need to be able to scale memory up and down in a way that roughly mirrors how processors are used today. A year after the CXL Consortium and JEDEC signed a memorandum of understanding (MOU) to formalize collaboration between the two organizations, suppor... » read more

A Chiplet-Based Supercomputer For Generative LLMs That Optimizes Total Cost of Ownership


A technical paper titled "Chiplet Cloud: Building AI Supercomputers for Serving Large Generative Language Models" was published by researchers at University of Washington and University of Sydney. Abstract: "Large language models (LLMs) such as ChatGPT have demonstrated unprecedented capabilities in multiple AI tasks. However, hardware inefficiencies have become a significant factor limiting ... » read more

How To Justify A Data Center


The breadth of cloud capabilities and improvements in cost and licensing structures is prompting chipmakers to consider offloading at least some of their design work into the cloud. Cloud is a viable business today for semiconductor design. Over the past decade, the interest in moving to cloud computing has grown from an idea that was fun to talk about — but which no one was serious about ... » read more

Power Markets


There has been an ongoing discussion in the industry about the importance of power and performance and which is more important. I submit that the real question is: How much performance can be squeezed out of the power budget for any given market segment? Figure 1. Processor Market Segment Power Budgets Figure 1 shows a rough breakdown of the different market segments for processors, alo... » read more