Micron has confirmed the launch of its new Multiplexed Rank Dual Inline Memory Module (MRDIMM). The new memory is designed for scenarios requiring more than 128GB of memory per DIMM slot and works by combining multiple layers of memory modules, running at standard DDR5 speeds, with a data buffer that speeds up the connection to the host computer, allowing for faster data transfers.
MRDIMMs improve on traditional TSV RDIMMs by offering higher bandwidth, higher capacity, lower latency, and better performance per watt.
Designed for use in virtualized environments, HPC, and AI data center operations, MRDIMMs are the first generation of Micron’s new family of memory modules and are compatible with Intel’s new Xeon 6 processors.
Used in Granite Rapids
“Micron’s latest innovative main memory solution, MRDIMM, delivers the much-needed bandwidth and capacity with lower latency to scale AI inference and HPC applications on next-generation server platforms,” said Praveen Vaidyanathan, vice president and general manager of Micron’s Compute Products Group.
“MRDIMMs significantly reduce the amount of power used per task while offering the same reliability, availability, serviceability and interface capabilities as RDIMMs, providing customers with a flexible solution that scales performance. Micron's close collaborations with the industry ensure seamless integration into existing server infrastructures and smooth transitions to future computing platforms.”
Compliant with DDR5 physical and electrical standards, MRDIMM technology is designed to enable better bandwidth and capacity scalability per core. The modules offer up to a 39% increase in effective memory bandwidth, over 15% improvement in bus efficiency, and up to 40% reduction in latency compared to RDIMM modules.
Available in capacities from 32GB to 256GB and suitable for both standard and tall form factors, MRDIMMs are designed for high-performance 1U and 2U servers. Micron claims they feature an advanced thermal design that reduces DRAM temperatures by up to 20 degrees Celsius, helping to improve cooling efficiency and reduce overall power consumption for memory-intensive tasks.
Micron plans to begin shipping MRDIMMs in large quantities in the second half of 2024, coinciding with Intel’s launch of its 128-core Granite Rapids-AP P line, a move that will allow the chip giant to take the fastest server CPU spot from AMD for the first time in a decade. Granite Rapids will be the first platform to support 8800 MT/s MRDIMMs on the host side.
