ClareNow
Search
ClareNow
Toggle sidebar
Technology ↑ Positive

Samsung HBM4E, Kioxia And HPE Storage, And Peak:AIO Metadata Server

Samsung is sampling HBM4E samples. Kioxia works with HPE on terrestrial and space computing. Peak:AIO and Los Alamos Laboratory break metadata storage bottleneck.

Forbes 3 min read 8/10
Samsung HBM4E, Kioxia And HPE Storage, And Peak:AIO Metadata Server
Key Takeaways
  • Samsung is sampling HBM4E memory with 48 GB per stack and up to 1.2 TB/s bandwidth, doubling HBM3E performance.
  • Kioxia and HPE are collaborating on storage class memory for HPE ProLiant servers and radiation-hardened systems for space computing.
  • Peak:AIO and Los Alamos National Lab developed a CXL-based metadata server that reduces AI data staging time by 70%.
  • The metadata server achieves billions of metadata operations per second, increasing GPU utilization up to 80% during training.
  • Samsung plans volume production of HBM4E in H1 2027, aiming to lead the memory race against SK Hynix and Micron.
Samsung is already sampling the next generation of high-bandwidth memory—HBM4E—months before its expected commercial launch. This signals an accelerated race among memory makers to supply the insatiable appetite of AI accelerators.

Samsung Electronics has begun providing HBM4E samples to key customers, advancing the standard that promises to double the bandwidth of current HBM3E. Industry sources confirm that the new memory modules are being tested in AI training clusters and high-performance computing systems. The move comes as Nvidia, AMD, and other chip designers demand ever-faster memory to feed their graphics processing units (GPUs). Samsung aims to start volume production in the first half of next year, leapfrogging competitors SK Hynix and Micron.

High-bandwidth memory stacks DRAM dies vertically, using through-silicon vias to achieve enormous data transfer rates. HBM4E is expected to deliver up to 1.2 TB/s per stack, up from around 1 TB/s in HBM3E. Each stack may pack 48 GB of capacity, double the current maximum, thanks to 6th-generation 1d DRAM technology. The samples are being validated by major data center operators and AI companies, who are already designing next-generation server platforms around the new memory.

In a separate development, Kioxia has teamed up with Hewlett Packard Enterprise to optimize storage solutions for both terrestrial and space-based computing. Kioxia’s Flash Memory and Storage Class Memory will be integrated into HPE’s ProLiant servers and space-qualified systems. The collaboration targets low-latency, high-endurance storage for edge AI and satellite data processing. Kioxia is also exploring 3D NAND radiation hardening for orbital environments.

Meanwhile, Peak:AIO and Los Alamos National Laboratory have jointly developed a metadata server that breaks the storage bottleneck in large-scale AI workloads. Traditional file systems struggle with the massive metadata operations generated by training datasets. The new Peak:AIO Metadata Server uses compute express link (CXL) and a distributed architecture to handle billions of metadata operations per second. In testing, it reduced data staging time by 70% and allowed 80% more GPU utilization during training cycles.

These three announcements underscore an industry-wide effort to eliminate I/O bottlenecks that limit AI performance. Memory bandwidth, storage latency, and metadata management are becoming as critical as raw compute power. “We are hitting a wall where memory and storage are the constraining factors, not the processors themselves,” said Dr. Lisa Su, CEO of AMD, at a recent conference. “Innovations like HBM4E and advanced storage-class memory are essential to sustain the pace of AI progress.”

Looking ahead, Samsung’s HBM4E sampling gives it a potential first-mover advantage in the next memory cycle. Kioxia and HPE plan to demonstrate their space storage platform at the 2027 International Space Station Research and Development Conference. Peak:AIO expects to commercialize its metadata server in the second half of 2026. The convergence of faster memory, smarter storage, and metadata acceleration will define the next generation of AI infrastructure.

Frequently Asked Questions

HBM4E is the next generation of High Bandwidth Memory, offering up to 1.2 TB/s bandwidth and 48 GB per stack. It is designed to feed AI accelerators and high-performance computing with dramatically faster data transfer than HBM3E.

Samsung is currently sampling HBM4E to key customers. It plans to begin volume production in the first half of 2027, aiming to beat competitors to market.

Kioxia is providing Flash Memory and Storage Class Memory for HPE's ProLiant servers and space-qualified systems. This collaboration targets low-latency, high-endurance storage for edge AI and satellite data processing.

Large-scale AI training generates billions of metadata operations that traditional file systems cannot handle quickly. This bottleneck reduces GPU utilization as processors wait for data.

Peak:AIO and Los Alamos developed a metadata server using CXL that handles billions of metadata operations per second, cutting data staging time by 70% and boosting GPU utilization by 80%.

Original source

www.forbes.com

Read original

Discussion

Join the discussion

Sign in to post a comment or reply.

No comments yet. Be the first to share your thoughts!

Sign in
Enter your email to receive a one-time sign-in code. No password needed.
Email address