Introducing Samsung's AI Computing 24GB GDDR7 DRAM

 

24 GB of GDDR7 DRAM

AI Computing of the Future: Samsung Introduces 24GB GDDR7 DRAM. Because of its industry-leading capacity and performance of over 40Gbps, it sets the bar for graphics DRAM.

The first 24-gigabit (Gb) GDDR7 DRAM was unveiled today by memory pioneer Samsung. Its speed and capacity are advantageous for applications of the next generation. The 24Gb GDDR7 will be used in data centers, AI workstations, graphics cards, gaming consoles, and autonomous vehicles because to its enormous capacity and superior performance.

"It will continue to lead the graphics DRAM market by launching next-generation products that satisfy the growing demands of the AI market." The 24Gb GDDR7's 5th-generation 10-nanometer (nm)-class DRAM maintains the same package footprint as the previous model while enabling a 50% increase in cell density.

The advanced manufacturing node and three-level Pulse-Amplitude Modulation (PAM3) signaling contribute to the industry-leading graphics DRAM performance of 40 gigabits per second (Gbps), which is a 25% improvement over the previous version. Depending on the context in which it is used, its performance might be further enhanced to 42.5 Gbps.

Power efficiency is also increased when technology that was previously used in mobile devices is applied to graphics DRAM for the first time. By decreasing unnecessary power consumption via the use of strategies like dual VDD design and clock control management, power efficiency may be raised by more than 30%.

Power gating design techniques are used by the 24Gb GDDR7 to reduce current leakage and improve operational stability while operating at high speeds.

In order to market the technology early the next year, major GPU customers will begin verifying the 24Gb GDDR7 in next-generation AI computing systems this year.

Comparing GDDR6 and GDDR7

GDDR7 promises a 1.4-fold boost in performance and a 20% gain in power efficiency over the present 24Gbps GDDR6 DRAM.

Samsung Electronics, a world leader in advanced semiconductor technology, said today that it has completed the development of the first Graphics Double Data Rate 7 (GDDR7) DRAM available for purchase. It will be first deployed in significant customers' next-generation systems this year for validation, bolstering Samsung's technological leadership in the sector and driving the graphics market's future growth.

Following the release of the first 24Gbps GDDR6 DRAM in 2022, Samsung's 16-gigabit (Gb) GDDR7 DRAM will provide the highest speed in the industry to date. New advancements in integrated circuit (IC) design and packaging provide greater stability even in high-speed operations.

Samsung's GDDR7 achieves an impressive 1.5 terabytes per second (TBps), which is 1.4 times faster than GDDR6's 1.1 TBps, with a performance gain per pin of up to 32Gbps. Instead of using the Non Return to Zero (NRZ) signaling approach from previous generations, the new memory standard uses the Pulse Amplitude Modulation (PAM3) signaling mechanism, which enables the enhancements. PAM3 allows 50% more data to be sent in a single signaling cycle than NRZ.

Notably, the new architecture is 20% more energy efficient than GDDR6 thanks to power-saving design features developed for high-speed operations. For gadgets like laptops where power conservation is a major issue, Samsung offers a low-operating voltage option.

To minimize heat output, the packaging material employs an epoxy molding compound (EMC) with superior thermal conductivity in addition to improving the IC design. These improvements drastically reduce heat resistance by 70% when compared to GDDR6, guaranteeing dependable product performance even at high operating speeds.

Date of GDDR7 Release

Samsung claims that early 2024 will see the start of commercial production of its 24GB GDDR7 DRAM. This year's certification procedure with key GPU manufacturers is well underway, even if the exact timing of public release is yet uncertain. It is currently anticipated that GDDR7 DRAM will be widely available in the market by 2024 due to the availability of next-generation GPUs that will support the new memory standard.

Samsung 24 GB GDDR7 Specs

Specification	Details
Memory Type	GDDR7 (Graphics Double Data Rate 7)
Capacity	24GB
Bandwidth	Over 40 Gbps per pin
Total Bandwidth	1.5 TB/s (terabytes per second)
Process Technology	Advanced node technology (likely EUV)
Power Efficiency	Improved over GDDR6 (reduced power usage)
Error Correction	Built-in ECC (Error-Correcting Code) support
Target Use Cases	AI computing, high-end GPUs, gaming, data centers
Validation	Ongoing with major GPU customers in 2024
Production Start	Early 2024