Samsung to launch 3D HBM chip packaging service in 2024

Samsung Foundry Forum 2024 took place in San Jose on June 12

SAN JOSE — Samsung Electronics Co. will launch three-dimensional (3D) packaging services for high-bandwidth memory (HBM) within the year, a technology expected to be introduced for the artificial intelligence chip’s sixth-generation model HBM4 due in 2025, according to the company and industry sources.

On June 20, the world’s largest memory chipmaker unveiled its latest chip packaging technology and service roadmaps at the Samsung Foundry Forum 2024 held in San Jose, California.

It was the first time Samsung to release the 3D packaging technology for HBM chips in a public event. Currently, HBM chips are packaged mainly with the 2.5D technology. 

It came about two weeks after Nvidia co-founder and Chief Executive Jensen Huang unveiled the new-generation architecture of its AI platform Rubin during a speech in Taiwan.

HBM4 will likely be embedded in Nvidia’s new Rubin GPU model expected to hit the market in 2026.

VERTICAL CONNECTION

Samsung’s latest packaging technology features HBM chips stacked vertically on top of a GPU to further accelerate data learning and inference processing, a technology regarded as a game changer in the fast-growing AI chip market.

Currently, HBM chips are horizontally connected with a GPU on a silicon interposer under the 2.5D packaging technology.

By comparison, 3D packaging does not require a silicon interposer, or a thin substrate that sits between chips to allow them to communicate and work together.

Samsung dubs its new packaging technology as SAINT-D, short for Samsung Advanced Interconnection Technology-D.

Samsung’s foundry business chief Choi Si-young unveils new chipmaking technology at Samsung Foundry Forum (SFF) 2024 in San Jose

TURNKEY SERVICE

The South Korean company is understood to offer 3D HBM packaging on a turnkey basis.

To do so, its advanced packaging team will vertically interconnect HBM chips produced at its memory business division with GPUs assembled for fabless companies by its foundry unit.

“3D packaging reduces power consumption and processing delays, improving the quality of electrical signals of semiconductor chips,” said a Samsung Electronics official.

In 2027, Samsung plans to introduce all-in-one heterogeneous integration technology that incorporates optical elements that dramatically increase the data transmission speed of semiconductors into one unified package of AI accelerators.

In line with the growing demand for low-power, high-performance chips, HBM is projected to make up 30% of the DRAM market in 2025 from 21% in 2024, according to TrendForce, a Taiwanese research company.

MGI Research forecast the advanced packaging market, including 3D packaging, to grow to $80 billion by 2032, compared with $34.5 billion in 2023.

By Jeong-Soo Hwang

hjs@hankyung.com

Yeonhee Kim edited this article

Latest News from Korea

Latest Entertainment from Korea

Learn People & History of Korea

  • A Journey Through Time: The History of Korean Art
    Introduction to Korean Art Korean art, a vital reflection of the nation’s rich heritage and cultural evolution, holds a unique place within the broader tapestry of East Asian art forms. Distinguished by its innovative spirit and aesthetic principles, Korean art dates back thousands of years, offering insights into the historical context and socio-political dynamics of the region. As both a… Read more: A Journey Through Time: The History of Korean Art
  • A South Korean soldier forcibly cuts a young man’s hair in front of others during a nationwide crackdown on men with long hair and women wearing short skirts in South Korea – 1970s
    This was during the Fourth Republic of South Korea. The President Park Chung-hee was declared dictator of South Korea for 18 years until he was assassinated and replaced in a coup-de-etat for about 3 years. I’ll post some links about it: https://en.wikipedia.org/wiki/Fourth_Republic_of_Korea https://en.wikipedia.org/wiki/Park_Chung-hee https://en.wikipedia.org/wiki/Assassination_of_Park_Chung-hee submitted by /u/goodhot0006 [link] [comments]
  • Jeong Cheol
    Introduction to Jeong Cheol Jeong Cheol, a prominent figure in Korean history, emerged during the Joseon Dynasty, which lasted from 1392 to 1910. His life, spanning from 1536 to 1593, encapsulates an era rich in cultural and intellectual development. As a scholar, poet, and government official, Jeong Cheol’s influence was significant, embodying the complexities of Confucian philosophy and its application… Read more: Jeong Cheol
  • From War to Miracles: The Evolution of South Korea Amidst Global Struggles
    The End of the Korean War: A Historical Overview The Korean War, which began in 1950, was a significant conflict that arose from the geopolitical tensions following World War II. The war pitted North Korea, backed by the Soviet Union and China, against South Korea, supported by the United States and other United Nations member states. The culmination of this… Read more: From War to Miracles: The Evolution of South Korea Amidst Global Struggles
  • Lee Hwang
    Introduction to Lee Hwang Lee Hwang (퇴溪 李滉), regarded as one of Korea’s foremost Confucian scholars of the 16th century, made significant strides in the development of Confucian thought and education. Born in 1501, he emerged from a distinguished family in the region of Gyeonggi Province, an area where Confucianism was gaining prominence as a guiding ethical framework. His early… Read more: Lee Hwang