ETRI develops processor for real-time hologram generation

Korean researchers have developed a digital holography processor that converts two-dimensional (2D) videos into real-time three-dimensional (3D) holograms. This technology is expected to play a key role in the future of holography, as it enables the instantaneous transformation of ordinary 2D videos into 3D holograms.

Electronics and Telecommunications Research Institute (ETRI) has announced the development of a programmable semiconductor-based digital holographic media processor (RHP) using Field Programmable Gate Array (FPGA) technology. This processor can convert 2D video into 3D holograms in real-time.

The real-time holography processor is the world’s first to utilize high-bandwidth memory (HBM) to generate real-time, full-color 3D holograms from 2D video. Notably, all the hardware required for hologram generation is integrated into a single system-on-chip (SoC).

The real-time holography processor (RHP) extracts the three primary colors (red, green, and blue) and depth information from 2D video, then reconstructs holographic video information at 4K resolution with a latency of just 30 milliseconds (ms). It is capable of rendering holograms at a processing speed of up to 30 frames per second (FPS), positioning it among the most advanced holography processors in the world.

This processor performs complex numerical calculations for wave propagation to convert 2D information into 3D holograms. Notably, by utilizing high-performance HBM memory instead of DDR memory, the processor enables high-speed processing of large-scale complex-number holographic computations.

This breakthrough achieves high processing speeds and performance dozens of times faster than conventional software-based hologram generation on standard computers, while also significantly reducing power consumption.

In a demonstration using the real-time holographic media processor, the researchers confirmed that any video displayed on a computer screen—including YouTube/Netflix content, video calls, and more—could be converted into 3D holographic video without delay.

Through this research, ETRI has developed a core holographic media technology that enables real-time rendering of ultra-high-resolution holograms using dedicated hardware. Moving forward, the researchers plan to enhance this technology by integrating ▲ direct acquisition of natural light-based holograms and ▲ high-definition hologram rendering techniques.

ETRI researchers explained that they achieved this technological breakthrough after three years of research and development. The technology was showcased at the 2023 SID Display Week I-Zone exhibition and at SID Display Week 2024 in San Jose, USA, where it received an enthusiastic response from visitors.

Their research findings were also presented at SIGGRAPH Asia 2024 in Tokyo, Japan, last December, where they garnered significant attention. These achievements demonstrate that ETRI’s holographic processor technology has established itself as a groundbreaking innovation on the global stage.

Kwon Won Ok, the principal researcher at ETRI’s Digital Holography Research Section, stated, “Our goal is to develop a dedicated holographic media processor chip (ASIC) for general-purpose holographic displays by incorporating hardware-based holographic image enhancement technology in the future.”

Hong Kee Hoon, the director of ETRI’s Digital Holography Research Section, added, “The development of the holography processor will enable the creation of real-time holograms with low power consumption and a compact form factor, marking a significant step toward the practical application of holography technology.”

This achievement was part of the “Development of Holo-TV Core Technologies for Hologram Media Services” supported by the Ministry of Science and ICT and the Institute of Information & Communications Technology Planning & Evaluation.

1) Hologram: A technology that uses light interference and diffraction to record and play back color and depth information of three-dimensional objects

3) FPGA (Field Programmable Gate Array): A semiconductor that can program programmable hardware elements used in the stage before making logic semiconductors into dedicated SoCs

2) RHP (Digital Holography Media Processor): A hardware device that converts 2D video or 3D computer graphics into holographic video in real time

4) HBM (High Bandwidth Memory): High-bandwidth, high-performance memory with 3D stacked DRAM for AI training and more

5) FPS (frame per second): Frames per second. 30 FPS means the screen is redrawn 30 times per second

6) DDR (Double Data Rate): A memory technology that can perform two data transfers per clock cycle, doubling the transfer rate of traditional synchronous dynamic random access memory (SDRAM)

###

The researchers anticipate that this technology will be widely applied in holographic automotive head-up displays (HUDs), holographic virtual reality/mixed reality (VR/MR) devices, and other holographic media systems. They also plan to transfer the technology to industry partners for further commercialization.