From square to cube: Hardware processing for AI goes 3D, boosting processing power

• A breakthrough development in photonic-electronic hardware could significantly boost processing power for AI and machine learning applications.
• The approach uses multiple radio frequencies to encode data, enabling multiple calculations to be carried out in parallel.
• The method shows promise for outperforming state-of-the-art electronic processors, with further enhancements possible.

In a paper published today in Nature Photonics, researchers from the University of Oxford, along with collaborators from the Universities of Muenster, Heidelberg, and Exeter, report on their development of integrated photonic-electronic hardware capable of processing three-dimensional (3D) data, substantially boosting data processing parallelism for AI tasks.

Conventional computer chip processing efficiency doubles every 18 months, but the processing power required by modern AI tasks is currently doubling around every 3.5 months. This means that new computing paradigms are urgently needed to cope with the rising demand.

One approach is to use light instead of electronics – this allows multiple calculations to be carried out in parallel using different wavelengths to represent different sets of data. Indeed, in ground breaking work published in the journal Nature in 2021, many of the same authors demonstrated a form of integrated photonic processing chip that could carry out matrix vector multiplication (a crucial task for AI and machine learning applications) at speeds far outpacing the fastest electronic approaches. This work resulted in the birth of the photonic AI company, Salience Labs, a spin-out from the University of Oxford.

Now the team has gone further by adding an extra parallel dimension to the processing capability of their photonic matrix-vector multiplier chips. This “higher-dimensional” processing is enabled by exploiting multiple different radio frequencies to encode the data, propelling parallelism to a level far beyond that previously achieved.

As a test case the team applied their novel hardware to the task of assessing the risk of sudden death from electrocardiograms of heart disease patients. They were able to successfully analyse 100 electrocardiogram signals simultaneously, identifying the risk of sudden death with a 93.5% accuracy.

The researchers further estimated that even with a moderate scaling of 6 inputs × 6 outputs, this approach can outperform state-of-the-art electronic processors, potentially providing a 100-times enhancement in energy efficiency and compute density. The team anticipates further enhancement in computing parallelism in the future, by exploiting more degrees of freedom of light, such as polarization and mode multiplexing.

First author Dr Bowei Dong at the Department of Materials, University of Oxford said: ‘We previously assumed that using light instead of electronics could increase parallelism only by the use of different wavelengths – but then we realised that using radio frequencies to represent data opens up yet another dimension, enabling superfast parallel processing for emerging AI hardware.’

Professor Harish Bhaskaran, Department of Materials, University of Oxford and CO-founder of Salience Labs, who led the work said: ‘This is an exciting time to be doing research in AI hardware at the fundamental scale, and this work is one example of how what we assumed was a limit can be further surpassed.’

Notes to editors:

For media inquiries, and requests for interviews and images, contact:

Professor Harish Bhaskaran: harish.bhaskaran@materials.ox.ac.uk  

Dr Bowei Dong: bowei.dong@materials.ox.ac.uk

Images and a video that can be used to illustrate articles can be found in this folder: https://www.dropbox.com/scl/fo/m75330lte6qh3y9ik9gu0/h?rlkey=viuzqyym4au8rgikra2kgqob8&dl=0  The caption for the images is ‘Artistic rendering of a photonic chip with both light and RF frequency encoding data. Credit: B.Dong/ University of Oxford.’

The study ‘Higher-dimensional processing using a photonic tensor core with continuous-time data’ will be published in Nature Photonics at 16:00 BST/ 11:00 ET Thursday 19 October 2023 at https://www.nature.com/articles/s41566-023-01313-x. To view a copy of the manuscript under embargo, see: https://www.dropbox.com/scl/fo/m75330lte6qh3y9ik9gu0/h?rlkey=viuzqyym4au8rgikra2kgqob8&dl=0  

The work was supported by the EU Horizon 2020 PHOENICS project (Grant No. 101017237) and the EU Innovation Council Pathfinder project HYBRAIN (Grant No. 101046878).

About the University of Oxford

Oxford University has been placed number 1 in the Times Higher Education World University Rankings for the eighth year running, and ​number 3 in the QS World Rankings 2024. At the heart of this success are the twin-pillars of our ground-breaking research and innovation and our distinctive educational offer.

Oxford is world-famous for research and teaching excellence and home to some of the most talented people from across the globe. Our work helps the lives of millions, solving real-world problems through a huge network of partnerships and collaborations. The breadth and interdisciplinary nature of our research alongside our personalised approach to teaching sparks imaginative and inventive insights and solutions.

Through its research commercialisation arm, Oxford University Innovation, Oxford is the highest university patent filer in the UK and is ranked first in the UK for university spinouts, having created more than 300 new companies since 1988. Over a third of these companies have been created in the past five years. The university is a catalyst for prosperity in Oxfordshire and the United Kingdom, contributing £15.7 billion to the UK economy in 2018/19, and supports more than 28,000 full time jobs.