image: Figure 1 Aim of Wireless Access Control with Lightweight AI in the Selected Project
Credit: © NII
News Highlights:
- NII and NTT’s application was selected by JST and by the French ANR for the Japan-France SICORP “Edge AI” research project.
- Through this program, NII and NTT will develop a radio access technology exploiting deep learning and reinforcement learning, and advance the R&D of wireless control methodologies using lightweight edge AI that can operate on small devices with limited capabilities.
- Edge AI-based wireless access control will enable high-quality wireless communications with higher data rate and reliability even when many devices are communicating in a dynamically varying environment, i.e., where the radio channel conditions change rapidly due to shielding shelves, pillars, people, moving machine tools, etc., such as in a factory.
Tokyo – March 18, 2024 – The National Institute of Informatics(NII) and NTT Corporation (NTT) , in cooperation with the CNRS Institut de Recherche en Informatique et Systèmes Aléatoires (IRISA) and Wavely, have been selected through an open call for proposal by the Japan Science and Technology Agency (JST) and by the French National Research Agency (ANR), under the framework of the Japan-France Strategic International Collaborative Research Program (SICORP) for “Edge AI”1. Our selected research project LIGHT-SWIFT2 will give rise to a power-saving, lightweight edge AI technology for jointly exploiting wireless communications and sensing in smart factories.
Through this research, we will develop a lightweight edge AI-based technology that can operate even on small devices and terminals with limited computation and battery capabilities, as well as a deep learning and reinforcement learning-based wireless access technology, stemming from the joint research outcomes we have achieved so far. We will advance research on intelligent wireless access technologies that can learn and adapt to the dynamic fluctuations of the devices’ surroundings. In particular, the proposed method will enable high-quality wireless communications even under challenging situations where many terminals need to communicate in an environment where radio channel conditions can degrade rapidly and in a complex manner, due to the effects of moving shelves, pillars, people, and machine tools inside factories.
1. Background
In the 6G era envisioned in 2030s, the use of Industrial Internet of Things (IIoT) terminals for factory automation and automated driving will expand, and wireless communications will become paramount for controlling and managing these devices. The quality of wireless communications varies from instant to instant depending on the ambient environment. Given this inherent instability, it is difficult to ensure reliable communications (minimal packet loss and low latency) among many connected IIoT terminals such that they meet strict quality of service requirements. In addition, to control the communications of many IIoT terminals, it is necessary to cope with their surrounding mobile environments that vary independently. Optimizing communications through centralized control poses the challenge of sending and receiving information from a massive number of devices, thereby consuming large amounts of power and bandwidth to manage the wireless access of all terminals in real-time.
2. Key points of the research
In the selected research project, we will develop a high-performance, low-power edge AI technology, namely a "lightweight AI" that can be used even by edge devices such as IoT terminals with low capabilities in terms of computation and battery, with the goal of optimizing their wireless communications and sensing. By doing so, we aim to establish technologies that can achieve stable and reliable communications despite the rapid and complex changes of mobile environments as in factories. Conventionally, it has been common to use base stations and controllers to manage communications in a centralized manner, but the proposed lightweight edge AI will enable many distributed terminals to optimize their wireless access and to rapidly react to the dynamic fluctuations of their mobile surroundings.
NII and NTT will develop a novel radio access technology using lightweight edge AI, building upon the reinforcement learning-based multi-radio access technology that they have designed through their joint research, and accelerate their research towards practical application. In this project, the goal is to reduce the power consumption at edge devices to ½, and to reduce the convergence speed of reinforcement learning to ½, as compared to the current benchmark method.
3. Multi-radio access technology exploiting risk-averse reinforcement learning
Through this collaboration research, NII and NTT have developed a multi-radio access technology based on the Risk-Averse Q-learning (RA-QL)3 method, one of the advanced reinforcement learning methods. As shown in Figure 2, the proposed RA-QL-based wireless access method reacts sensitively to packet losses of the wireless links. In wireless communications with multiple radio interfaces, the proposed method leverages RA-QL to enable each access point to autonomously select the best interface and the amount of transmit packets, in order to achieve reliable communications. This technology hence enables to control wireless packet transmissions, according to the varying conditions of the mobile environment surrounding each access point and terminal. Through computer simulations, it was confirmed that the target packet loss rate could be achieved for base stations and terminals equipped by radio interfaces over two frequency bands, sub-6GHz and millimeter waves.3 In addition, we have proposed a wireless access method that exploits deep reinforcement learning (e.g., Deep Q-Network) designed for edge AI, namely with a small-scale Deep Q-Network in order to achieve lower processing and energy consumption. These research outcomes have been published in a top international journal of the field.4
4. Roles of each institution
・NII: Design and evaluation of the core algorithm for this technology, represents the Japanese organization of the Principal Investigator (PI) for SICORP (PI: Assoc. Prof. Megumi KANEKO)
・NTT: Discussion on the creation of this technology in the joint research, examination of applicable architecture, and experimental evaluation (co-PI : Dr. Yasushi TAKATORI)
5. Outlook
We will further advance our research on smart wireless access technologies exploiting lightweight edge AI, to provide high-quality wireless communications even when many terminals need to communicate in a complex mobile environment, while realizing large energy savings. Through our selected research project that builds upon these technologies, we aim to further establish practical edge AI-based technologies for future smart factories.
1 JST Press Release #1657 JST and ANR (France) jointly fund three research projects in the Edge AI field under the Strategic International Collaborative Research Program (SICORP) framework
https://www.jst.go.jp/pr/info/info1657/pdf/info1657_en.pdf
2 LIGHT-SWIFT: LIGHTweight edge artificial intelligence for Sensing and WIreless communications in connected FacTories
3 T. H. L. Dinh, M. Kaneko, K. Kawamura, T. Moriyama and Y. Takatori, "Improving Reliability by Risk-Averse Reinforcement Learning over Sub6GHz/mmWave Integrated Networks," ICC 2022 - IEEE International Conference on Communications, Seoul, Korea, Republic of, 2022, pp. 3178-3183.
4 M. Kaneko, T. H. Ly Dinh, K. Kawamura, T. Moriyama and Y. Takatori, "Wireless Multi-Interface Connectivity with Deep Learning-Enabled User Devices: An Energy Efficiency Perspective," in IEEE Network, vol. 37, no. 3, pp. 132-139, May/June 2023.
###
About NTT
NTT contributes to a sustainable society through the power of innovation. We are a leading global technology company providing services to consumers and business as a mobile operator, infrastructure, networks, applications, and consulting provider. Our offerings include digital business consulting, managed application services, workplace and cloud solutions, data center and edge computing, all supported by our deep global industry expertise. We are over $97B in revenue and 330,000 employees, with $3.6B in annual R&D investments. Our operations span across 80+ countries and regions, allowing us to serve clients in over 190 of them. We serve over 75% of Fortune Global 100 companies, thousands of other enterprise and government clients and millions of consumers.
About the National Institute of Informatics (NII)
NII is Japan's only academic research institute dedicated to the new discipline of informatics. Its mission is to "create future value" in informatics. NII conducts both long-term basic research and practical research aimed at solving social problems in a wide range of informatics research fields, from fundamental theories to the latest topics, such as artificial intelligence, big data, the Internet of Things, and information security.
As an inter-university research institute, NII builds and operates academic information infrastructure essential for the research and educational activities of the entire academic community (including the Science Information Network) as well as developing services such as those that enable the provision of academic content and service platforms.https://www.nii.ac.jp/en/
About the Research Organization of Information and Systems (ROIS)
ROIS is a parent organization of four national institutes (National Institute of Polar Research, National Institute of Informatics, the Institute of Statistical Mathematics and National Institute of Genetics) and the Joint Support-Center for Data Science Research. It is ROIS's mission to promote integrated, cutting-edge research that goes beyond the barriers of these institutions, in addition to facilitating their research activities, as members of inter-university research institutes.