image: From left to right, the trajectory of a double pendulum, the prediction results using a conventional artificial neural network, and those using the method proposed in this study. The conventional artificial neural network was unable to discover that the length of the pendulum rod remains constant, and errors accumulated over time. The proposed method found and preserved this law. view more
Credit: Takashi Matsubara, Takaharu Yaguchi
Osaka, Japan – Many real-world systems, from climate systems to the physical mechanisms of robots, are governed by the invariant quantities that arise from their underlying geometric structures. Modelling these systems using computer simulations is a key tool for understanding them (for weather forecasting, for instance, or developing robot locomotion). It’s often possible to collect data for these systems, but making sense of those data to build a model is a more challenging task.
Artificial intelligence has long been used to analyze the data of systems with known conservation laws. However, in the real world, these laws are often unknown. To address this problem, researchers from Osaka University developed an algorithm named as FINDE, which not only finds the quantities of known laws, but also those of unknown ones, which could lead to scientific discoveries.
FINDE assumes invariant quantities and projects the dynamics into the tangent space of a manifold defined by the quantities. This allows FINDE to learn these dynamics and invariant quantities jointly, preserving the conservation laws. Real-world systems are continuous systems, but numerical computer algorithms can only model discrete systems, which can lead to errors and ultimately reduce the accuracy of simulations. Hence, FINDE also uses discrete gradients, which are defined in discrete time, to define the discrete counterpart of the tangent space, and then it can be used without accumulating errors.
“Because FINDE learns and preserves the conservation laws of a system,” says Prof. Takashi Matsubara, first author of the study, “our computer simulations will be more accurate over the long term.”
However, FINDE is about more than just reducing modelling errors. If the laws governing a system are unknown, the number of laws might also be unknown. FINDE can be used to determine this number by testing the accuracy of models with different numbers of laws. “This reveals additional information about the underlying structure of a system,” says Prof. Matsubara, and that could lead to scientific discoveries about the systems under study.
The researchers tested the ability of FINDE to discover and model systems on a variety of datasets. A two-body gravitational system, shallow water waves, a double pendulum, and the electrical circuit model of a biological neuron were all considered. FINDE was able to find and preserve the first integrals that arise from the conservation laws governing these systems in all cases. As a result, FINDE is expected to contribute to the acceleration and sophistication of future computer-aided engineering and physics simulations.
###
The article, “FINDE: Neural Differential Equations for Finding and Preserving Invariant Quantities,” will be presented at the 2023 International Conference on Learning Representations.
About Osaka University
Osaka University was founded in 1931 as one of the seven imperial universities of Japan and is now one of Japan's leading comprehensive universities with a broad disciplinary spectrum. This strength is coupled with a singular drive for innovation that extends throughout the scientific process, from fundamental research to the creation of applied technology with positive economic impacts. Its commitment to innovation has been recognized in Japan and around the world, being named Japan's most innovative university in 2015 (Reuters 2015 Top 100) and one of the most innovative institutions in the world in 2017 (Innovative Universities and the Nature Index Innovation 2017). Now, Osaka University is leveraging its role as a Designated National University Corporation selected by the Ministry of Education, Culture, Sports, Science and Technology to contribute to innovation for human welfare, sustainable development of society, and social transformation.
Website: https://resou.osaka-u.ac.jp/en
Method of Research
Computational simulation/modeling
Subject of Research
Not applicable