image: This is a game interface of the Alice Challenge. Players could manipulate three curves representing two laser beam intensities and the strength of a magnetic field gradient, respectively. The chosen curves were then realized in the laboratory in real-time. view more
Credit: Robert Heck, AU
Researchers developed a versatile remote gaming interface that allowed external experts as well as hundreds of citizen scientists all over the world through multiplayer collaboration and in real time to optimize a quantum gas experiment in a lab at Aarhus University. Surprisingly, both teams quickly used the interface to dramatically improve upon the previous best solutions established after months of careful experimental optimization. Comparing domain experts, algorithms and citizen scientists is a first step towards unravelling how humans solve complex, natural science problems.
In a future characterized by algorithms with ever increasing computational power, it becomes essential to understand the difference between human and machine intelligence. This will enable the development of hybrid-intelligence interfaces that optimally exploit the best of both worlds. By making complex research challenges available for contribution by the general public, citizen science does exactly this.
Numerous citizen science projects have shown that humans can compete with state-of-the-art algorithms in terms of solving complex, natural science problems. However, these projects have so far not addressed why a collective of citizen scientists can solve such complex problems.
An interdisciplinary team of researchers from Aarhus University, Ulm University, and the University of Sussex, Brighton have now taken important first steps in this direction by analyzing the performance and search strategy of both a state-of-the-art computer algorithm and citizen scientists in their real-time optimization of an experimental laboratory setting.
In the 'Alice Challenge', Robert Heck and colleagues in their quest for realizing quantum simulations enlisted the help of both experts and citizen scientists by providing live access to their ultra-cold quantum gas experiment.
This was made possible by using a novel remote interface created by the team at ScienceAtHome, Aarhus University. By manipulating laser beams and magnetic fields, the task was to cool as many atoms as possible down to extremely cold temperatures just above absolute zero at -273.15°C.
Surprisingly, both groups using the remote interface consistently outperformed the best solutions identified by the experimental team over months and years of careful optimization.
Why could players without any formal training in experimental physics manage to find surprisingly good solutions? One hint came from an interview with a top-player, a retired Italian microwave systems engineer. He said, that for him participating in the Alice Challenge reminded him a lot of his previous job as an engineer. He never attained a detailed understanding of microwave systems but instead spent years developing an intuition of how to optimize the performance of his "black-box".
"We humans may develop general optimization skills in our everyday work life that we can efficiently transfer to new settings. If this is true, any research challenge can in fact be turned into a citizen science game," said Jacob Sherson, head of the ScienceAtHome project at Aarhus University.
It still seems incredible that untrained amateurs using an unintuitive game interface outcompete expert experimentalists. One answer may lie in an old Herbert Simon quote: "Solving a problem simply means representing it so as to make the solution transparent".
In this view, the players may be performing better not because they have superior skills, but because the interface they are using makes another kind of exploration "the obvious thing to try out" compared to the traditional experimental control interface.
"The process of developing (fun) interfaces that allow experts and citizen scientists alike to view the complex research problems from different angles, may contain the key to developing future hybrid intelligence systems in which we make optimal use of human creativity" explained Jacob Sherson.
More concretely, the team set up a carefully constructed "social science in the wild" study which allowed them to quantitatively characterize the collective search behavior of the players. They concluded that what makes human problem solving unique is how a collective of individuals balance innovative attempts and refine existing solutions based on their previous performance.
Selected quotes from participating researchers:
Tommaso Calarco (Forschungszentrum Jülich/University of Cologne) and Simone Montangero (Padova University), leaders of the Ulm remote theory optimization team:
* "Making machines play alongside with humans over the internet required us to create a new software package for remote optimization of quantum experiments: RedCRAB. It worked so well that it is now applied in several labs around the world to enhance the performance of quantum devices. We plan to extend this as a cloud service that we believe will likely result in faster development of the theoretical understanding, of the algorithmic development and overall of quantum science and technologies."
Robert Heck, one of the lead scientists in designing the Alice Challenge and first author of the paper:
"This realizes the first ever citizen science experimental optimization challenge with real-time feedback in any field! It was also a challenge for us. As our participants came from all over the world we had to keep the experiment online for two weeks straight without interruptions."
Carsten Bergenholtz and Oana Vuculescu, Dep. of Management, Aarhus University:
* "These findings provide insight into the unique human ability to collectively solve complex problems. Leveraging this knowledge will allow for the design of hybrid intelligence interfaces that combine the computational strengths of AI with the advantages of human intuition."
Mark Bason, University of Sussex:
* "Progress in science is very frequently the result of close collaboration between established groups, such as those from academia or industry. However, technology has advanced so far that many new interactions are possible. By opening up our research, we can now benefit from the skills of players, algorithms and hybrid approaches of the two."
###
Journal
Proceedings of the National Academy of Sciences