Thumbs-up for mind-controlled robotic arm

A paralysed woman who controlled a robotic arm using just her thoughts has taken another step towards restoring her natural movements by controlling the arm with a range of complex hand movements.

Thanks to researchers at the University of Pittsburgh, Jan Scheuermann, who has longstanding quadriplegia and has been taking part in the study for over two years, has gone from giving "high fives" to the "thumbs-up" after increasing the manoeuvrability of the robotic arm from seven dimensions (7D) to 10 dimensions (10D).

The extra dimensions come from four hand movements--finger abduction, a scoop, thumb extension and a pinch--and have enabled Jan to pick up, grasp and move a range of objects much more precisely than with the previous 7D control.

A video of Jan controlling the robotic arm can be viewed here - https://www.dropbox.com/sh/mvccgkvorjo8xjn/AAAd5oNMG2P8ZLHAwPs7czPCa?dl=0

It is hoped that these latest results, which have been published today, 17 December, in IOP Publishing's Journal of Neural Engineering, can build on previous demonstrations and eventually allow robotic arms to restore natural arm and hand movements in people with upper limb paralysis.

Jan Scheuermann, 55, from Pittsburgh, PA had been paralysed from the neck down since 2003 due to a neurodegenerative condition. After her eligibility for a research study was confirmed in 2012, Jan underwent surgery to be fitted with two quarter-inch electrode grids, each fitted with 96 tiny contact points, in the regions of Jan's brain that were responsible for right arm and hand movements.

After the electrode grids in Jan's brain were connected to a computer, creating a brain-machine interface (BMI), the 96 individual contact points picked up pulses of electricity that were fired between the neurons in Jan's brain.

Computer algorithms were used to decode these firing signals and identify the patterns associated with a particular arm movement, such as raising the arm or turning the wrist.

By simply thinking of controlling her arm movements, Jan was then able to make the robotic arm reach out to objects, as well as move it in a number of directions and flex and rotate the wrist. It also enabled Jan to "high five" the researchers and feed herself dark chocolate.

Two years on from the initial results, the researchers at the University of Pittsburgh have now shown that Jan can successfully manoeuvre the robotic arm in a further four dimensions through a number of hand movements, allowing for more detailed interaction with objects.

The researchers used a virtual reality computer program to calibrate Jan's control over the robotic arm, and discovered that it is crucial to include virtual objects in this training period in order to allow reliable, real-time interaction with objects.

Co-author of the study Dr Jennifer Collinger said: "10D control allowed Jan to interact with objects in different ways, just as people use their hands to pick up objects depending on their shapes and what they intend to do with them. We hope to repeat this level of control with additional participants and to make the system more robust, so that people who might benefit from it will one day be able to use brain-machine interfaces in daily life.

"We also plan to study whether the incorporation of sensory feedback, such as the touch and feel of an object, can improve neuroprosthetic control."

Commenting on the latest results, Jan Scheuermann said: ""This has been a fantastic, thrilling, wild ride, and I am so glad I've done this."

"This study has enriched my life, given me new friends and co-workers, helped me contribute to research and taken my breath away. For the rest of my life, I will thank God every day for getting to be part of this team."

###

From Wednesday 17 December, this paper can be downloaded from http://iopscience.iop.org/1741-2552/12/1/016011

Notes to Editors

Contact

1. For further information, a full draft of the journal paper or contact with one of the researchers, contact IOP Press Officer, Michael Bishop: Tel: 0117 930 1032 E-mail: michael.bishop@iop.org . For more information on how to use the embargoed material above, please refer to our embargo policy.

IOP Publishing Journalist Area

2. The IOP Publishing Journalist Area gives journalists access to embargoed press releases, advanced copies of papers, supplementary images and videos. In addition to this, a weekly news digest is uploaded into the Journalist Area every Friday, highlighting a selection of newsworthy papers set to be published in the following week. Login details also give free access to IOPscience, IOP Publishing's journal platform. To apply for a free subscription to this service, please email Michael Bishop, IOP Press Officer, michael.bishop@iop.org, with your name, organisation, address and a preferred username.

10 dimensional anthropomorphic arm control in a human brain-machine interface: difficulties, solutions and limitations

3. The published version of the paper '10 dimensional anthropomorphic arm control in a human brain-machine interface: difficulties, solutions and limitations' Wodlinger et al 2015 J. Neural Eng. 12 016011 will be freely available online from Wednesday 17 December. It will be available at http://iopscience.iop.org/1741-2552/12/1/016011

Journal of Neural Engineering

4. J. Neural Eng. was developed to help scientists, clinicians and engineers to understand, replace, repair and enhance the nervous system. The journal encompasses experimental, computational, theoretical, clinical and applied aspects of neural engineering. J. Neural Eng. is an essential point of reference for researchers working in biomedical engineering, neuroscience, neurobiology and neurology.

IOP Publishing

5. IOP Publishing provides publications through which leading-edge scientific research is distributed worldwide.

Beyond our traditional journals programme, we make high-value scientific information easily accessible through an ever-evolving portfolio of books, community websites, magazines, conference proceedings and a multitude of electronic services. IOP Publishing is central to the Institute of Physics, a not-for-profit society. Any financial surplus earned by IOP Publishing goes to support science through the activities of the Institute. Go to ioppublishing.org.

Access to Research

6. Access to Research is an initiative through which the UK public can gain free, walk-in access to a wide range of academic articles and research at their local library. This article is freely available through this initiative. For more information, go to http://www.accesstoresearch.org.uk.

The Institute of Physics

6. The Institute of Physics is a leading scientific society. We are a charitable organisation with a worldwide membership of more than 50,000, working together to advance physics education, research and application.

We engage with policymakers and the general public to develop awareness and understanding of the value of physics and, through IOP Publishing, we are world leaders in professional scientific communications.

In September 2013, we launched our first fundraising campaign. Our campaign, Opportunity Physics, offers you the chance to support the work that we do.

---

---