Login / Register

Username:


Password: [Lost?]



New User? Click here for your FREE subscription



Healthcare Professionals
Healthcare Professionals Healthcare Professionals

Follow Us


NEWS-Line on Twitter NEWS-Line on Facebook NEWS-Line on Google+ NEWS-Line on LinkedIn NEWS-Line on Pinterest


Healthcare Conferences &
Educational Opportunities











Dec. 27, 2020 - 31

Skin, Bones, Hearts & Private Parts - CME NOW OnDemand

Skin, Bones, Heart & Private Parts

July 28 - 28, 2022

Primary Care Focus Symposium Online

Baptist Health South Florida

Sept. 14 - 17

Skin, Bones, Heart & Private Parts - Pensacola, FL

Skin, Bones, Heart & Private Parts

Oct. 5 - 08

Skin, Bones, Heart & Private Parts - San Antonio, TX

Skin, Bones, Heart & Private Parts

Oct. 25 - 28

Skin, Bones, Heart & Private Parts - Orlando, FL

Skin, Bones, Heart & Private Parts

More Events

Composing Thoughts: Mental Handwriting Produces Brain Activity That Can Be Turned Into Text | NEWS-Line for Healthcare Professionals

Composing Thoughts: Mental Handwriting Produces Brain Activity That Can Be Turned Into Text


Source:

NIH BRAIN Initiative-funded project could help people with paralysis to communicate.

Scientists have developed a brain-computer interface (BCI) designed to restore the ability to communicate in people with spinal cord injuries and neurological disorders such as amyotrophic lateral sclerosis (ALS). This system has the potential to work more quickly than previous BCIs, and it does so by tapping into one of the oldest means of communications we have — handwriting.

The study, published in Nature, was funded by the National Institutes of Health’s Brain Research Through Advancing Innovative Neurotechnologies® (BRAIN) Initiative as well as the National Institute of Neurological Disorders and Stroke (NINDS) and the National Institute on Deafness and Other Communication Disorders (NIDCD), both part of the NIH.

Researchers focused on the part of the brain that is responsible for fine movement and recorded the signals generated when the participant attempted to write individual letters by hand. In doing so, the participant, who is paralyzed from the neck down following a spinal cord injury, trained a machine learning computer algorithm to identify neural patterns representing individual letters. While demonstrated as a proof of concept in one patient so far, this system appears to be more accurate and more efficient than existing communication BCIs and could help people with paralysis rapidly type without needing to use their hands.

“This study represents an important milestone in the development of BCIs and machine learning technologies that are unraveling how the human brain controls processes as complex as communication,” said John Ngai, Ph.D., director of the NIH BRAIN Initiative. “This knowledge is providing a critical foundation for improving the lives of others with neurological injuries and disorders.”

When a person becomes paralyzed due to spinal cord injury, the part of the brain that controls movement still works. This means that, while the participant could not move his hand or arm to write, his brain still produced similar signals related to the intended movement. Similar BCI systems have been developed to restore motor function through devices like robotic arms.

“Just think about how much of your day is spent on a computer or communicating with another person,” said study co-author Krishna Shenoy, Ph.D., a Howard Hughes Medical Institute (HHMI) Investigator and the Hong Seh and Vivian W. M. Lim Professor at Stanford University. “Restoring the ability of people who have lost their independence to interact with computers and others is extremely important, and that is what is bringing projects like this one front and center.”

Researchers have, for the first time, decoded the neural signals associated with writing letters, then displayed typed versions of those letters in real time. They hope their invention could one day help people with paralysis communicate.

First, the participant was asked to copy letters that were displayed on the screen, which included the 26 lower-case letters along with some punctuation: “>” which was used as a space and “~” which was used as a “full stop.” At the same time, implanted electrodes recorded the brain activity from approximately 200 individual neurons that responded differently while he mentally “wrote” each individual character. After a series of training sessions, the BCI’s computer algorithms learned how to recognize neural patterns corresponding to individual letters, allowing the participant to “write” new sentences that hadn’t been printed out before, with the computer displaying the letters in real time.

“This method is a marked improvement over existing communication BCIs that rely on using the brain to move a cursor to “type” words on a screen,” said Frank Willett, Ph.D., an HHMI Research Scientist at Stanford University and the study’s lead author. “Attempting to write each letter produces a unique pattern of activity in the brain, making it easier for the computer to identify what is being written with much greater accuracy and speed.”

Using this system, the participant was able to compose sentences and communicate with others at a speed of about 90 characters per minute, comparable to someone of a similar age typing on a smartphone. In contrast, “point-and-click” interfaces have only achieved about 40 characters per minute.

Study participants were asked to write the same sentence using a novel handwriting-based brain-computer interface or an existing interface based on “pointing and clicking” on a virtual keyboard. The new interface is approximately twice as fast as the existing system.

This system also provides a level of flexibility that is crucial to restoring communication. Some studies have gone as far as attempting direct thought-to-speech BCIs that, while promising, are currently limited by what is possible through recordings from the surface of the brain which averages responses across thousands of neurons.

“Right now, other investigators can achieve about a 50-word dictionary using machine learning methods when decoding speech,” said Dr. Shenoy. “By using handwriting to record from hundreds of individual neurons, we can write any letter and thus any word which provides a truly ‘open vocabulary’ that can be used in most any life situation.”

For individuals who are paralyzed or living with “locked-in syndrome” due to brainstem stroke or late-stage ALS, the ability to communicate is largely or even completely lost without technological intervention. While preliminary, the technologies being developed here offer the potential to help those who have completely lost the ability to write and speak.

“Communication is central to how we function in society,” said Debara L, Tucci, M.D., M.S., M.B.A, director, NIDCD. “In today’s world of internet-based communication, people with severe speech and physical impairments can face significant communication barriers and, potentially, isolation. We hope these findings will encourage commercial development of this latest BCI technology.”

In the future, Dr. Shenoy’s team intends to test the system on a patient who has lost the ability to speak, such as someone with advanced ALS. In addition, they are looking to increase the number of characters available to the participants (such as capital letters and numbers).

The clinical trial, called BrainGate2, a collaboration of internationally recognized laboratories, universities, and hospitals working to advance brain-computer interface technologies, is testing the safety of BCIs that directly connect a person’s brain to a computer. The study was a collaboration between Dr. Shenoy’s and Jaimie Henderson, M.D.’s research group at Stanford University, Leigh Hochberg, M.D., Ph.D. from Brown University, Massachusetts General Hospital, and Providence VA and sponsor-investigator of the BrainGate2 trial. Dr. Henderson at Stanford University also performed the surgery to place the necessary electrodes.

“Thanks to the pioneering spirit of the participants in BrainGate, we are able to gain new insights into human brain function, which could lead to the creation of systems that will help others with paralysis,” said Dr. Hochberg.

This study was funded by the National Institutes of Health through the NIH BRAIN Initiative, NINDS, and NIDCD (NS095548, NS098968, DC009899, DC017844, DC014034, DC017844), HHMI, US Department of Veterans Affairs, L. and P. Garlick, S. and B. Reeves, the Wu Tsai Neurosciences Institute at Stanford University, and the Simons Foundation Collaboration on the Global Brain.

The NIH BRAIN Initiative® is managed by 10 institutes whose missions and current research portfolios complement the goals of The BRAIN Initiative®: National Center for Complementary and Integrative Health, National Eye Institute, National Institute on Aging, National Institute on Alcohol Abuse and Alcoholism, National Institute of Biomedical Imaging and Bioengineering, Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institute on Drug Abuse, National Institute on Deafness and other Communication Disorders, National Institute of Mental Health, and National Institute of Neurological Disorders and Stroke.

NINDS is the nation’s leading funder of research on the brain and nervous system. The mission of NINDS is to seek fundamental knowledge about the brain and nervous system and to use that knowledge to reduce the burden of neurological disease.

About the National Institute on Deafness and Other Communication Disorders (NIDCD): Advancing the science of communication to improve lives, the NIDCD supports and conducts research and research training on the normal and disordered processes of hearing, balance, taste, smell, voice, speech, and language and provides health information, based upon scientific discovery, to the public.

About the National Institutes of Health (NIH): NIH, the nation's medical research agency, includes 27 Institutes and Centers and is a component of the U.S. Department of Health and Human Services. NIH is the primary federal agency conducting and supporting basic, clinical, and translational medical research, and is investigating the causes, treatments, and cures for both common and rare diseases. For more information about NIH and its programs, visit www.nih.gov..

NIH…Turning Discovery Into Health®

Article
Willett FR et al., “High-performance brain-to-text communication via handwriting.” Nature. May 12, 2021. DOI: 10.1038/s41586-021-03506-2

Source/Image: National Institutes of Health (NIH)/Shenoy Lab & Erika Woodrum (artist)

Pictured: Cartoon of man thinking about writing a sentence while electrodes implanted into his brain send a signal that appears as words on a computer screen
Thoughts turned into text: Two implanted electrode arrays record the brain activity produced by thinking about writing letters. This information is then collected and processed in real-time by a computer, which converts that data into words on a screen.

Image: Shenoy Lab & Erika Woodrum (artist)






Share This!


Healthcare Jobs





Chief Development Officer

Cambridge Health Alliance
Cambridge, MA

Full-Time Pediatrics Speech Language Pathologist - No weekends, holidays or on-call - Up to a $15,000 Sign-on Bonus (Based on Experience) - Relocation assistance negotiable

Genesis Healthcare System
Zanesville, Ohio

Pediatric Primary Care Physician, Clinical Assistant/Associate Professor, Pediatrics, Pediatric Primary Care Medicine

Stony Brook University
Stony Brook, NY

Staff Physical Therapist - Full or Part-Time Availability - Pain Relief and Physical Therapy

Pain Relief and Physical Therapy
Havertown and Montgomeryville, Pennsylvania

Full-Time Physical Therapy & Sports Physical & Occupational Therapists - Relocation expenses up to $2,000

Kitsap Physical Therapy
Washington

Clinical/Medical Technologist 1 and 2 (two positions) - Washington State University College of Veterinary Medicine

Washington State University - College of Veterinary Medicine
Pullman, Washington

More Jobs
(Dismiss) Thank you for visiting NEWS-Line! Please sign up, login, or follow us on your favorite social networks
to receive custom tailored eNews, job listings, and educational opportunities for your specific profession.