A brain implant lets paralyzed people speak and gesture at the same time
For years, brain-computer interfaces have given paralyzed people back either words or gestures, never both at once, because researchers assumed the brain signals for talking and waving would simply pile on top of each other and overwhelm the system.
A UCSF team led by neurosurgeon Edward Chang tested that assumption on three patients with vocal-tract and body paralysis from ALS or brainstem stroke, using a thin strip of sensors on the motor cortex to read their attempts at both speech and gestures like a thumbs-up or a wave 59. Two participants used the decoded signals to control a full-body avatar in real time, speaking and gesturing together, and the brain activity for combined expression turned out to be more than the sum of its parts, not the muddle scientists expected.