Bright key facts / Emerging
One implant, speech and gesture together.
UCSF researchers showed that neural signals recorded through one high-density implant could support simultaneous decoding of attempted speech and communicative gestures in people with paralysis.
- AI’s role
- Parallel neural decoders translated high-density electrocorticography signals into selected speech phrases and upper-body gesture commands for a personalized virtual avatar.
- Documented result
- Researchers decoded isolated movements across three participants and tested the simultaneous full-avatar system with two. Models trained on both isolated and simultaneous attempts performed more reliably across those contexts than models trained on only one context.
- Important limitation
- Evidence comes from three participants; the simultaneous full-avatar system was tested with two of them.