EEG-based Brain-Computer Interfaces (BCI) is a non-invasive technique used to translate brain activity to commands that control an effector (such as a computer keyboard, mouse, etc). Many patients who cannot communicate effectively, such as those who have suffered from a stroke, locked-in syndrome, or other neurodegenerative diseases, rely on BCI’s to stay connected. A few of the most common types of BCI’s modalities are P300, SSVEP, slow cortical potentials, and sensorimotor rhythms. With Wearable Sensing’s revolutionary dry EEG technology, nearly any type of BCI is possible with our research-grade signal quality. Since DSI systems are extremely easy to use and comfortable, this has opened the door to translating a wide range of BCI applications to the real- and virtual- worlds.
P300, otherwise known as the oddball paradigm, is an event-related potential (ERP) in which the brain elicits a unique response roughly 300ms after an “odd” stimulus is presented. This response can be decoded and classified in real-time for a variety of different applications.
One such use case is known as a P300 speller, in which a series of letters are flashed on a screen, and when the “target” letter pops up, our brain has the P300 response, which can then be transformed into a letter selection.
Betts Peters, Dr. Melanie Fried-Oken, and their team at Oregon Health & Science University have developed a P300 speller using the DSI-24, and have validated its functionality on subjects with Locked-In syndrome.
Steady State Visually Evoked Potentials (SSVEP) are natural responses to visual stimuli at specific frequencies. In a typical SSVEP paradigm, targets will flash at differing frequencies, anywhere from 3.5 Hz – 75 Hz, and depending on which target the subject is attending to, the brain will have a characterizable response at such specific frequency.
As shown in the video, a 12 target numbered keyboard is setup, and the subject is counting up. There is no training required, and the algorithm can correctly classify in under 1 second, in some cases.
This specific SSVEP software was developed by Wearable Sensing’s collaborater in China, Neuracle, and is available for purchase for all DSI systems. The software comes ready to use, with customizable 12-count and 40-count keyboards designed for ultra-rapid, high-accuracy classification.
Motor Imagery is a BCI technique in which the subject imagines performing a movement with a particular limb. This then alters the rhythmic activity in locations in the sensorimotor cortex that correspond to the imagined limb. The BCI can decode these signals, and translate the imagined movement into feedback in the form of cursor movements or other computer commands.
The DSI-24 was featured at an interactive art installation “Mental Work” at the Ecole Polytechnique Federale de Lausanne (EPFL) Switzerland. During the exhibit, subjects were presented with a wheel that was controlled by the subject thinking about moving either one of their arms.
Neurolutions is a medical device company developing neuro-rehabilitation solutions that seek to restore function to patients who are disabled as a result of neurological injury. The Neurolutions IpsiHand system provides upper extremity rehabilitation for chronic stroke patients leveraging brain-computer interface and advanced wearable robotics technology.
By utilizing the DSI-7, Neurolutions is able to use Motor Imagery techniques to decode a patients intent to move their finger, which then instructs the exoskeleton to physically move the finger. With repeated sessions, patients can regain control of their lost limbs.
What fires together, wires together!
Humphries, Joseph B; Mattos, Daniela JS; Rutlin, Jerrel; Daniel, Andy GS; Rybczynski, Kathleen; Notestine, Theresa; Shimony, Joshua S; Burton, Harold; Carter, Alexandre; Leuthardt, Eric C
Motor Network Reorganization Induced in Chronic Stroke Patients with the Use of a Contralesionally-Controlled Brain Computer Interface Journal Article
In: Brain-Computer Interfaces, vol. 9, no. 3, pp. 179–192, 2022.
@article{humphries2022motor,
title = {Motor Network Reorganization Induced in Chronic Stroke Patients with the Use of a Contralesionally-Controlled Brain Computer Interface},
author = {Joseph B Humphries and Daniela JS Mattos and Jerrel Rutlin and Andy GS Daniel and Kathleen Rybczynski and Theresa Notestine and Joshua S Shimony and Harold Burton and Alexandre Carter and Eric C Leuthardt},
doi = {https://doi.org/10.1080/2326263X.2022.2057757},
year = {2022},
date = {2022-07-01},
urldate = {2022-01-01},
journal = {Brain-Computer Interfaces},
volume = {9},
number = {3},
pages = {179--192},
publisher = {Taylor & Francis},
abstract = {Upper extremity weakness in chronic stroke remains a problem not fully addressed by current therapies. Brain–computer interfaces (BCIs) engaging the unaffected hemisphere are a promising therapy that are entering clinical application, but the mechanism underlying recovery is not well understood. We used resting state functional MRI to assess the impact a contralesionally driven EEG BCI therapy had on motor system functional organization. Patients used a therapeutic BCI for 12 weeks at home. We acquired resting-state fMRI scans and motor function data before and after the therapy period. Changes in functional connectivity (FC) strength between motor network regions of interest (ROIs) and the topographic extent of FC to specific ROIs were analyzed. Most patients achieved clinically significant improvement. Motor FC strength and topographic extent decreased following BCI therapy. Motor recovery correlated with reductions in motor FC strength across the entire motor network. These findings suggest BCI-mediated interventions may reverse pathologic strengthening of dysfunctional network interactions.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Kim, Min Gyu; Lim, Hyunmi; Lee, Hye Sun; Han, In Jun; Ku, Jeonghun; Kang, Youn Joo
In: Journal of Neural Engineering, vol. 19, no. 3, 2022.
@article{kim2022brain,
title = {Brain--computer interface-based action observation combined with peripheral electrical stimulation enhances corticospinal excitability in healthy subjects and stroke patients},
author = {Min Gyu Kim and Hyunmi Lim and Hye Sun Lee and In Jun Han and Jeonghun Ku and Youn Joo Kang},
url = {https://iopscience.iop.org/article/10.1088/1741-2552/ac76e0/meta?casa_token=MPuDFAHtwF4AAAAA:Q_cSc8qcY0m6fnqiqPpkHv5cAIzKaJBw51nYjwygju0LbXYaujodUGwUy1RjTcbCm-MTN7ZnOg},
year = {2022},
date = {2022-06-20},
urldate = {2022-01-01},
journal = {Journal of Neural Engineering},
volume = {19},
number = {3},
publisher = {IOP Publishing},
abstract = {Objective. Action observation (AO) combined with brain–computer interface (BCI) technology enhances cortical activation. Peripheral electrical stimulation (PES) increases corticospinal excitability, thereby activating brain plasticity. To maximize motor recovery, we assessed the effects of BCI-AO combined with PES on corticospinal plasticity. Approach. Seventeen patients with chronic hemiplegic stroke and 17 healthy subjects were recruited. The participants watched a video of repetitive grasping actions with four different tasks for 15 min: (A) AO alone; (B) AO + PES; (C) BCI-AO + continuous PES; and (D) BCI-AO + triggered PES. PES was applied at the ulnar nerve of the wrist. The tasks were performed in a random order at least three days apart. We assessed the latency and amplitude of motor evoked potentials (MEPs). We examined changes in MEP parameters pre-and post-exercise across the four tasks in the first dorsal interosseous muscle of the dominant hand (healthy subjects) and affected hand (stroke patients). Main results. The decrease in MEP latency and increase in MEP amplitude after the four tasks were significant in both groups. The increase in MEP amplitude was sustained for 20 min after tasks B, C, and D in both groups. The increase in MEP amplitude was significant between tasks A vs. B, B vs. C, and C vs. D. The estimated mean difference in MEP amplitude post-exercise was the highest for A and D in both groups. Significance. The results indicate that BCI-AO combined with PES is superior to AO alone or AO + PES for facilitating corticospinal plasticity in both healthy subjects and patients with stroke. Furthermore, this study supports the idea that synchronized activation of cortical and peripheral networks can enhance neuroplasticity after stroke. We suggest that the BCI-AO paradigm and PES could provide a novel neurorehabilitation strategy for patients with stroke.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Rustamov, Nabi; Humphries, Joseph; Carter, Alexandre; Leuthardt, Eric C
Theta-gamma coupling as a cortical biomarker of brain-computer interface mediated motor recovery in chronic stroke Journal Article
In: Brain Communications, vol. 4, iss. 3, 2022.
@article{rustamov2022thetab,
title = {Theta-gamma coupling as a cortical biomarker of brain-computer interface mediated motor recovery in chronic stroke},
author = {Nabi Rustamov and Joseph Humphries and Alexandre Carter and Eric C Leuthardt},
doi = {https://doi.org/10.1093/braincomms/fcac136},
year = {2022},
date = {2022-05-25},
urldate = {2022-01-01},
journal = {Brain Communications},
volume = {4},
issue = {3},
abstract = {Chronic stroke patients with upper-limb motor disabilities are now beginning to see treatment options that were not previously available. To date, the two options recently approved by the United States Food and Drug Administration include vagus nerve stimulation and brain–computer interface therapy. While the mechanisms for vagus nerve stimulation have been well defined, the mechanisms underlying brain–computer interface-driven motor rehabilitation are largely unknown. Given that cross-frequency coupling has been associated with a wide variety of higher-order functions involved in learning and memory, we hypothesized this rhythm-specific mechanism would correlate with the functional improvements effected by a brain–computer interface. This study investigated whether the motor improvements in chronic stroke patients induced with a brain–computer interface therapy are associated with alterations in phase–amplitude coupling, a type of cross-frequency coupling. Seventeen chronic hemiparetic stroke patients used a robotic hand orthosis controlled with contralesional motor cortical signals measured with EEG. Patients regularly performed a therapeutic brain–computer interface task for 12 weeks. Resting-state EEG recordings and motor function data were acquired before initiating brain–computer interface therapy and once every 4 weeks after the therapy. Changes in phase–amplitude coupling values were assessed and correlated with motor function improvements. To establish whether coupling between two different frequency bands was more functionally important than either of those rhythms alone, we calculated power spectra as well. We found that theta–gamma coupling was enhanced bilaterally at the motor areas and showed significant correlations across brain–computer interface therapy sessions. Importantly, an increase in theta–gamma coupling positively correlated with motor recovery over the course of rehabilitation. The sources of theta–gamma coupling increase following brain–computer interface therapy were mostly located in the hand regions of the primary motor cortex on the left and right cerebral hemispheres. Beta–gamma coupling decreased bilaterally at the frontal areas following the therapy, but these effects did not correlate with motor recovery. Alpha–gamma coupling was not altered by brain–computer interface therapy. Power spectra did not change significantly over the course of the brain–computer interface therapy. The significant functional improvement in chronic stroke patients induced by brain–computer interface therapy was strongly correlated with increased theta–gamma coupling in bihemispheric motor regions. These findings support the notion that specific cross-frequency coupling dynamics in the brain likely play a mechanistic role in mediating motor recovery in the chronic phase of stroke recovery.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Klee, Daniel; Memmott, Tab; Smedemark-Margulies, Niklas; Celik, Basak; Erdogmus, Deniz; Oken, Barry S
Target-Related Alpha Attenuation in a Brain-Computer Interface Rapid Serial Visual Presentation Calibration Journal Article
In: Frontiers in Human Neuroscience, vol. 16, 2022.
@article{klee2022target,
title = {Target-Related Alpha Attenuation in a Brain-Computer Interface Rapid Serial Visual Presentation Calibration},
author = {Daniel Klee and Tab Memmott and Niklas Smedemark-Margulies and Basak Celik and Deniz Erdogmus and Barry S Oken},
doi = {10.3389/fnhum.2022.882557},
year = {2022},
date = {2022-04-21},
urldate = {2022-01-01},
journal = {Frontiers in Human Neuroscience},
volume = {16},
publisher = {Frontiers Media SA},
abstract = {This study evaluated the feasibility of using occipitoparietal alpha activity to drive target/non-target classification in a brain-computer interface (BCI) for communication. EEG data were collected from 12 participants who completed BCI Rapid Serial Visual Presentation (RSVP) calibrations at two different presentation rates: 1 and 4 Hz. Attention-related changes in posterior alpha activity were compared to two event-related potentials (ERPs): N200 and P300. Machine learning approaches evaluated target/non-target classification accuracy using alpha activity. Results indicated significant alpha attenuation following target letters at both 1 and 4 Hz presentation rates, though this effect was significantly reduced in the 4 Hz condition. Target-related alpha attenuation was not correlated with coincident N200 or P300 target effects. Classification using posterior alpha activity was above chance and benefitted from individualized tuning procedures. These findings suggest that target-related posterior alpha attenuation is detectable in a BCI RSVP calibration and that this signal could be leveraged in machine learning algorithms used for RSVP or comparable attention-based BCI paradigms.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Kim, Soram; Lee, Seungyun; Kang, Hyunsuk; Kim, Sion; Ahn, Minkyu
P300 Brain--Computer Interface-Based Drone Control in Virtual and Augmented Reality Journal Article
In: Sensors, vol. 21, no. 17, pp. 5765, 2021.
@article{kim2021p300,
title = {P300 Brain--Computer Interface-Based Drone Control in Virtual and Augmented Reality},
author = {Soram Kim and Seungyun Lee and Hyunsuk Kang and Sion Kim and Minkyu Ahn},
doi = {https://doi.org/10.3390/s21175765},
year = {2021},
date = {2021-08-27},
journal = {Sensors},
volume = {21},
number = {17},
pages = {5765},
publisher = {Multidisciplinary Digital Publishing Institute},
abstract = {Since the emergence of head-mounted displays (HMDs), researchers have attempted to introduce virtual and augmented reality (VR, AR) in brain–computer interface (BCI) studies. However, there is a lack of studies that incorporate both AR and VR to compare the performance in the two environments. Therefore, it is necessary to develop a BCI application that can be used in both VR and AR to allow BCI performance to be compared in the two environments. In this study, we developed an opensource-based drone control application using P300-based BCI, which can be used in both VR and AR. Twenty healthy subjects participated in the experiment with this application. They were asked to control the drone in two environments and filled out questionnaires before and after the experiment. We found no significant (p > 0.05) difference in online performance (classification accuracy and amplitude/latency of P300 component) and user experience (satisfaction about time length, program, environment, interest, difficulty, immersion, and feeling of self-control) between VR and AR. This indicates that the P300 BCI paradigm is relatively reliable and may work well in various situations},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Lim, Hyunmi; Ku, Jeonghun
Superior Facilitation of an Action Observation Network by Congruent Character Movements in Brain--Computer Interface Action-Observation Games Journal Article
In: Cyberpsychology, Behavior, and Social Networking, vol. 24, no. 8, pp. 566–572, 2021.
@article{lim2021superior,
title = {Superior Facilitation of an Action Observation Network by Congruent Character Movements in Brain--Computer Interface Action-Observation Games},
author = {Hyunmi Lim and Jeonghun Ku},
doi = {https://doi.org/10.1089/cyber.2020.0231},
year = {2021},
date = {2021-08-04},
journal = {Cyberpsychology, Behavior, and Social Networking},
volume = {24},
number = {8},
pages = {566--572},
publisher = {Mary Ann Liebert, Inc., publishers 140 Huguenot Street, 3rd Floor New~…},
abstract = {Action observation (AO) is a promising strategy for promoting motor function in neural rehabilitation. Recently, brain–computer interface (BCI)-AO game rehabilitation, which combines AO therapy with BCI technology, has been introduced to improve the effectiveness of rehabilitation. This approach can improve motor learning by providing feedback, which can be interactive in an observation task, and the game contents of the BCI-AO game paradigm can affect rehabilitation. In this study, the effects of congruent rather than incongruent feedback in a BCI-AO game on mirror neurons were investigated. Specifically, the mu suppression with congruent and incongruent BCI-AO games was measured in 17 healthy adults. The mu suppression in the central motor cortex was significantly higher with the congruent BCI-AO game than with the incongruent one. In addition, the satisfaction evaluation results were excellent for the congruent case. These results support the fact that providing feedback congruent with the motion of an action video facilitates mirror neuron activity and can offer useful guidelines for the design of BCI-AO games for rehabilitation},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Zhang, Dong
Brain-Controlled Robotic Arm Based on Adaptive FBCCA Conference
Human Brain and Artificial Intelligence: Second International Workshop, HBAI 2020, Held in Conjunction with IJCAI-PRICAI 2020, Yokohama, Japan, January 7, 2021, Revised Selected Papers, Springer Nature 2021.
@conference{zhang2021brain,
title = {Brain-Controlled Robotic Arm Based on Adaptive FBCCA},
author = {Dong Zhang},
url = {https://link.springer.com/chapter/10.1007/978-981-16-1288-6_7},
year = {2021},
date = {2021-04-08},
booktitle = {Human Brain and Artificial Intelligence: Second International Workshop, HBAI 2020, Held in Conjunction with IJCAI-PRICAI 2020, Yokohama, Japan, January 7, 2021, Revised Selected Papers},
pages = {102},
organization = {Springer Nature},
abstract = {The SSVEP-BCI system usually uses a fixed calculation time and a static window stop method to decode the EEG signal, which reduces the efficiency of the system. In response to this problem, this paper uses an adaptive FBCCA algorithm, which uses Bayesian estimation to dynamically find the optimal data length for result prediction, adapts to the differences between different trials and different individuals, and effectively improves system operation effectiveness. At the same time, through this method, this paper constructs a brain-controlled robotic arm grasping life assistance system based on adaptive FBCCA. In this paper, we selected 20 subjects and conducted a total of 400 experiments. A large number of experiments have verified that the system is available and the average recognition success rate is 95.5%. This also proves that the system can be applied to actual scenarios. Help the handicapped to use the brain to control the mechanical arm to grab the needed items to assist in daily life and improve the quality of life. In the future, SSVEP’s adaptive FBCCA decoding algorithm can be combined with the motor imaging brain-computer interface decoding algorithm to build a corresponding system to help patients with upper or lower limb movement disorders caused by stroke diseases to recover, and reshape the brain and Control connection of limbs.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Eldeeb, Safaa; Susam, Busra T; Akcakaya, Murat; Conner, Caitlin M; White, Susan W; Mazefsky, Carla A
Trial by trial EEG based BCI for distress versus non distress classification in individuals with ASD Journal Article
In: Scientific Reports, vol. 11, no. 1, pp. 1–13, 2021.
@article{eldeeb2021trial,
title = {Trial by trial EEG based BCI for distress versus non distress classification in individuals with ASD},
author = {Safaa Eldeeb and Busra T Susam and Murat Akcakaya and Caitlin M Conner and Susan W White and Carla A Mazefsky},
url = {https://www.nature.com/articles/s41598-021-85362-8},
year = {2021},
date = {2021-03-16},
journal = {Scientific Reports},
volume = {11},
number = {1},
pages = {1--13},
publisher = {Nature Publishing Group},
abstract = {Autism spectrum disorder (ASD) is a neurodevelopmental disorder that is often accompanied by impaired emotion regulation (ER). There has been increasing emphasis on developing evidence-based approaches to improve ER in ASD. Electroencephalography (EEG) has shown success in reducing ASD symptoms when used in neurofeedback-based interventions. Also, certain EEG components are associated with ER. Our overarching goal is to develop a technology that will use EEG to monitor real-time changes in ER and perform intervention based on these changes. As a first step, an EEG-based brain computer interface that is based on an Affective Posner task was developed to identify patterns associated with ER on a single trial basis, and EEG data collected from 21 individuals with ASD. Accordingly, our aim in this study is to investigate EEG features that could differentiate between distress and non-distress conditions. Specifically, we investigate if the EEG time-locked to the visual feedback presentation could be used to classify between WIN (non-distress) and LOSE (distress) conditions in a game with deception. Results showed that the extracted EEG features could differentiate between WIN and LOSE conditions (average accuracy of 81%), LOSE and rest-EEG conditions (average accuracy 94.8%), and WIN and rest-EEG conditions (average accuracy 94.9%).},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Memmott, Tab; Koçanaoğullari, Aziz; Lawhead, Matthew; Klee, Daniel; Dudy, Shiran; Fried-Oken, Melanie; Oken, Barry
BciPy: brain--computer interface software in Python Journal Article
In: Brain-Computer Interfaces, pp. 1-18, 2021.
@article{memmott2021bcipy,
title = {BciPy: brain--computer interface software in Python},
author = {Tab Memmott and Aziz Koçanaoğullari and Matthew Lawhead and Daniel Klee and Shiran Dudy and Melanie Fried-Oken and Barry Oken},
doi = {https://doi.org/10.1080/2326263X.2021.1878727},
year = {2021},
date = {2021-02-02},
journal = {Brain-Computer Interfaces},
pages = {1-18},
publisher = {Taylor & Francis},
abstract = {There are high technological and software demands associated with conducting Brain–Computer Interface (BCI) research. In order to accelerate the development and accessibility of BCIs, it is worthwhile to focus on open-source and community desired tooling. Python, a prominent computer language, has emerged as a language of choice for many research and engineering purposes. In this article, BciPy, an open-source, Python-based software for conducting BCI research is presented. It was developed with a focus on restoring communication using Event-Related Potential (ERP) spelling interfaces; however, it may be used for other non-spelling and non-ERP BCI paradigms. Major modules in this system include support for data acquisition, data queries, stimuli presentation, signal processing, signal viewing and modeling, language modeling, task building, and a simple Graphical User Interface (GUI).},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Son, Ji Eun; Choi, Hyoseon; Lim, Hyunmi; Ku, Jeonghun
In: Technology and Health Care, vol. 28, no. S1, pp. 509-519, 2020.
@article{son2020development,
title = {Development of a flickering action video based steady state visual evoked potential triggered brain computer interface-functional electrical stimulation for a rehabilitative action observation game},
author = {Ji Eun Son and Hyoseon Choi and Hyunmi Lim and Jeonghun Ku},
editor = {Severin P. Schwarzacher and Carlos Gómez},
doi = {10.3233/THC-209051},
year = {2020},
date = {2020-06-04},
journal = {Technology and Health Care},
volume = {28},
number = {S1},
pages = {509-519},
publisher = {IOS Press},
abstract = {BACKGROUND:
This study focused on developing an upper limb rehabilitation program. In this regard, a steady state visual evoked potential (SSVEP) triggered brain computer interface (BCI)-functional electrical stimulation (FES) based action observation game featuring a flickering action video was designed.
OBJECTIVE:
In particular, the synergetic effect of the game was investigated by combining the action observation paradigm with BCI based FES.
METHODS:
The BCI-FES system was contrasted under two conditions: with flickering action video and flickering noise video. In this regard, 11 right-handed subjects aged between 22–27 years were recruited. The differences in brain activation in response to the two conditions were examined.
RESULTS:
The results indicate that T3 and P3 channels exhibited greater Mu suppression in 8–13 Hz for the action video than the noise video. Furthermore, T4, C4, and P4 channels indicated augmented high beta (21–30 Hz) for the action in contrast to the noise video. Finally, T4 indicated suppressed low beta (14–20 Hz) for the action video in contrast to the noise video.
CONCLUSION:
The flickering action video based BCI-FES system induced a more synergetic effect on cortical activation than the flickering noise based system.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Please fill out the form and provide a brief description of your application so we can help match you with products that will meet your specific needs.
Please fill out the form and provide a brief description of your application so we can help match you with products that will meet your specific needs.
Please fill out the form and provide a brief description of your application so we can help match you with products that will meet your specific needs.