94. NEURAL CORRELATES TO AUTOMATIC BEHAVIOR ESTIMATIONS FROM RGB-D VIDEO IN EPILEPSY UNIT

Department: Electrical & Computer Engineering
Research Institute Affiliation: California Institute for Telecommunications and Information Technology (Calit2)
Faculty Advisor(s): Vikash Gilja

Primary Student
Name: Paolo Gutierrez Gabriel
Email: pgabriel@ucsd.edu
Phone: 513-675-9444
Grad Year: 2018

Abstract
To augment neural monitoring, a minimally intrusive multi-modal capture system was designed and implemented in the epilepsy clinic. This system provides RGB-D audio-video synchronized with patient electrocorticography (ECoG), which records neural activity across cortex. We propose an automated approach to studying the human brain in a naturalistic setting. We demonstrate coarse functional mapping of ECoG electrodes correlated to contralateral arm movements. Motor electrode mapping was generated by analyzing continuous movement data recorded over several hours from epilepsy patients in hospital rooms. From these recordings we estimate the kinematics of patient hand movement behaviors using computer vision algorithms. We compare movement behaviors to neural data collected from ECoG, specifically high-γ (70-110 Hz) spectral features. We present a functional map of electrode responses to natural arm movements, generated using a statistical test. We demonstrate that our approach has the potential to aid in the development of automated functional brain mapping using continuous video and neural recordings of patients in clinical settings.

Industry Application Area(s)
Life Sciences/Medical Devices & Instruments

« Back to Posters or Search Results


Contact:   researchexpo@soe.ucsd.edu   (858) 534-6068