The design of our platform ecosystem includes a neuromodulation system and data collection devices to be installed in a person’s home. It also incorporates cloud storage for long-term data storage. A VPN network enables remote updates to aDBS algorithms, and it allows data to be securely transmitted to researchers and clinicians.

Where is the Person in Personalized Medicine? The Missing Expert in Adaptive Neurotechnology.

Bringing the Clinic Home: An At-Home Multi-Modal Data Collection Ecosystem to Support Adaptive Deep Brain Stimulation

The processing flow of multi-modal data collected with our platform ecosystem, starting inside the research participant’s home.

I built a custom video recording app to automatically initiate recordings based on a configurable schedule. The application includes a graphical interface to pause or cancel recordings with a single touch to quickly and easily maintain privacy.

Finger-tapping task
A resesarch participant performs a finger-tapping task in their home office, shown here in 2D pose estimates I computed from videos.

I measured various aspects of movement quality while a research participant performed finger tapping, opening and closing a fist, and wrist rotation tasks in their home. By comparing measurements when the participant received different levels of stimulation amplitude, we can continuously assess how well symptoms are treated.

In-Home Video and IMU Kinematics of Self Guided Tasks Correlate with Clinical Bradykinesia Scores

I developed metrics to remotely assess the symptom severity for people with Parkinson’s disease using 2D pose estimates from videos and acceleration and velocity data from smartwatches. By correlating metrics like speed and range of motion with clinical UPDRS scores, I demonstrated that remote assessments could match gold-standard clinical evaluations.

A Participant’s Experience Participating in an At-Home Pilot Study: A Reflexive Thematic Analysis

Research on the experiences of research participants exists, however it is frequently published in separate places from the research that impacts their lives, such as clinical neurology. This is notable because neurological diseases impact each person uniquely and subjectively, often in ways we cannot ascertain without directly asking the person.

I designed a reflexive thematic analysis of the experience of a research participant in my prior work investigating adaptive Deep Brain Stimulation at home for people with Parkinson’s disease. I developed several themes demonstrating that the fields of clinical neurology and neural engineering stand to benefit immensely from co-researching with participants in a collaborative approach. For instance, the participant was uncertain about navigating trade-offs in their movement abilities while performing some self-guided experimental tasks at home, which introduced noise into the collected data. These kinds of issues can be mitigated by co-designing experiments with the participant.

(a) Simplified diagram of novel Variational Autoencoder (VAE) architecture. (b) Latent representation of a single subject’s neural data in two-dimensional space.

Neural Decoding of Natural Human Behaviors