Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams

August 19, 2019
Publications

Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams

August 19, 2019
Publications

Chan R, Jankovic F, Marinsek N, Foschini L, Kourtis L, Signorini A, Pugh M, Shen J, Yaari R, Maljkovic V, Sunga M, Hee Song H, Joon Jung H, Tseng B, Trister A

August 19, 2019
Publications

Developing Measures of Cognitive Impairment in the Real World from Consumer-Grade Multimodal Sensor Streams

August 19, 2019
Publications
Eve: Evidation's brand mark which is a yellow glowing orb

ABSTRACT: The ubiquity and remarkable technological progress of wearable consumer devices and mobile-computing platforms (smart phone, smart watch, tablet), along with the multitude of sensor modalities available, have enabled continuous monitoring of patients and their daily activities. Such rich, longitudinal information can be mined for physiological and behavioral signatures of cognitive impairment and provide new avenues for detecting MCI in a timely and cost-effective manner. In this work, we present a platform for remote and unobtrusive monitoring of symptoms related to cognitive impairment using several consumer-grade smart devices.We demonstrate how the platform has been used to collect a total of 16TB of data during the Lilly Exploratory Digital AssessmentStudy, a 12-week feasibility study which monitored 31 people with cognitive impairment and 82 without cognitive impairment in free living conditions. We describe how careful data unification, time alignment, and imputation techniques can handle missing data rates inherent in real-world settings and ultimately show utility of these disparate data in differentiating symptomatics from healthy controls based on features computed purely from device data.

Read the full paper here.