Publications

Refine Results

(Filters Applied) Clear All

Predicting ankle moment trajectory with adaptive weighted ensemble of LSTM network

Published in:
2022 IEEE High Perf. Extreme Comp. Conf. (HPEC), 19-23 September 2022, DOI: 10.1109/HPEC55821.2022.9926370.

Summary

Estimations of ankle moments can provide clinically helpful information on the function of lower extremities and further lead to insight on patient rehabilitation and assistive wearable exoskeleton design. Current methods for estimating ankle moments leave room for improvement, with most recent cutting-edge methods relying on machine learning models trained on wearable sEMG and IMU data. While machine learning eliminates many practical challenges that troubled more traditional human body models for this application, we aim to expand on prior work that showed the feasibility of using LSTM models by employing an ensemble of LSTM networks. We present an adaptive weighted LSTM ensemble network and demonstrate its performance during standing, walking, running, and sprinting. Our result show that the LSTM ensemble outperformed every single LSTM model component within the ensemble. Across every activity, the ensemble reduced median root mean squared error (RMSE) by 0.0017-0.0053 N. m/kg, which is 2.7 – 10.3% lower than the best performing single LSTM model. Hypothesis testing revealed that most reductions in RMSE were statistically significant between the ensemble and other single models across all activities and subjects. Future work may analyze different trajectory lengths and different combinations of LSTM submodels within the ensemble.
READ LESS

Summary

Estimations of ankle moments can provide clinically helpful information on the function of lower extremities and further lead to insight on patient rehabilitation and assistive wearable exoskeleton design. Current methods for estimating ankle moments leave room for improvement, with most recent cutting-edge methods relying on machine learning models trained on...

READ MORE

Multimodal physiological monitoring during virtual reality piloting tasks

Summary

This dataset includes multimodal physiologic, flight performance, and user interaction data streams, collected as participants performed virtual flight tasks of varying difficulty. In virtual reality, individuals flew an "Instrument Landing System" (ILS) protocol, in which they had to land an aircraft mostly relying on the cockpit instrument readings. Participants were presented with four levels of difficulty, which were generated by varying wind speed, turbulence, and visibility. Each of the participants performed 12 runs, split into 3 blocks of four consecutive runs, one run at each difficulty, in a single experimental session. The sequence of difficulty levels was presented in a counterbalanced manner across blocks. Flight performance was quantified as a function of horizontal and vertical deviation from an ideal path towards the runway as well as deviation from the prescribed ideal speed of 115 knots. Multimodal physiological signals were aggregated and synchronized using Lab Streaming Layer. Descriptions of data quality are provided to assess each data stream. The starter code provides examples of loading and plotting the time synchronized data streams, extracting sample features from the eye tracking data, and building models to predict pilot performance from the physiology data streams.
READ LESS

Summary

This dataset includes multimodal physiologic, flight performance, and user interaction data streams, collected as participants performed virtual flight tasks of varying difficulty. In virtual reality, individuals flew an "Instrument Landing System" (ILS) protocol, in which they had to land an aircraft mostly relying on the cockpit instrument readings. Participants were...

READ MORE

Axon tracing and centerline detection using topologically-aware 3D U-nets

Published in:
2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2022, pp. 238-242

Summary

As advances in microscopy imaging provide an ever clearer window into the human brain, accurate reconstruction of neural connectivity can yield valuable insight into the relationship between brain structure and function. However, human manual tracing is a slow and laborious task, and requires domain expertise. Automated methods are thus needed to enable rapid and accurate analysis at scale. In this paper, we explored deep neural networks for dense axon tracing and incorporated axon topological information into the loss function with a goal to improve the performance on both voxel-based segmentation and axon centerline detection. We evaluated three approaches using a modified 3D U-Net architecture trained on a mouse brain dataset imaged with light sheet microscopy and achieved a 10% increase in axon tracing accuracy over previous methods. Furthermore, the addition of centerline awareness in the loss function outperformed the baseline approach across all metrics, including a boost in Rand Index by 8%.
READ LESS

Summary

As advances in microscopy imaging provide an ever clearer window into the human brain, accurate reconstruction of neural connectivity can yield valuable insight into the relationship between brain structure and function. However, human manual tracing is a slow and laborious task, and requires domain expertise. Automated methods are thus needed...

READ MORE

Detection of COVID-19 using multimodal data from a wearable device: results from the first TemPredict Study

Summary

Early detection of diseases such as COVID-19 could be a critical tool in reducing disease transmission by helping individuals recognize when they should self-isolate, seek testing, and obtain early medical intervention. Consumer wearable devices that continuously measure physiological metrics hold promise as tools for early illness detection. We gathered daily questionnaire data and physiological data using a consumer wearable (Oura Ring) from 63,153 participants, of whom 704 self-reported possible COVID-19 disease. We selected 73 of these 704 participants with reliable confirmation of COVID-19 by PCR testing and high-quality physiological data for algorithm training to identify onset of COVID-19 using machine learning classification. The algorithm identified COVID-19 an average of 2.75 days before participants sought diagnostic testing with a sensitivity of 82% and specificity of 63%. The receiving operating characteristic (ROC) area under the curve (AUC) was 0.819 (95% CI [0.809, 0.830]). Including continuous temperature yielded an AUC 4.9% higher than without this feature. For further validation, we obtained SARS CoV-2 antibody in a subset of participants and identified 10 additional participants who self-reported COVID-19 disease with antibody confirmation. The algorithm had an overall ROC AUC of 0.819 (95% CI [0.809, 0.830]), with a sensitivity of 90% and specificity of 80% in these additional participants. Finally, we observed substantial variation in accuracy based on age and biological sex. Findings highlight the importance of including temperature assessment, using continuous physiological features for alignment, and including diverse populations in algorithm development to optimize accuracy in COVID-19 detection from wearables.
READ LESS

Summary

Early detection of diseases such as COVID-19 could be a critical tool in reducing disease transmission by helping individuals recognize when they should self-isolate, seek testing, and obtain early medical intervention. Consumer wearable devices that continuously measure physiological metrics hold promise as tools for early illness detection. We gathered daily...

READ MORE

Alternative cue and response modalities maintain the Simon effect but impact task performance

Published in:
Appl. Ergon., Vol. 100, 2022, 103648.

Summary

Inhibitory control, the ability to inhibit impulsive responses and irrelevant stimuli, enables high level functioning and activities of daily living. The Simon task probes inhibition using interfering stimuli, i.e., cues spatially presented on the opposite side of the indicated response; incongruent response times (RT) are slower than congruent RTs. Operational applicability of the Simon task beyond finger/hand manipulations and visual/auditory cues is unclear, but important to consider as new technologies provide tactile cues and require motor responses from the lower extremity (e.g., exoskeletons). In this study, twenty participants completed the Simon task under four conditions, each combination of two cue (visual/tactile) and response (upper/lower-extremity) modalities. RT were significantly longer for incongruent than congruent cues across cue-response pairs. However, alternative cue-response pairs yielded slower RT and decreased accuracy for tactile cues and lower extremity responses. Results support operational usage of the Simon task to probe inhibition using tactile cues and lower-extremity responses relevant for new technologies like exoskeletons and immersive environments.
READ LESS

Summary

Inhibitory control, the ability to inhibit impulsive responses and irrelevant stimuli, enables high level functioning and activities of daily living. The Simon task probes inhibition using interfering stimuli, i.e., cues spatially presented on the opposite side of the indicated response; incongruent response times (RT) are slower than congruent RTs. Operational...

READ MORE

Individuals differ in muscle activation patterns during early adaptation to a powered ankle exoskeleton

Published in:
Applied Ergonomics Volume 98, January 2022, 103593

Summary

Exoskeletons have the potential to assist users and augment physical ability. To achieve these goals across users, individual variation in muscle activation patterns when using an exoskeleton need to be evaluated. This study examined individual muscle activation patterns during walking with a powered ankle exoskeleton. 60% of the participants were observed to reduce medial gastrocnemius activation with exoskeleton powered and increase with the exoskeleton unpowered during stance. 80% of the participants showed a significant increase in tibialis anterior activation upon power addition, with inconsistent changes upon power removal during swing. 60% of the participants that were able to adapt to the system, did not de-adapt after 5 min. Muscle activity patterns differ between individuals in response to the exoskeleton power state, and affected the antagonist muscle behavior during this early adaptation. It is important to understand these different individual behaviors to inform the design of exoskeleton controllers and training protocols.
READ LESS

Summary

Exoskeletons have the potential to assist users and augment physical ability. To achieve these goals across users, individual variation in muscle activation patterns when using an exoskeleton need to be evaluated. This study examined individual muscle activation patterns during walking with a powered ankle exoskeleton. 60% of the participants were...

READ MORE

AI-enabled, ultrasound-guided handheld robotic device for femoral vascular access

Summary

Hemorrhage is a leading cause of trauma death, particularly in prehospital environments when evacuation is delayed. Obtaining central vascular access to a deep artery or vein is important for administration of emergency drugs and analgesics, and rapid replacement of blood volume, as well as invasive sensing and emerging life-saving interventions. However, central access is normally performed by highly experienced critical care physicians in a hospital setting. We developed a handheld AI-enabled interventional device, AI-GUIDE (Artificial Intelligence Guided Ultrasound Interventional Device), capable of directing users with no ultrasound or interventional expertise to catheterize a deep blood vessel, with an initial focus on the femoral vein. AI-GUIDE integrates with widely available commercial portable ultrasound systems and guides a user in ultrasound probe localization, venous puncture-point localization, and needle insertion. The system performs vascular puncture robotically and incorporates a preloaded guidewire to facilitate the Seldinger technique of catheter insertion. Results from tissue-mimicking phantom and porcine studies under normotensive and hypotensive conditions provide evidence of the technique's robustness, with key performance metrics in a live porcine model including: a mean time to acquire femoral vein insertion point of 53 plus or minus 36 s (5 users with varying experience, in 20 trials), a total time to insert catheter of 80 plus or minus 30 s (1 user, in 6 trials), and a mean number of 1.1 (normotensive, 39 trials) and 1.3 (hypotensive, 55 trials) needle insertion attempts (1 user). These performance metrics in a porcine model are consistent with those for experienced medical providers performing central vascular access on humans in a hospital.
READ LESS

Summary

Hemorrhage is a leading cause of trauma death, particularly in prehospital environments when evacuation is delayed. Obtaining central vascular access to a deep artery or vein is important for administration of emergency drugs and analgesics, and rapid replacement of blood volume, as well as invasive sensing and emerging life-saving interventions...

READ MORE

Relationships between cognitive factors and gait strategy during exoskeleton-augmented walking

Published in:
Proc. Human Factors and Ergonomics Society Annual Mtg, HFES, Vol. 65, No. 1, 2021.

Summary

Individual variation in exoskeleton-augmented gait strategy may arise from differences in cognitive factors, e.g., ability to respond quickly to stimuli or complete tasks under divided attention. Gait strategy is defined as different approaches to achieving gait priorities (e.g., walking without falling) and is observed via changes in gait characteristics like normalized stride length or width. Changes indicate shifting priorities like increasing stability or coordination with an exoskeleton. Relationships between cognitive factors and exoskeleton gait characteristics were assessed. Cognitive factors were quantified using a modified Simon task and a speed achievement task on a self-paced treadmill with and without a secondary go/no-go task. Individuals with faster reaction times and decreased ability to maintain a given speed tended to prioritize coordination with an exoskeleton over gait stability. These correlations indicate relationships between cognitive factors and individual exoskeleton-augmented gait strategy that should be further investigated to understand variation in exoskeleton use.
READ LESS

Summary

Individual variation in exoskeleton-augmented gait strategy may arise from differences in cognitive factors, e.g., ability to respond quickly to stimuli or complete tasks under divided attention. Gait strategy is defined as different approaches to achieving gait priorities (e.g., walking without falling) and is observed via changes in gait characteristics like...

READ MORE

Utility of inter-subject transfer learning for wearable-sensor-based joint torque prediction models

Published in:
43rd Annual Intl. Conf. of the IEEE Engineering in Medicine & Biology, 31 October 2021-4 November 2021.

Summary

Generalizability between individuals and groups is often a significant hurdle in model development for human subjects research. In the domain of wearable-sensor-controlled exoskeleton devices, the ability to generalize models across subjects or fine-tune more general models to individual subjects is key to enabling widespread adoption of these technologies. Transfer learning techniques applied to machine learning models afford the ability to apply and investigate the viability and utility such knowledge-transfer scenarios. This paper investigates the utility of single- and multi-subject based parameter transfer on LSTM models trained for "sensor-to-joint torque" prediction tasks, with regards to task performance and computational resources required for network training. We find that parameter transfer between both single- and multi-subject models provide useful knowledge transfer, with varying results across specific "source" and "target" subject pairings. This could be leveraged to lower model training time or computational cost in compute-constrained environments or, with further study to understand causal factors of the observed variance in performance across source and target pairings, to minimize data collection and model retraining requirements to select and personalize a generic model for personalized wearable-sensor-based joint torque prediction technologies.
READ LESS

Summary

Generalizability between individuals and groups is often a significant hurdle in model development for human subjects research. In the domain of wearable-sensor-controlled exoskeleton devices, the ability to generalize models across subjects or fine-tune more general models to individual subjects is key to enabling widespread adoption of these technologies. Transfer learning...

READ MORE

Metrics for quantifying cognitive factors that may underlie individual variation in exoskeleton use

Published in:
Proc. of the Human Factors and Ergonomics Society Annual Meeting, Vol. 65, No. 1, 2021, pp. 216-20.

Summary

Individual differences in adaptation to exoskeletons have been observed, but are not well understood. Kinematic, kinetic, and physiologic factors are commonly used to assess these systems. Parameters from experimental psychology and gait literature wereadapted to probe the lower extremity perception-cognition-action loop using measures of reaction times, gait task performance, and gait strategy. Parameters were measured in 15 subjects via two tasks: (1) a modified Simon task and (2) a speed-achievement task with secondary go/no-go cues on a self-paced treadmill. Outcome metrics were assessed for significantly different intra- versus inter-subject variability. Reaction time measures from the modified Simon task, as well two speed-achievement metrics and one gait-strategy characteristic were found to show significant differences in intra- versus inter-subject variability. These results suggest that select cognitive factors may differentiate between individuals and be potential predictors for individual variation during exoskeleton system operation.
READ LESS

Summary

Individual differences in adaptation to exoskeletons have been observed, but are not well understood. Kinematic, kinetic, and physiologic factors are commonly used to assess these systems. Parameters from experimental psychology and gait literature wereadapted to probe the lower extremity perception-cognition-action loop using measures of reaction times, gait task performance, and...

READ MORE