Publications
AI-enabled, ultrasound-guided handheld robotic device for femoral vascular access
December 18, 2021
Journal Article
Published in:
Biosensors, Vol. 11, No. 12, 18 December 2021, 522.
Topic:
R&D area:
R&D group:
Summary
Hemorrhage is a leading cause of trauma death, particularly in prehospital environments when evacuation is delayed. Obtaining central vascular access to a deep artery or vein is important for administration of emergency drugs and analgesics, and rapid replacement of blood volume, as well as invasive sensing and emerging life-saving interventions. However, central access is normally performed by highly experienced critical care physicians in a hospital setting. We developed a handheld AI-enabled interventional device, AI-GUIDE (Artificial Intelligence Guided Ultrasound Interventional Device), capable of directing users with no ultrasound or interventional expertise to catheterize a deep blood vessel, with an initial focus on the femoral vein. AI-GUIDE integrates with widely available commercial portable ultrasound systems and guides a user in ultrasound probe localization, venous puncture-point localization, and needle insertion. The system performs vascular puncture robotically and incorporates a preloaded guidewire to facilitate the Seldinger technique of catheter insertion. Results from tissue-mimicking phantom and porcine studies under normotensive and hypotensive conditions provide evidence of the technique's robustness, with key performance metrics in a live porcine model including: a mean time to acquire femoral vein insertion point of 53 plus or minus 36 s (5 users with varying experience, in 20 trials), a total time to insert catheter of 80 plus or minus 30 s (1 user, in 6 trials), and a mean number of 1.1 (normotensive, 39 trials) and 1.3 (hypotensive, 55 trials) needle insertion attempts (1 user). These performance metrics in a porcine model are consistent with those for experienced medical providers performing central vascular access on humans in a hospital.
Summary
Hemorrhage is a leading cause of trauma death, particularly in prehospital environments when evacuation is delayed. Obtaining central vascular access to a deep artery or vein is important for administration of emergency drugs and analgesics, and rapid replacement of blood volume, as well as invasive sensing and emerging life-saving interventions...
READ MORE
Relationships between cognitive factors and gait strategy during exoskeleton-augmented walking
November 12, 2021
Conference Paper
Published in:
Proc. Human Factors and Ergonomics Society Annual Mtg, HFES, Vol. 65, No. 1, 2021.
Topic:
R&D area:
R&D group:
Summary
Individual variation in exoskeleton-augmented gait strategy may arise from differences in cognitive factors, e.g., ability to respond quickly to stimuli or complete tasks under divided attention. Gait strategy is defined as different approaches to achieving gait priorities (e.g., walking without falling) and is observed via changes in gait characteristics like normalized stride length or width. Changes indicate shifting priorities like increasing stability or coordination with an exoskeleton. Relationships between cognitive factors and exoskeleton gait characteristics were assessed. Cognitive factors were quantified using a modified Simon task and a speed achievement task on a self-paced treadmill with and without a secondary go/no-go task. Individuals with faster reaction times and decreased ability to maintain a given speed tended to prioritize coordination with an exoskeleton over gait stability. These correlations indicate relationships between cognitive factors and individual exoskeleton-augmented gait strategy that should be further investigated to understand variation in exoskeleton use.
Summary
Individual variation in exoskeleton-augmented gait strategy may arise from differences in cognitive factors, e.g., ability to respond quickly to stimuli or complete tasks under divided attention. Gait strategy is defined as different approaches to achieving gait priorities (e.g., walking without falling) and is observed via changes in gait characteristics like...
READ MORE
Utility of inter-subject transfer learning for wearable-sensor-based joint torque prediction models
October 31, 2021
Conference Paper
Published in:
43rd Annual Intl. Conf. of the IEEE Engineering in Medicine & Biology, 31 October 2021-4 November 2021.
Summary
Generalizability between individuals and groups is often a significant hurdle in model development for human subjects research. In the domain of wearable-sensor-controlled exoskeleton devices, the ability to generalize models across subjects or fine-tune more general models to individual subjects is key to enabling widespread adoption of these technologies. Transfer learning techniques applied to machine learning models afford the ability to apply and investigate the viability and utility such knowledge-transfer scenarios. This paper investigates the utility of single- and multi-subject based parameter transfer on LSTM models trained for "sensor-to-joint torque" prediction tasks, with regards to task performance and computational resources required for network training. We find that parameter transfer between both single- and multi-subject models provide useful knowledge transfer, with varying results across specific "source" and "target" subject pairings. This could be leveraged to lower model training time or computational cost in compute-constrained environments or, with further study to understand causal factors of the observed variance in performance across source and target pairings, to minimize data collection and model retraining requirements to select and personalize a generic model for personalized wearable-sensor-based joint torque prediction technologies.
Summary
Generalizability between individuals and groups is often a significant hurdle in model development for human subjects research. In the domain of wearable-sensor-controlled exoskeleton devices, the ability to generalize models across subjects or fine-tune more general models to individual subjects is key to enabling widespread adoption of these technologies. Transfer learning...
READ MORE
Metrics for quantifying cognitive factors that may underlie individual variation in exoskeleton use
October 4, 2021
Journal Article
Published in:
Proc. of the Human Factors and Ergonomics Society Annual Meeting, Vol. 65, No. 1, 2021, pp. 216-20.
Topic:
R&D area:
R&D group:
Summary
Individual differences in adaptation to exoskeletons have been observed, but are not well understood. Kinematic, kinetic, and physiologic factors are commonly used to assess these systems. Parameters from experimental psychology and gait literature wereadapted to probe the lower extremity perception-cognition-action loop using measures of reaction times, gait task performance, and gait strategy. Parameters were measured in 15 subjects via two tasks: (1) a modified Simon task and (2) a speed-achievement task with secondary go/no-go cues on a self-paced treadmill. Outcome metrics were assessed for significantly different intra- versus inter-subject variability. Reaction time measures from the modified Simon task, as well two speed-achievement metrics and one gait-strategy characteristic were found to show significant differences in intra- versus inter-subject variability. These results suggest that select cognitive factors may differentiate between individuals and be potential predictors for individual variation during exoskeleton system operation.
Summary
Individual differences in adaptation to exoskeletons have been observed, but are not well understood. Kinematic, kinetic, and physiologic factors are commonly used to assess these systems. Parameters from experimental psychology and gait literature wereadapted to probe the lower extremity perception-cognition-action loop using measures of reaction times, gait task performance, and...
READ MORE
A neural network estimation of ankle torques from electromyography and accelerometry
August 26, 2021
Journal Article
Published in:
IEEE Trans. Neural Syst. Rehabilitation Eng., Vol. 29, 2021, pp. 1624-33.
Summary
Estimations of human joint torques can provide clinically valuable information to inform patient care, plan therapy, and assess the design of wearable robotic devices. Predicting joint torques into the future can also be useful for anticipatory robot control design. In this work, we present a method of mapping joint torque estimates and sequences of torque predictions from motion capture and ground reaction forces to wearable sensor data using several modern types of neural networks. We use dense feedforward, convolutional, neural ordinary differential equation, and long short-term memory neural networks to learn the mapping for ankle plantarflexion and dorsiflexion torque during standing,walking, running, and sprinting, and consider both single-point torque estimation, as well as the prediction of a sequence of future torques. Our results show that long short-term memory neural networks, which consider incoming data sequentially, outperform dense feedforward, neural ordinary differential equation networks, and convolutional neural networks. Predictions of future ankle torques up to 0.4 s ahead also showed strong positive correlations with the actual torques. The proposed method relies on learning from a motion capture dataset, but once the model is built, the method uses wearable sensors that enable torque estimation without the motion capture data.
Summary
Estimations of human joint torques can provide clinically valuable information to inform patient care, plan therapy, and assess the design of wearable robotic devices. Predicting joint torques into the future can also be useful for anticipatory robot control design. In this work, we present a method of mapping joint torque...
READ MORE
Geographic source estimation using airborne plant environmental DNA in dust
August 10, 2021
Journal Article
Published in:
Scientific Reports
Topic:
R&D area:
R&D group:
Summary
Information obtained from the analysis of dust, particularly biological particles such as pollen, plant parts, and fungal spores, has great utility in forensic geolocation. As an alternative to manual microscopic analysis of dust components, we developed a pipeline that utilizes the airborne plant environmental DNA (eDNA) in settled dust to estimate geographic origin. Metabarcoding of settled airborne eDNA was used to identify plant species whose geographic distributions were then derived from occurrence records in the USGS Biodiversity in Service of Our Nation (BISON) database. The distributions for all plant species identified in a sample were used to generate a probabilistic estimate of the sample source. With settled dust collected at four U.S. sites over a 15-month period, we demonstrated positive regional geolocation (within 600 km2 of the collection point) with 47.6% (20 of 42) of the samples analyzed. Attribution accuracy and resolution was dependent on the number of plant species identified in a dust sample, which was greatly affected by the season of collection. In dust samples that yielded a minimum of 20 identified plant species, positive regional attribution was achieved with 66.7% (16 of 24 samples). For broader demonstration, citizen-collected dust samples collected from 31 diverse U.S. sites were analyzed, and trace plant eDNA provided relevant regional attribution information on provenance in 32.2% of samples. This showed that analysis of airborne plant eDNA in settled dust can provide an accurate estimate regional provenance within the U.S., and relevant forensic information, for a substantial fraction of samples analyzed.
Summary
Information obtained from the analysis of dust, particularly biological particles such as pollen, plant parts, and fungal spores, has great utility in forensic geolocation. As an alternative to manual microscopic analysis of dust components, we developed a pipeline that utilizes the airborne plant environmental DNA (eDNA) in settled dust to...
READ MORE
Near-term regional climate change over Bangladesh
July 5, 2021
Journal Article
Published in:
Clim. Dyn., Vol. 57, July 2021, pp. 3055-73.
Summary
Bangladesh stands out as a climate change hot spot due to its unique geography, climate, high population density, and limited adaptation capacity. Mounting evidence suggests that the country is already suffering from the effects of climate change which may get worse without aggressive action. Here, we use an ensemble of high-resolution (10 km) regional climate model simulations to project near-term change in climate extremes, mainly heat waves and intense rainfall, for the period (2021–2050). Near-term climate projections represent a valuable input for designing sound adaptation policies. Our climate projections suggest that heatwaves will become more frequent and severe in Bangladesh under the business-as-usual scenario (RCP8.5). In particular, extremes of wet-bulb temperature (a temperature and humidity metric important in evaluating humid heat stress) in the western part of Bangladesh including Bogra, Ishurdi, and Jessore are likely to exceed the extreme danger threshold (according to U.S. National Weather Service criterion), which has rarely been observed in the current climate. The return periods of extreme heat waves are also significantly shortened across the country. In addition, country-averaged rainfall is projected to increase by about 6% during the summer months, with the largest increases (above 10%) in the eastern mountainous areas, such as Sylhet and Chittagong. Meanwhile, insignificant changes in extreme rainfall are simulated. Our results suggest that Bangladesh is particularly susceptible
Summary
Bangladesh stands out as a climate change hot spot due to its unique geography, climate, high population density, and limited adaptation capacity. Mounting evidence suggests that the country is already suffering from the effects of climate change which may get worse without aggressive action. Here, we use an ensemble of...
READ MORE
Geographic source estimation using airborne plant environmental DNA in dust
May 14, 2021
Journal Article
Published in:
Sci. Rep., Vol. 11, No. 1, 10 August 2021, 16238.
Summary
Information obtained from the analysis of dust, particularly biological particles such as pollen, plant parts, and fungal spores, has great utility in forensic geolocation. As an alternative to manual microscopic analysis, we developed a pipeline that utilizes the environmental DNA (eDNA) from plants in dust samples to estimate previous sample location(s). The species of plant-derived eDNA within dust samples were identified using metabarcoding and their geographic distributions were then derived from occurrence records in the USGS Biodiversity in Service of Our Nation (BISON) database. The distributions for all plant species identified in a sample were used to generate a probabilistic estimate of the sample source. With settled dust collected at four U.S. sites over a 15-month period, we demonstrated positive regional geolocation (within 600 km2 of the collection point) with 47.6% (20 of 42) of the samples analyzed. Attribution accuracy and resolution was dependent on the number of plant species identified in a dust sample, which was greatly affected by the season of collection. In dust samples that yielded a minimum of 20 identified plant species, positive regional attribution improved to 66.7% (16 of 24 samples). Using dust samples collected from 31 different U.S. sites, trace plant eDNA provided relevant regional attribution information on provenance in 32.2%. This demonstrated that analysis of plant eDNA in dust can provide an accurate estimate regional provenance within the U.S., and relevant forensic information, for a substantial fraction of samples analyzed.
Summary
Information obtained from the analysis of dust, particularly biological particles such as pollen, plant parts, and fungal spores, has great utility in forensic geolocation. As an alternative to manual microscopic analysis, we developed a pipeline that utilizes the environmental DNA (eDNA) from plants in dust samples to estimate previous sample...
READ MORE
Detecting Parkinson's disease from wrist-worn accelerometry in the U.K. Biobank
March 14, 2021
Journal Article
Published in:
Sensors, Vol. 21, No. 6, 2021, Art. No. 2047.
Topic:
R&D area:
R&D group:
Summary
Parkinson's disease (PD) is a chronic movement disorder that produces a variety of characteristic movement abnormalities. The ubiquity of wrist-worn accelerometry suggests a possible sensor modality for early detection of PD symptoms and subsequent tracking of PD symptom severity. As an initial proof of concept for this technological approach, we analyzed the U.K. Biobank data set, consisting of one week of wrist-worn accelerometry from a population with a PD primary diagnosis and an age-matched healthy control population. Measures of movement dispersion were extracted from automatically segmented gait data, and measures of movement dimensionality were extracted from automatically segmented low-movement data. Using machine learning classifiers applied to one week of data, PD was detected with an area under the curve (AUC) of 0.69 on gait data, AUC = 0.84 on low-movement data, and AUC = 0.85 on a fusion of both activities. It was also found that classification accuracy steadily improved across the one-week data collection, suggesting that higher accuracy could be achievable from a longer data collection. These results suggest the viability of using a low-cost and easy-to-use activity sensor for detecting movement abnormalities due to PD and motivate further research on early PD detection and tracking of PD symptom severity.
Summary
Parkinson's disease (PD) is a chronic movement disorder that produces a variety of characteristic movement abnormalities. The ubiquity of wrist-worn accelerometry suggests a possible sensor modality for early detection of PD symptoms and subsequent tracking of PD symptom severity. As an initial proof of concept for this technological approach, we...
READ MORE
Speaker separation in realistic noise environments with applications to a cognitively-controlled hearing aid
March 4, 2021
Journal Article
Published in:
Neural Ntw., Vol. 140, 4 March 2021, pp. 136-47.
Summary
Future wearable technology may provide for enhanced communication in noisy environments and for the ability to pick out a single talker of interest in a crowded room simply by the listener shifting their attentional focus. Such a system relies on two components, speaker separation and decoding the listener's attention to acoustic streams in the environment. To address the former, we present a system for joint speaker separation and noise suppression, referred to as the Binaural Enhancement via Attention Masking Network (BEAMNET). The BEAMNET system is an end-to-end neural network architecture based on self-attention. Binaural input waveforms are mapped to a joint embedding space via a learned encoder, and separate multiplicative masking mechanisms are included for noise suppression and speaker separation. Pairs of output binaural waveforms are then synthesized using learned decoders, each capturing a separated speaker while maintaining spatial cues. A key contribution of BEAMNET is that the architecture contains a separation path, an enhancement path, and an autoencoder path. This paper proposes a novel loss function which simultaneously trains these paths, so that disabling the masking mechanisms during inference causes BEAMNET to reconstruct the input speech signals. This allows dynamic control of the level of suppression applied by BEAMNET via a minimum gain level, which is not possible in other state-of-the-art approaches to end-to-end speaker separation. This paper also proposes a perceptually-motivated waveform distance measure. Using objective speech quality metrics, the proposed system is demonstrated to perform well at separating two equal-energy talkers, even in high levels of background noise. Subjective testing shows an improvement in speech intelligibility across a range of noise levels, for signals with artificially added head-related transfer functions and background noise. Finally, when used as part of an auditory attention decoder (AAD) system using existing electroencephalogram (EEG) data, BEAMNET is found to maintain the decoding accuracy achieved with ideal speaker separation, even in severe acoustic conditions. These results suggest that this enhancement system is highly effective at decoding auditory attention in realistic noise environments, and could possibly lead to improved speech perception in a cognitively controlled hearing aid.
Summary
Future wearable technology may provide for enhanced communication in noisy environments and for the ability to pick out a single talker of interest in a crowded room simply by the listener shifting their attentional focus. Such a system relies on two components, speaker separation and decoding the listener's attention to...
READ MORE