Publications
An exploratory characterization of speech- and fine-motor coordination in verbal children with Autism spectrum disorder
May 22, 2024
Journal Article
Published in:
Comput. Speech Lang., Vol. 89, 2025, 101665.
Topic:
R&D area:
R&D group:
Summary
Autism spectrum disorder (ASD) is a neurodevelopmental disorder often associated with difficulties in speech production and fine-motor tasks. Thus, there is a need to develop objective measures to assess and understand speech production and other fine-motor challenges in individuals with ASD. In addition, recent research suggests that difficulties with speech production and fine-motor tasks may contribute to language difficulties in ASD. In this paper, we explore the utility of an off-body recording platform, from which we administer a speech- and fine-motor protocol to verbal children with ASD and neurotypical controls. We utilize a correlation-based analysis technique to develop proxy measures of motor coordination from signals derived from recordings of speech- and fine-motor behaviors. Eigenvalues of the resulting correlation matrix are inputs to Gaussian Mixture Models to discriminate between highly-verbal children with ASD and neurotypical controls. These eigenvalues also characterize the complexity (underlying dimensionality) of representative signals of speech- and fine-motor movement dynamics, and form the feature basis to estimate scores on an expressive vocabulary measure. Based on a pilot dataset (15 ASD and 15 controls), features derived from an oral story reading task are used in discriminating between the two groups with AUCs > 0.80, and highlight lower complexity of coordination in children with ASD. Features derived from handwriting and maze tracing tasks led to AUCs of 0.86 and 0.91, however features derived from ocular tasks did not aid in discrimination between the ASD and neurotypical groups. In addition, features derived from free speech and sustained vowel tasks are strongly correlated with expressive vocabulary scores. These results indicate the promise of a correlation-based analysis in elucidating motor differences between individuals with ASD and neurotypical controls.
Summary
Autism spectrum disorder (ASD) is a neurodevelopmental disorder often associated with difficulties in speech production and fine-motor tasks. Thus, there is a need to develop objective measures to assess and understand speech production and other fine-motor challenges in individuals with ASD. In addition, recent research suggests that difficulties with speech...
READ MORE
A neurophysiological-auditory "listen receipt" for communication enhancement
April 14, 2024
Conference Paper
Published in:
49th IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, ICASSP, 14-19 April 2024.
Topic:
R&D area:
R&D group:
Summary
Information overload, and specifically auditory overload, is common in critical situations and detrimental to communication. Currently, there is no auditory equivalent of an email read receipt to know if a person has heard a message, other than waiting for a reply. This work hypothesizes that it may be possible to decode whether a person has indeed heard a message, or in other words, create an an auditory "listen receipt," through use of non-invasive physiological or neural monitoring. We extracted a variety of features derived from Electrodermal activity (EDA), Electroencephalography (EEG), and the correlations between the acoustic envelope of the radio message and EEG to use in the decoder. We were able to classify the cases in which the subject responded correctly to the question in the message, versus the cases where they missed or heard the message incorrectly, with an accuracy of 79% and a receiver operating characteristic (ROC) area under the curve (AUC) of 0.83. This work suggests that the concept of a "listen receipt" may be possible, and future wearable machine-brain interface technologies may be able to automatically determine if an important radio message has been missed for both human-to-human and human-to-machine communication.
Summary
Information overload, and specifically auditory overload, is common in critical situations and detrimental to communication. Currently, there is no auditory equivalent of an email read receipt to know if a person has heard a message, other than waiting for a reply. This work hypothesizes that it may be possible to...
READ MORE
Quantifying speech production coordination from non- and minimally-speaking individuals
April 13, 2024
Journal Article
Published in:
J. Autism Dev. Disord., 13 April 2024.
Topic:
R&D area:
R&D group:
Summary
Purpose: Non-verbal utterances are an important tool of communication for individuals who are non- or minimally-speaking. While these utterances are typically understood by caregivers, they can be challenging to interpret by their larger community. To date, there has been little work done to detect and characterize the vocalizations produced by non- or minimally-speaking individuals. This paper aims to characterize five categories of utterances across a set of 7 non- or minimally-speaking individuals. Methods: The characterization is accomplished using a correlation structure methodology, acting as a proxy measurement for motor coordination, to localize similarities and differences to specific speech production systems. Results: We specifically find that frustrated and dysregulated utterances show similar correlation structure outputs, especially when compared to self-talk, request, and delighted utterances. We additionally witness higher complexity of coordination between articulatory and respiratory subsystems and lower complexity of coordination between laryngeal and respiratory subsystems in frustration and dysregulation as compared to self-talk, request, and delight. Finally, we observe lower complexity of coordination across all three speech subsystems in the request utterances as compared to self-talk and delight. Conclusion: The insights from this work aid in understanding of the modifications made by non- or minimally-speaking individuals to accomplish specific goals in non-verbal communication.
Summary
Purpose: Non-verbal utterances are an important tool of communication for individuals who are non- or minimally-speaking. While these utterances are typically understood by caregivers, they can be challenging to interpret by their larger community. To date, there has been little work done to detect and characterize the vocalizations produced by...
READ MORE
Securing the satellite software stack
March 1, 2024
Conference Paper
Published in:
Workshop on Security of Space and Satellite Systems, SpaceSec, 1 March 2024.
Topic:
R&D area:
Summary
Satellites and the services enabled by them, like GPS, real-time world-wide imaging, weather tracking, and worldwide communication, play an increasingly important role in modern life. To support these services satellite software is becoming increasingly complex and connected. As a result, concerns about its security are becoming prevalent. While the focus of security for satellites has historically been on encrypting the communications link, we argue that a fuller consideration of the security of satellites is necessary and presents unique challenges. Satellites are becoming increasingly accessible to attackers–thanks to supply chain attacks and Internet connected ground stations–and present a unique set of challenges for security practitioners. These challenges include the lack of any real ability for a human to be physically present to repair or recover these systems, a focus on safety and availability over confidentiality and integrity, and the need to deal with radiation-induced faults. This work characterizes the cyber threats to satellite systems, surveys the unique challenges for satellite software, and presents a future vision for research in this area.
Summary
Satellites and the services enabled by them, like GPS, real-time world-wide imaging, weather tracking, and worldwide communication, play an increasingly important role in modern life. To support these services satellite software is becoming increasingly complex and connected. As a result, concerns about its security are becoming prevalent. While the focus...
READ MORE
Covariance estimation with scanning arrays: FY23 RF Systems Technical Investment Program
December 21, 2023
Project Report
Published in:
MIT Lincoln Laboratory Report TIP-194
Summary
Analog arrays with steerable beams can be capable of angle estimation and sometimes even adaptive beamforming based on power measurements taken at the outputs of multiple beam dwells. In the interesting case of a reflectarray, where beams are formed using a large collection of programmable, passive phase shifters, it is possible to use multiple dwells to estimate signal correlations among the phase shifters. These correlations form an estimated covariance matrix at the phase centers of the shifters. Adaptive beamforming and geolocation can be based on this covariance matrix. Various methods for estimating full-rank and approximately rank-deficient covariance matrices using power measurements from multiple dwells are introduced and evaluated. In some cases, the performance of an estimator can be shown to be optimal in the sense of achieving Cramer-Rao bounds for the estimated covariance parameters.
Summary
Analog arrays with steerable beams can be capable of angle estimation and sometimes even adaptive beamforming based on power measurements taken at the outputs of multiple beam dwells. In the interesting case of a reflectarray, where beams are formed using a large collection of programmable, passive phase shifters, it is...
READ MORE
WSR-88D microburst detection performance evaluation
November 28, 2023
Project Report
Published in:
MIT Lincoln Laboratory Report ATC-455
Summary
An empirical study of Weather Surveillance Radar 1988-Doppler (WSR-88D) microburst detection performance is conducted using Integrated Terminal Weather System (ITWS) microburst detections as reference. Data from 14 airport regions during 181 independent time periods spanning the years 2015–2022 are utilized for the evaluation. Results show that the detection and false alarm probabilities depend on event range from the WSR-88D. ITWS-level detection (~95%) and false alarm (~5%) probabilities are achieved for 0 to 20 km range, while at 20 to 30 km range, detection (~80%) and false alarm (~5%) rates meeting or exceeding Weather Systems Processor (WSP) microburst detection (≥80%) and false alarm (≤15%) probability requirements are observed. Beyond ~30 km from the radar, the WSR-88D microburst detection performance falls to operationally unacceptable levels. Timing analysis indicates that, on average, WSR-88D microburst detections lag ITWS microburst detections with a median value on the order of 30 s. The detection time difference distribution shows a normal symmetric form around zero with a thin tail extending in the positive lag direction, implying that the thin tail is responsible for the positive median lag time. The lag distribution tail is shown to be shortened, and the median lag time reduced to ~10 s, if the WSR-88D's slower base scan update modes are eliminated. The study shows that the WSR-88D (and its future replacement) could generate operationally useful microburst alerts for airports that are located close enough (less than ~20 km) to the radar. The long detection lag times for a small fraction of cases that are associated with WSR-88D scan strategies that have long base (lowest elevation angle) scan update periods is an issue that may need to be addressed if the current system is to be considered for operational air traffic control purposes. Also, the unavailability of output data from the first eight range gates (2 km) should be addressed for a future replacement radar by adding a minimum observation range requirement comparable to the Terminal Doppler Weather Radar's (TDWR; 0.5 km) to the follow-on radar program requirements.
Summary
An empirical study of Weather Surveillance Radar 1988-Doppler (WSR-88D) microburst detection performance is conducted using Integrated Terminal Weather System (ITWS) microburst detections as reference. Data from 14 airport regions during 181 independent time periods spanning the years 2015–2022 are utilized for the evaluation. Results show that the detection and false...
READ MORE
Security-as-a-service for embedded systems
October 30, 2023
Conference Paper
Topic:
Summary
In order to promote competition and technology refresh, the Department of Defense (DoD) has required the use of a Modular Open Systems Approach (MOSA) for the acquisition and implementation of embedded systems. Designing security and mission assurance for MOSA systems often relies upon payload specific, potentially inadequate, and difficult to update schemes. Our goal is to develop a physically separated Embedded Security-as-a-Service (ESaaS) function as a payload agnostic, updatable security manager for MOSA systems. In this paper, we describe the ongoing development of an ESaaS module for securing embedded systems that align with DoD standards, OpenVPX and Sensor Open Systems Architecture (SOSA).
Summary
In order to promote competition and technology refresh, the Department of Defense (DoD) has required the use of a Modular Open Systems Approach (MOSA) for the acquisition and implementation of embedded systems. Designing security and mission assurance for MOSA systems often relies upon payload specific, potentially inadequate, and difficult to...
READ MORE
A vocal model to predict readiness under sleep deprivation
October 9, 2023
Conference Paper
Published in:
Proc. 2023 IEEE 19th Intl. Conf. on Body Sensor Networks, BSN, 9-11 October 2023.
Topic:
R&D area:
R&D group:
Summary
A variety of factors can affect cognitive readiness and influence human performance in tasks that are mission critical. Sleep deprivation is one of the most prevalent factors that degrade performance. One risk-mitigation approach is to use vocal biomarkers to detect cognitive fatigue and resulting performance decrements. In this study, a group of 20 subjects were deprived of sleep for a period of 24 hours. Every two hours, they performed a battery of both speech tasks and cognitive performance tasks, including the psychomotor vigilance test (PVT). Performance on the PVT declined dramatically during nighttime hours between 2 AM and 8 AM. We demonstrate that a model using vocal biomarkers from read speech and free speech can be successfully trained to detect performance decrements on the PVT. We also demonstrate that the vocal model successfully generalizes to other outcomes at a similar level as PVT, detecting sleep deprivation (AUC=0.79) and cognitive performance declines on a battery of cognitive tasks (AUC=0.79). In comparison, using PVT as the basis for detecting sleep deprivation and performance declines resulted in AUC=0.75 and AUC=0.80, respectively.
Summary
A variety of factors can affect cognitive readiness and influence human performance in tasks that are mission critical. Sleep deprivation is one of the most prevalent factors that degrade performance. One risk-mitigation approach is to use vocal biomarkers to detect cognitive fatigue and resulting performance decrements. In this study, a...
READ MORE
Optimizing MobileNet algorithms for real-time vessel detection on smartphones
October 9, 2023
Conference Paper
Published in:
Proc. 2023 IEEE 19th Intl. Conf. on Body Sensor Networks, BSN, 9-11 October 2023.
Topic:
R&D area:
R&D group:
Summary
Internal bleeding due to non-compressible torso hemorrhage is the leading cause of prehospital fatalities in civilian and military trauma. A limited number of trauma surgeons are expected to be available in disaster scenarios and future large-scale combat operations. As a result, non-specialists will need to perform life-saving interventions to address internal bleeding. A first step in mitigation is ultrasound-guided central vascular access, which involves identifying a deep blood vessel in the imagery, such as the femoral vein, femoral artery, or internal jugular vein, and then placing a needle and catheter into the vessel for follow-on resuscitation. In this paper, we demonstrate machine learning algorithms for both femoral and neck vessel detection with high accuracy and real-time speed on smartphones. The algorithms are integrated with commercial ultrasound and optimized for use on low size, weight, and power devices. Coupled with custom robotics, this technology can enable rapid vascular access by non-specialist operators using a handheld platform.
Summary
Internal bleeding due to non-compressible torso hemorrhage is the leading cause of prehospital fatalities in civilian and military trauma. A limited number of trauma surgeons are expected to be available in disaster scenarios and future large-scale combat operations. As a result, non-specialists will need to perform life-saving interventions to address...
READ MORE
Daily activity profiles and activity fluctuations correlate with BMI
October 9, 2023
Conference Paper
Published in:
2023 IEEE 19th Intl. Conf. on Body Sensor Networks, BSN, 9-11 October 2023.
Topic:
R&D area:
R&D group:
Summary
The rising levels of obesity have been declared a global epidemic by the World Health Organization, with obesity rates surpassing 50% in many countries. Between the late 1970s and the early 2000s in the U.S., the prevalence of obesity doubled while the prevalence of severe obesity more than tripled. One of the factors underlying the obesity epidemic is secular changes in activity patterns due to an increasingly sedentary lifestyle. A better understanding is needed of how daily activity patterns relate to obesity. In this study we use wrist-worn accelerometry from the National Health And Nutrition Examination Survey (NHANES) data set to develop a number of features that characterize daily activity profiles, as well as fluctuations in those profiles over time, and determine how those features correlate with body mass index (BMI). Using a data set of 2,882 subjects split evenly between a training and test fold, we constructed regression models that estimate BMI based on activity profiles and fluctuations. We found a correlation of r=0.47 between estimated and true BMI, resulting in detection of overweight, obese, and severely obese subjects with area under the ROC curve (AUC) of 0.69, 0.73 and 0.85. These results indicate how patterns of activity levels across daily sleep/wake cycles are associated with higher risk for obesity.
Summary
The rising levels of obesity have been declared a global epidemic by the World Health Organization, with obesity rates surpassing 50% in many countries. Between the late 1970s and the early 2000s in the U.S., the prevalence of obesity doubled while the prevalence of severe obesity more than tripled. One...
READ MORE