Publications

Refine Results

(Filters Applied) Clear All

Adapting deep learning models to new meteorological contexts using transfer learning

Published in:
2021 IEEE International Conference on Big Data (Big Data), 2021, pp. 4169-4177, doi: 10.1109/BigData52589.2021.9671451.

Summary

Meteorological applications such as precipitation nowcasting, synthetic radar generation, statistical downscaling and others have benefited from deep learning (DL) approaches, however several challenges remain for widespread adaptation of these complex models in operational systems. One of these challenges is adequate generalizability; deep learning models trained from datasets collected in specific contexts should not be expected to perform as well when applied to different contexts required by large operational systems. One obvious mitigation for this is to collect massive amounts of training data that cover all expected meteorological contexts, however this is not only costly and difficult to manage, but is also not possible in many parts of the globe where certain sensing platforms are sparse. In this paper, we describe an application of transfer learning to perform domain transfer for deep learning models. We demonstrate a transfer learning algorithm called weight superposition to adapt a Convolutional Neural Network trained in a source context to a new target context. Weight superposition is a method for storing multiple models within a single set of parameters thus greatly simplifying model maintenance and training. This approach also addresses the issue of catastrophic forgetting where a model, once adapted to a new context, performs poorly in the original context. We apply weight superposition to the problem of synthetic weather radar generation and show that in scenarios where the target context has less data, a model adapted with weight superposition is better at maintaining performance when compared to simpler methods. Conversely, the simple adapted model performs better on the source context when the source and target contexts have comparable amounts of data.
READ LESS

Summary

Meteorological applications such as precipitation nowcasting, synthetic radar generation, statistical downscaling and others have benefited from deep learning (DL) approaches, however several challenges remain for widespread adaptation of these complex models in operational systems. One of these challenges is adequate generalizability; deep learning models trained from datasets collected in specific...

READ MORE

CoSPA data product description

Published in:
MIT Lincoln Laboratory Report ATC-449

Summary

This document contains a description of Consolidated Storm Prediction for Aviation (CoSPA) data products that are packaged and distributed for external users. As described in Rappa and Troxel, 2013 [1] for Corridor Integrated Weather System (CIWS) data products, CoSPA products are categorized as gridded and non-gridded. Gridded products are typically expressed as rectangular arrays whose elements contain a data value coinciding with uniformly-spaced observations or computed results on a 2-D surface. Gridded data arrays map to the earth's surface through a map projection, for example, Lambert Conformal or Lambert Azimuthal Equal-Area. CoSPA generates only gridded products; there are no non-gridded data for CoSPA.
READ LESS

Summary

This document contains a description of Consolidated Storm Prediction for Aviation (CoSPA) data products that are packaged and distributed for external users. As described in Rappa and Troxel, 2013 [1] for Corridor Integrated Weather System (CIWS) data products, CoSPA products are categorized as gridded and non-gridded. Gridded products are typically...

READ MORE

Demand and capacity modeling for advanced air mobility

Published in:
AIAA Aviation 2021 Conf., 2-6 August 2021.

Summary

Advanced Air Mobility encompasses emerging aviation technologies that transport people and cargo between local, regional, or urban locations that are currently underserved by aviation and other transportation modalities. The disruptive nature of these technologies has pushed industry, academia, and governments to devote significant investments to understand their impact on airspace risk, operational procedures, and passengers. A flexible framework was designed to assess the operational viability of these technologies and the sensitivity to a variety of assumptions. This framework is used to simulate air taxi traffic within New York City by replacing a portion of the city's taxi requests with trips taken with electric vertical takeoff and landing vehicles and evaluate the sensitivity of passenger trip time to a variety of system wide assumptions. In particular, the paper focuses on the impact of the passenger capacity, landing site vehicle capacity, and fleet size. The operation density is then compared with the current air traffic to assess operation constraints that will challenge the network UAM operations.
READ LESS

Summary

Advanced Air Mobility encompasses emerging aviation technologies that transport people and cargo between local, regional, or urban locations that are currently underserved by aviation and other transportation modalities. The disruptive nature of these technologies has pushed industry, academia, and governments to devote significant investments to understand their impact on airspace...

READ MORE

The need for spectrum and the impact on weather observations

Summary

One of the most significant challenges—and potential opportunities—for the scientific community is society's insatiable need for the radio spectrum. Wireless communication systems have profoundly impacted the world's economies and its inhabitants. Newer technological uses in telemedicine, Internet of Things, streaming services, intelligent transportation, etc., are driving the rapid development of 5G/6G (and beyond) wireless systems that demand ever-increasing bandwidth and performance. Without question, these wireless technologies provide an important benefit to society with the potential to mitigate the economic divide across the world. Fundamental science drives the development of future technologies and benefits society through an improved understanding of the world in which we live. Often, these studies require use of the radio spectrum, which can lead to an adversarial relationship between ever evolving technology commercialization and the quest for scientific understanding. Nowhere is this contention more acute than with atmospheric remote sensing and associated weather forecasts (Saltikoff et al. 2016; Witze 2019), which was the theme for the virtual Workshop on Spectrum Challenges and Opportunities for Weather Observations held in November 2020 and hosted by the University of Oklahoma. The workshop focused on spectrum challenges for remote sensing observations of the atmosphere, including active (e.g., weather radars, cloud radars) and passive (e.g., microwave imagers, radiometers) systems for both spaceborne and ground-based applications. These systems produce data that are crucial for weather forecasting—we chose to primarily limit the workshop scope to forecasts up to 14 days, although some observations (e.g., satellite) cover a broader range of temporal scales. Nearly 70 participants from the United States, Europe, South America, and Asia took part in a concentrated and intense discussion focused not only on current radio frequency interference (RFI) issues, but potential cooperative uses of the spectrum ("spectrum sharing"). Equally important to the workshop's international makeup, participants also represented different sectors of the community, including academia, industry, and government organizations. Given the importance of spectrum challenges to the future of scientific endeavor, the U.S. National Science Foundation (NSF) recently began the Spectrum Innovation Initiative (SII) program, which has a goal to synergistically grow 5G/6G technologies with crucial scientific needs for spectrum as an integral part of the design process. The SII program will accomplish this goal in part through establishing the first nationwide institute focused on 5G/6G technologies and science. The University of California, San Diego (UCSD), is leading an effort to compete for NSF SII funding to establish the National Center for Wireless Spectrum Research. As key partners in this effort, the University of Oklahoma (OU) and The Pennsylvania State University (PSU) hosted this workshop to bring together intellectual leaders with a focus on impacts of the spectrum revolution on weather observations and numerical weather prediction.
READ LESS

Summary

One of the most significant challenges—and potential opportunities—for the scientific community is society's insatiable need for the radio spectrum. Wireless communication systems have profoundly impacted the world's economies and its inhabitants. Newer technological uses in telemedicine, Internet of Things, streaming services, intelligent transportation, etc., are driving the rapid development of...

READ MORE

Towards the next generation operational meteorological radar

Summary

This article summarizes research and risk reduction that will inform acquisition decisions regarding NOAA's future national operational weather radar network. A key alternative being evaluated is polarimetric phased-array radar (PAR). Research indicates PAR can plausibly achieve fast, adaptive volumetric scanning, with associated benefits for severe-weather warning performance. We assess these benefits using storm observations and analyses, observing system simulation experiments, and real radar-data assimilation studies. Changes in the number and/or locations of radars in the future network could improve coverage at low altitude. Analysis of benefits that might be so realized indicates the possibility for additional improvement in severe weather and flash-flood warning performance, with associated reduction in casualties. Simulations are used to evaluate techniques for rapid volumetric scanning and assess data quality characteristics of PAR. Finally, we describe progress in developing methods to compensate for polarimetric variable estimate biases introduced by electronic beam-steering. A research-to-operations (R2O) strategy for the PAR alternative for the WSR-88D replacement network is presented.
READ LESS

Summary

This article summarizes research and risk reduction that will inform acquisition decisions regarding NOAA's future national operational weather radar network. A key alternative being evaluated is polarimetric phased-array radar (PAR). Research indicates PAR can plausibly achieve fast, adaptive volumetric scanning, with associated benefits for severe-weather warning performance. We assess these...

READ MORE

Mobile capabilities for micro-meteorological predictions: FY20 Homeland Protection and Air Traffic Control Technical Investment Program

Published in:
MIT Lincoln Laboratory Report TIP-146

Summary

Existing operational numerical weather forecast systems are geographically too coarse and not sufficiently accurate to adequately support future needs in applications such as Advanced Air Mobility, Unmanned Aerial Systems, and wildfire forecasting. This is especially true with respect to wind forecasts. Principal factors contributing to this are the lack of observation data within the atmospheric boundary layer and numerical forecast models that operate on low-resolution grids. This project endeavored to address both of these issues. Firstly, by development and demonstration of specially equipped fixed-wing drones to collect atmospheric data within the boundary layer, and secondly by creating a high-resolution weather research forecast model executing on the Lincoln Laboratory Supercomputing Center. Some success was achieved in the development and flight testing of the specialized drones. Significant success was achieved in the development of the high-resolution forecasting system and demonstrating the feasibility of ingesting atmospheric observations from small airborne platforms.
READ LESS

Summary

Existing operational numerical weather forecast systems are geographically too coarse and not sufficiently accurate to adequately support future needs in applications such as Advanced Air Mobility, Unmanned Aerial Systems, and wildfire forecasting. This is especially true with respect to wind forecasts. Principal factors contributing to this are the lack of...

READ MORE

Advanced Air Mobility assessment framework: FY20 Homeland Protection and Air Traffic Control Technical Investment Program

Published in:
MIT Lincoln Laboratory Report TIP-145

Summary

Advanced Air Mobility encompasses emerging aviation technologies that transport people and cargo between local, regional, or urban locations that are currently underserved by aviation and other transportation modalities. The disruptive nature of these technologies has pushed industry, academia, and governments to devote significant investments to understand their impact on airspace risk, operational procedures, and passengers. A flexible framework was designed to assess the operational viability of these technologies and the sensitivity to a variety of assumptions. This framework is used to simulate an initial AAM implementation scenario in New York City. This scenario was created by replacing a portion of NYC taxi requests with electric vertical takeoff and landing vehicles. The framework was used to assess the sensitivity of this scenario to a variety of system assumption.
READ LESS

Summary

Advanced Air Mobility encompasses emerging aviation technologies that transport people and cargo between local, regional, or urban locations that are currently underserved by aviation and other transportation modalities. The disruptive nature of these technologies has pushed industry, academia, and governments to devote significant investments to understand their impact on airspace...

READ MORE

Geospatial QPE accuracy dependence on weather radar network configurations

Published in:
J. Appl. Meteor. Climatol., Vol. 59, No. 1, 2020, pp. 1773-92.

Summary

The relatively low density of weather radar networks can lead to low-altitude coverage gaps. As existing networks are evaluated for gap-fillers and new networks are designed, the benefits of low-altitude coverage must be assessed quantitatively. This study takes a regression approach to modeling quantitative precipitation estimation (QPE) differences based on network density, antenna aperture, and polarimetric bias. Thousands of cases from the warm-season months of May–August 2015–2017 are processed using both the specific attenuation [R(A)] and reflectivity-differential reflectivity [R(Z,ZDR)] QPE methods and are compared against Automated Surface Observing System (ASOS) rain gauge data. QPE errors are quantified based on beam height, cross-radial resolution, added polarimetric bias, and observed rainfall rate. The collected data are used to construct a support vector machine regression model that is applied to the current WSR-88D network for holistic error quantification. An analysis of the effects of polarimetric bias on flash-flood rainfall rates is presented. Rainfall rates based on 2-year/1-hr return rates are used for a CONUS-wide analysis of QPE errors in extreme rainfall situations. These errors are then re-quantified using previously proposed network design scenarios with additional radars that provide enhanced estimate capabilities. Finally, a gap-filling scenario utilizing the QPE error model, flash-flood rainfall rates, population density, and potential additional WSR-88D sites is presented, exposing the highest-benefit coverage holes in augmenting the WSR-88D network (or a future network) relative to QPE performance.
READ LESS

Summary

The relatively low density of weather radar networks can lead to low-altitude coverage gaps. As existing networks are evaluated for gap-fillers and new networks are designed, the benefits of low-altitude coverage must be assessed quantitatively. This study takes a regression approach to modeling quantitative precipitation estimation (QPE) differences based on...

READ MORE

Weather radar network benefit model for nontornadic thunderstorm wind casualty cost reduction

Author:
Published in:
Wea. Climate Soc., Vol. 12, No. 4, October 2020, pp. 789-804.

Summary

An econometric geospatial benefit model for nontornadic thunderstorm wind casualty reduction is developed for meteorological radar network planning. Regression analyses on 22 years (1998–2019) of storm event and warning data show, likely for the first time, a clear dependence of nontornadic severe thunderstorm warning performance on radar coverage. Furthermore, nontornadic thunderstorm wind casualty rates are observed to be negatively correlated with better warning performance. In combination, these statistical relationships form the basis of a cost model that can be differenced between radar network configurations to generate geospatial benefit density maps. This model, applied to the current contiguous U.S. weather radar network, yields a benefit estimate of $207 million (M) yr^-1 relative to no radar coverage at all. The remaining benefit pool with respect to enhanced radar coverage and scan update rate is about $36M yr^-1. Aggregating these nontornadic thunderstorm wind results with estimates from earlier tornado and flash flood cost reduction models yields a total benefit of $1.12 billion yr^-1 for the present-day radars and a remaining radar-based benefit pool of $778M yr^-1.
READ LESS

Summary

An econometric geospatial benefit model for nontornadic thunderstorm wind casualty reduction is developed for meteorological radar network planning. Regression analyses on 22 years (1998–2019) of storm event and warning data show, likely for the first time, a clear dependence of nontornadic severe thunderstorm warning performance on radar coverage. Furthermore, nontornadic...

READ MORE

The 2017 Buffalo Area Icing and Radar Study (BAIRS II)

Published in:
MIT Lincoln Laboratory Report ATC-447

Summary

The second Buffalo Area Icing and Radar Study (BAIRS II) was conducted during the winter of 2017. The BAIRS II partnership between Massachusetts Institute of Technology (MIT) Lincoln Laboratory (LL), the National Research Council of Canada (NRC), and Environment and Climate Change Canada (ECCC) was sponsored by the Federal Aviation Administration (FAA). It is a follow-up to the similarly sponsored partnership of the original BAIRS conducted in the winter of 2013. The original BAIRS provided in situ verification and validation of icing and hydrometeors, respectively, within the radar domain in support of a hydrometeor-classification-based automated icing hazard algorithm. The BAIRS II motivation was to: --Collect additional in situ verification and validation data, --Probe further dual polarimetric radar features associated with icing hazard, --Provide foundations for additions to the icing hazard algorithm beyond hydrometeor classifications, and --Further characterize observable microphysical conditions in terms of S-band dual polarimetric radar data. With BAIRS II, the dual polarimetric capability is provided by multiple Next Generation Weather Radar (NEXRAD) S-band radars in New York State, and the verification of the icing hazard with microphysical and hydrometeor characterizations is provided by NRC's Convair-580 instrumented research plane during five icing missions covering about 21 mission hours. The ability to reliably interpret the NEXRAD dual polarization radar-sensed thermodynamic phase of the hydrometeors (solid, liquid, mix) in the context of cloud microphysics and precipitation physics makes it possible to assess the icing hazard potential to aviation. The challenges faced are the undetectable nature of supercooled cloud droplets (for Sband) and the isotropic nature of Supercooled Large Drops (SLD). The BAIRS II mission strategy pursued was to study and probe radar-identifiable, strongly anisotropic crystal targets (dendrites and needles) with which supercooled water (and water saturated conditions) are physically linked as a means for dual polarimetric detection of icing hazard. BAIRS II employed superior optical array probes along with state and microphysical instrumentation; and, using again NEXRAD-feature-guided flight paths, was able to make advances from the original BAIRS helpful to the icing algorithm development. The key findings that are given thorough treatment in this report are: --Identification of the radar-detectable "crystal sandwich" structure from two anisotropic crystal types stratified by in situ air temperature in association with varying levels of supercooled water --with layer thicknesses observed to 2 km, --over hundred-kilometer scales matched with the mesoscale surveillance of the NEXRAD radars, --Development and application of a multi-sensor cloud phase algorithm to distinguish between liquid phase, mixed phase, and glaciated (no icing) conditions for purposes of a "truth" database and improved analysis in BAIRS II, --Development of concatenated hydrometeor size distributions to examine the in situ growth of both liquid and solid hydrometeors over a broad size spectrum; used, in part, to demonstrate differences between maritime and continental conditions, and --The Icing Hazard Levels (IHL) algorithm’s verification in icing conditions is consistent with previous work and, new, is documented to perform well when indicating "glaciated" (no icing) conditions.
READ LESS

Summary

The second Buffalo Area Icing and Radar Study (BAIRS II) was conducted during the winter of 2017. The BAIRS II partnership between Massachusetts Institute of Technology (MIT) Lincoln Laboratory (LL), the National Research Council of Canada (NRC), and Environment and Climate Change Canada (ECCC) was sponsored by the Federal Aviation...

READ MORE