Publications
LLSuperCloud: sharing HPC systems for diverse rapid prototyping
September 10, 2013
Conference Paper
Published in:
HPEC 2013: IEEE Conf. on High Performance Extreme Computing, 10-12 September 2013.
Topic:
R&D area:
R&D group:
Summary
The supercomputing and enterprise computing arenas come from very different lineages. However, the advent of commodity computing servers has brought the two arenas closer than they have ever been. Within enterprise computing, commodity computing servers have resulted in the development of a wide range of new cloud capabilities: elastic computing, virtualization, and data hosting. Similarly, the supercomputing community has developed new capabilities in heterogeneous, massively parallel hardware and software. Merging the benefits of enterprise clouds and supercomputing has been a challenging goal. Significant effort has been expended in trying to deploy supercomputing capabilities on cloud computing systems. These efforts have resulted in unreliable, low performance solutions, which requires enormous expertise to maintain. LLSuperCloud provides a novel solution to the problem of merging enterprise cloud and supercomputing technology. More specifically LLSuperCloud reverses the traditional paradigm of attempting to deploy supercomputing capabilities on a cloud and instead deploys cloud capabilities on a supercomputer. The result is a system that can handle heterogeneous, massively parallel workloads while also providing high performance elastic computing, virtualization, and databases. The benefits of LLSuperCloud are highlighted using a mixed workload of C MPI, parallel MATLAB, Java, databases, and virtualized web services.
Summary
The supercomputing and enterprise computing arenas come from very different lineages. However, the advent of commodity computing servers has brought the two arenas closer than they have ever been. Within enterprise computing, commodity computing servers have resulted in the development of a wide range of new cloud capabilities: elastic computing...
READ MORE
D4M 2.0 Schema: a general purpose high performance schema for the Accumulo database
September 10, 2013
Conference Paper
Published in:
HPEC 2013: IEEE Conf. on High Performance Extreme Computing, 10-12 September 2013.
Summary
Non-traditional, relaxed consistency, triple store databases are the backbone of many web companies (e.g., Google Big Table, Amazon Dynamo, and Facebook Cassandra). The Apache Accumulo database is a high performance open source relaxed consistency database that is widely used for government applications. Obtaining the full benefits of Accumulo requires using novel schemas. The Dynamic Distributed Dimensional Data Model (D4M) [http://www.mit.edu/~kepner/D4M] provides a uniform mathematical framework based on associative arrays that encompasses both traditional (i.e., SQL) and non-traditional databases. For non-traditional databases D4M naturally leads to a general purpose schema that can be used to fully index and rapidly query every unique string in a dataset. The D4M 2.0 Schema has been applied with little or no customization to cyber, bioinformatics, scientific citation, free text, and social media data. The D4M 2.0 Schema is simple, requires minimal parsing, and achieves the highest published Accumulo ingest rates. The benefits of the D4M 2.0 Schema are independent of the D4M interface. Any interface to Accumulo can achieve these benefits by using the D4M 2.0 Schema.
Summary
Non-traditional, relaxed consistency, triple store databases are the backbone of many web companies (e.g., Google Big Table, Amazon Dynamo, and Facebook Cassandra). The Apache Accumulo database is a high performance open source relaxed consistency database that is widely used for government applications. Obtaining the full benefits of Accumulo requires using...
READ MORE
Slab-coupled optical waveguide (SCOW) devices and photonic integrated circuits (PICs)
September 8, 2013
Conference Paper
Published in:
2013 IEEE Photonics Conf. (IPC), 8-12 September 2013.
Topic:
R&D area:
Summary
We review recent advances in the development of slab-coupled optical waveguide (SCOW) devices, progress toward a flexible photonic integration platform containing both conventional high-confinement and SCOW ultra-low confinement devices, and applications of this technology.
Summary
We review recent advances in the development of slab-coupled optical waveguide (SCOW) devices, progress toward a flexible photonic integration platform containing both conventional high-confinement and SCOW ultra-low confinement devices, and applications of this technology.
READ MORE
Multifunction Phased Array Radar (MPAR): achieving Next Generation Surveillance and Weather Radar Capability
September 1, 2013
Journal Article
Published in:
J. Air Traffic Control, Vol. 55, No. 3, Fall 2013, pp. 40-7.
Summary
Within DOT, the FAA has initiated an effort known as the NextGen Surveillance and Weather Radar Capability (NSWRC) to analyze the need for the next generation radar replacement and assess viable implementation alternatives. One concept under analysis is multifunction radar using phased-array technology -- Multifunction Phased Array Radar or MPAR.
Summary
Within DOT, the FAA has initiated an effort known as the NextGen Surveillance and Weather Radar Capability (NSWRC) to analyze the need for the next generation radar replacement and assess viable implementation alternatives. One concept under analysis is multifunction radar using phased-array technology -- Multifunction Phased Array Radar or MPAR.
READ MORE
Pixel-processing imager development for directed energy applications
August 26, 2013
Conference Paper
Published in:
Directed Energy Systems Symposium, 26-29 August 2013.
Summary
Tactical high-energy laser (HEL) systems face a range of imaging-related challenges in wavefront sensing, acquiring and tracking targets, selecting the HEL aimpoint, and assessing lethality. Accomplishing these functions in a timely fashion may be limited by competing requirements on total field of regard, target resolution, signal to noise, and focal plane readout bandwidth. In this paper, we explore the applicability of an emerging pixel-processing imager (PPI) technology to these challenges. The on-focal-plane signal processing capabilities of the MIT Lincoln Laboratory PPI technology have recently been extended in support of directed energy applications. We describe this work as well as early results from a new PPI-based short-wave-infrared focal plane readout capable of supporting diverse applications such as low-latency Shack-Hartmann wavefront sensing, centroid computation, and Fitts correlation tracking.
Summary
Tactical high-energy laser (HEL) systems face a range of imaging-related challenges in wavefront sensing, acquiring and tracking targets, selecting the HEL aimpoint, and assessing lethality. Accomplishing these functions in a timely fashion may be limited by competing requirements on total field of regard, target resolution, signal to noise, and focal...
READ MORE
Very large graphs for information extraction (VLG) - summary of first-year proof-of-concept study
August 20, 2013
Project Report
Published in:
MIT Lincoln Laboratory Report VLG-1
Summary
In numerous application domains relevant to the Department of Defense and the Intelligence Community, data of interest take the form of entities and the relationships between them, and these data are commonly represented as graphs. Under the Very Large Graphs for Information Extraction effort--a one-year proof-of-concept study--MIT LL developed novel techniques for anomalous subgraph detection, building on tools in the signal processing research literature. This report documents the technical results of this effort. Two datasets--a snapshot of Thompson Reuters? Web of Science database and a stream of web proxy logs--were parsed, and graphs were constructed from the raw data. From the phenomena in these datasets, several algorithms were developed to model the dynamic graph behavior, including a preferential attachment mechanism with memory, a streaming filter to model a graph as a weighted average of its past connections, and a generalized linear model for graphs where connection probabilities are determined by additional side information or metadata. A set of metrics was also constructed to facilitate comparison of techniques. The study culminated in a demonstration of the algorithms on the datasets of interest, in addition to simulated data. Performance in terms of detection, estimation, and computational burden was measured according to the metrics. Among the highlights of this demonstration were the detection of emerging coauthor clusters in the Web of Science data, detection of botnet activity in the web proxy data after 15 minutes (which took 10 days to detect using state-of-the-practice techniques), and demonstration of the core algorithm on a simulated 1-billion-vertex graph using a commodity computing cluster.
Summary
In numerous application domains relevant to the Department of Defense and the Intelligence Community, data of interest take the form of entities and the relationships between them, and these data are commonly represented as graphs. Under the Very Large Graphs for Information Extraction effort--a one-year proof-of-concept study--MIT LL developed novel...
READ MORE
Due regard encounter model version 1.0
August 19, 2013
Project Report
Published in:
MIT Lincoln Laboratory Report ATC-397
Topic:
R&D area:
R&D group:
Summary
Airspace encounter models describe encounter situations that may occur between aircraft in the airspace and are a critical component of safety assessment of sense and avoid (SAA) systems for Unmanned Aircraft Systems (UASs). Some UAS will fly in international airspace under due regard and may encounter other aircraft during these operations. In these types of encounters, the intruder aircraft is likely receiving air traffic control (ATC) services, but the UAS is not. Thus, there is a need for a due regard encounter model that can be used to generate these types of encounters. This report describes the development of a due regard encounter model. In order to build the model, Lincoln Laboratory collected data for aircraft flying in international airspace using the Enhanced Traffic Management System (ETMS) data feed that was provided by the Volpe Center. Lincoln processed these data, and extracted important features to construct the model. The model is based on Bayesian networks that represent the probabilistic relationship between variables that describe how aircraft behave. The model is used to construct random aircraft trajectories that are statistically similar to those observed in the airspace. A large collection of encounters generated from an airspace encounter model can be used to evaluate the performance of a SAA system against encounter situations representative of those expected to actually occur in the airspace. Lincoln Laboratory has previously developed several other encounter models. There is an uncorrelated encounter model that is used to generate encounters with an intruder that does not have a transponder, or between two aircraft using a Mode A code of 1200 (VFR). There is also a correlated encounter model that is used when both aircraft have a transponder and at least one aircraft is in contact with ATC. Both of these models were built from radar data collected from the National Airspace System (NAS). There is also an unconventional encounter model that is used to generate encounters with unconventional intruders such as gliders, balloons, and airships--these vehicles have different flight characteristics than conventional aircraft. The framework used to construct the due regard encounter model described in this paper is similar to the prior models. The primary difference is that a different data feed is used and the model covers encounters in international flight where the aircraft of interest is flying due regard, which were not within the scope of prior models. Separate electronic files are available from Lincoln Laboratory that contain the statistical data required to generate encounter trajectories.
Summary
Airspace encounter models describe encounter situations that may occur between aircraft in the airspace and are a critical component of safety assessment of sense and avoid (SAA) systems for Unmanned Aircraft Systems (UASs). Some UAS will fly in international airspace under due regard and may encounter other aircraft during these...
READ MORE
A language-independent approach to automatic text difficulty assessment for second-language learners
August 4, 2013
Conference Paper
Published in:
Proc. 2nd Workshop on Predicting and Improving Text Readability for Target Reader Populations, 4-9 August 2013.
Topic:
R&D area:
Summary
In this paper we introduce a new baseline for language-independent text difficulty assessment applied to the Interagency Language Roundtable (ILR) proficiency scale. We demonstrate that reading level assessment is a discriminative problem that is best-suited for regression. Our baseline uses z-normalized shallow length features and TF-LOG weighted vectors on bag-of-words for Arabic, Dari, English, and Pashto. We compare Support Vector Machines and the Margin-Infused Relaxed Algorithm measured by mean squared error. We provide an analysis of which features are most predictive of a given level.
Summary
In this paper we introduce a new baseline for language-independent text difficulty assessment applied to the Interagency Language Roundtable (ILR) proficiency scale. We demonstrate that reading level assessment is a discriminative problem that is best-suited for regression. Our baseline uses z-normalized shallow length features and TF-LOG weighted vectors on bag-of-words...
READ MORE
Exploring the variable sky with LINEAR. II. Halo structure and substructure traces by RR Lyrae stars to 30 kpc
August 1, 2013
Journal Article
Published in:
Astron. J., Vol. 146, No. 21, August 2013.
Topic:
R&D area:
R&D group:
Summary
We present a sample of ~5000 RR Lyrae stars selected from the recalibrated LINEAR data set and detected at heliocentric distances between 5 kpc and 30 kpc over ~8000 deg^2 of sky. The coordinates and light curve properties, such as period and Oosterhoff type, are made publicly available. We analyze in detail the light curve properties and Galactic distribution of the subset of ~4000 type ab RR Lyrae (RRab) stars, including a search for new halo substructures and the number density distribution as a function of Oosterhoff type. We find evidence for the Oosterhoff dichotomy among field RR Lyrae stars, with the ratio of the type II and I subsamples of about 1:4, but with a weaker separation than for globular cluster stars. The wide sky coverage and depth of this sample allow unique constraints for the number density distribution of halo RRab stars as a function of galactocentric distance: it can be described as an oblate ellipsoid with an axis ratio q = 0.63 and with either a single or a double power law with a power-law index in the range -2 to -3. Consistent with previous studies, we find that the Oosterhoff type II subsample has a steeper number density profile than the Oosterhoff type I subsample. Using the group-finding algorithm EnLink, we detected seven candidate halo groups, only one of which is statistically spurious. Three of these groups are near globular clusters (M53/NGC 5053, M3, M13), and one is near a known halo substructure (Virgo Stellar Stream); the remaining three groups do not seem to be near any known halo substructures or globular clusters and seem to have a higher ratio of Oosterhoff type II to Oosterhoff type I RRab stars than what is found in the halo. The extended morphology and the position (outside the tidal radius) of some of the groups near globular clusters are suggestive of tidal streams possibly originating from globular clusters. Spectroscopic follow-up of detected halo groups is encouraged.
Summary
We present a sample of ~5000 RR Lyrae stars selected from the recalibrated LINEAR data set and detected at heliocentric distances between 5 kpc and 30 kpc over ~8000 deg^2 of sky. The coordinates and light curve properties, such as period and Oosterhoff type, are made publicly available. We analyze...
READ MORE
Stepped notch antenna array used as a low thermal resistance heat sink
July 7, 2013
Conference Paper
Published in:
IEEE Antennas and Propagation Society Int. Symp. 2013, 7-13 July 2013.
Summary
A stepped notch antenna at Ku-band is developed to provide a thermal heat sink for active arrays. The antenna with forced air cooling provides up to 0.4 degrees C/W of thermal resistance. The antenna integration with a printed circuit board allows for high volume surface mount assembly of active devices.
Summary
A stepped notch antenna at Ku-band is developed to provide a thermal heat sink for active arrays. The antenna with forced air cooling provides up to 0.4 degrees C/W of thermal resistance. The antenna integration with a printed circuit board allows for high volume surface mount assembly of active devices.
READ MORE