Publications

Refine Results

(Filters Applied) Clear All

Measuring translation quality by testing English speakers with a new Defense Language Proficiency Test for Arabic

May 2, 2005
  |
Conference Paper
Author:
Douglas A. Jones
…
Published in:
Int. Conf. on Intelligence Analysis, 2-5 May 2005.
Topic:
machine translation
R&D area:
R&D group:

Summary

We present results from an experiment in which educated English-native speakers answered questions from a machine translated version of a standardized Arabic language test. We compare the machine translation (MT) results with professional reference translations as a baseline for the purpose of determining the level of Arabic reading comprehension that current machine translation technology enables an English speaker to achieve. Furthermore, we explore the relationship between the current, broadly accepted automatic measures of performance for machine translation and the Defense Language Proficiency Test, a broadly accepted measure of effectiveness for evaluating foreign language proficiency. In doing so, we intend to help translate MT system performance into terms that are meaningful for satisfying Government foreign language processing requirements. The results of this experiment suggest that machine translation may enable Interagency Language Roundtable Level 2 performance, but is not yet adequate to achieve ILR Level 3. Our results are based on 69 human subjects reading 68 documents and answering 173 questions, giving a total of 4,692 timed document trials and 7,950 question trials. We propose Level 3 as a reasonable nearterm target for machine translation research and development.
READ LESS

Summary

We present results from an experiment in which educated English-native speakers answered questions from a machine translated version of a standardized Arabic language test. We compare the machine translation (MT) results with professional reference translations as a baseline for the purpose of determining the level of Arabic reading comprehension that...

READ MORE
Measuring translation quality by testing English speakers with a new Defense Language Proficiency Test for Arabic

Laser beam combining for high-power, high-radiance sources

May 1, 2005
  |
Journal Article
Author:
Tso Yee Fan
Published in:
IEEE J. Sel. Top. Quantum Electron., Vol. 11, No. 3, May/June 2005, pp. 567-577.
Topic:
lasers
R&D area:
R&D group:

Summary

Beam combining of laser arrays with high efficiency and good beam quality for power and radiance (brightness) scaling is a long-standing problem in laser technology. Recently, significant progress has been made usingwavelength (spectral) techniques and coherent (phased array) techniques, which has led to the demonstration of beam combining of a large semiconductor diode laser array (100 array elements) with near-diffraction-limited output (M2 ~ 1.3) at significant power (35 W). This paper provides an overview of progress in beam combining and highlights some of the tradeoffs among beam-combining techniques.
READ LESS

Summary

Beam combining of laser arrays with high efficiency and good beam quality for power and radiance (brightness) scaling is a long-standing problem in laser technology. Recently, significant progress has been made usingwavelength (spectral) techniques and coherent (phased array) techniques, which has led to the demonstration of beam combining of a...

READ MORE
Laser beam combining for high-power, high-radiance sources

Multi-PRI signal processing for the terminal Doppler weather radar, part I: clutter filtering

May 1, 2005
  |
Journal Article
Author:
John Y. Cho
…
Published in:
J. Atmos. Ocean. Technol., Vol. 22, May 2005, pp. 575-582.
Topic:
algorithms
R&D area:
R&D group:

Summary

Multiple pulse repetition interval (multi-PRI) transmission is part of an adaptive signal transmission and processing algorithm being developed to aggressively combat range-velocity ambiguity in weather radars. In the past, operational use of multi-PRI pulse trains has been hampered due to the difficulty in clutter filtering. This paper presents finite impulse response clutter filter designs for multi-PRI signals with excellent magnitude and phase responses. These filters provide strong suppression for use on low-elevation scans and yield low biases of velocity estimates so that accurate velocity dealiasing is possible. Specifically, the filters are designed for use in the Terminal Doppler Weather Radar (TDWR) and are shown to meet base data bias requirements equivalent to the Federal Aviation Administration's specifications for the current TDWR clutter filters. Also an adaptive filter selection algorithm is proposed that bases its decision on clutter power estimated during an initial long-PRI surveillance scan. Simulations show that this adaptive algorithm yields satisfactory biases for reflectivity, velocity, and spectral width. Implementation of such a scheme would enable automatic elimination of anomalous propagation signals and constant adjustment to evolving ground clutter conditions, an improvement over the current TDWR clutter filtering system.
READ LESS

Summary

Multiple pulse repetition interval (multi-PRI) transmission is part of an adaptive signal transmission and processing algorithm being developed to aggressively combat range-velocity ambiguity in weather radars. In the past, operational use of multi-PRI pulse trains has been hampered due to the difficulty in clutter filtering. This paper presents finite impulse...

READ MORE
Multi-PRI signal processing for the terminal Doppler weather radar, part I: clutter filtering

Using leader-based communication to improve the scalability of single-round group membership algorithms

April 4, 2005
  |
Conference Paper
Author:
Roger I. Khazan
…
Published in:
IPDPS 2005: 19th Int. Parallel and Distributed Processing Symp., 4-8 April 2005, pp. 280-287.
Topic:
algorithms
R&D area:
R&D group:

Summary

Sigma, the first single-round group membership (GM) algorithm, was recently introduced and demonstrated to operate consistently with theoretical expectations in a simulated WAN environment. Sigma achieved similar quality of membership configurations as existing algorithms but required fewer message exchange rounds. We now consider Sigma in terms of scalability. Sigma involves all-to-all (A2A) type of communication among members. A2A protocols have been shown to perform worse than leader-based (LB) protocols in certain networks, due to greater message overhead and higher likelihood of message loss. Thus, although LB protocols often involve additional communication steps, they can be more efficient in practice, particularly in fault-prone networks with large numbers of participating nodes. In this paper, we present Leader-Based Sigma, which transforms the original all-to-all version into a more scalable centralized communication scheme, and discuss the rounds vs. messages tradeoff involved in optimizing GM algorithms for deployment in large-scale, fault-prone dynamic network environments.
READ LESS

Summary

Sigma, the first single-round group membership (GM) algorithm, was recently introduced and demonstrated to operate consistently with theoretical expectations in a simulated WAN environment. Sigma achieved similar quality of membership configurations as existing algorithms but required fewer message exchange rounds. We now consider Sigma in terms of scalability. Sigma involves...

READ MORE
Using leader-based communication to improve the scalability of single-round group membership algorithms

An annotated review of past papers on attack graphs

March 31, 2005
  |
Project Report
Author:
Richard P. Lippmann
…
Published in:
MIT Lincoln Laboratory Report IA-1
Topic:
attack graphs
R&D area:
R&D group:

Summary

This report reviews past research papers that describe how to construct attack graphs, how to use them to improve security of computer networks, and how to use them to analyze alerts from intrusion detection systems. Two commercial systems are described [I, 2], and a summary table compares important characteristics of past research studies. For each study, information is provided on the number of attacker goals, how graphs are constructed, sizes of networks analyzed, how well the approach scales to larger networks, and the general approach. Although research has made significant progress in the past few years, no system has analyzed networks with more than 20 hosts, and computation for most approaches scales poorly and would be impractical for networks with more than even a few hundred hosts. Current approaches also are limited because many require extensive and difficult-to-obtain details on attacks, many assume that host-to-host reachability information between all hosts is already available, and many produce an attack graph but do not automatically generate recommendations from that graph. Researchers have suggested promising approaches to alleviate some of these limitations, including grouping hosts to improve scaling, using worst-case default values for unknown attack details, and symbolically analyzing attack graphs to generate recommendations that improve security for critical hosts. Future research should explore these and other approaches to develop attack graph construction and analysis algorithms that can be applied to large enterprise networks.
READ LESS

Summary

This report reviews past research papers that describe how to construct attack graphs, how to use them to improve security of computer networks, and how to use them to analyze alerts from intrusion detection systems. Two commercial systems are described [I, 2], and a summary table compares important characteristics of...

READ MORE
An annotated review of past papers on attack graphs

Speaker adaptive cohort selection for Tnorm in text-independent speaker verification

March 19, 2005
  |
Conference Paper
Author:
Douglas E. Sturim
…
Published in:
Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, ICASSP, Vol. 1, 19-23 March 2005, pp. I-741 - I-744.
Topic:
speaker recognition
R&D area:
R&D group:

Summary

In this paper we discuss an extension to the widely used score normalization technique of test normalization (Tnorm) for text-independent speaker verification. A new method of speaker Adaptive-Tnorm that offers advantages over the standard Tnorm by adjusting the speaker set to the target model is presented. Examples of this improvement using the 2004 NIST SRE data are also presented.
READ LESS

Summary

In this paper we discuss an extension to the widely used score normalization technique of test normalization (Tnorm) for text-independent speaker verification. A new method of speaker Adaptive-Tnorm that offers advantages over the standard Tnorm by adjusting the speaker set to the target model is presented. Examples of this improvement...

READ MORE
Speaker adaptive cohort selection for Tnorm in text-independent speaker verification

Measuring human readability of machine generated text: three case studies in speech recognition and machine translation

March 19, 2005
  |
Conference Paper
Author:
Douglas A. Jones
…
Published in:
Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Vol. 5, ICASSP, 19-23 March 2005, pp. V-1009 - V-1012.
Topic:
machine translation
R&D area:
R&D group:

Summary

We present highlights from three experiments that test the readability of current state-of-the art system output from (1) an automated English speech-to-text system (2) a text-based Arabic-to-English machine translation system and (3) an audio-based Arabic-to-English MT process. We measure readability in terms of reaction time and passage comprehension in each case, applying standard psycholinguistic testing procedures and a modified version of the standard Defense Language Proficiency Test for Arabic called the DLPT*. We learned that: (1) subjects are slowed down about 25% when reading system STT output, (2) text-based MT systems enable an English speaker to pass Arabic Level 2 on the DLPT* and (3) audio-based MT systems do not enable English speakers to pass Arabic Level 2. We intend for these generic measures of readability to predict performance of more application-specific tasks.
READ LESS

Summary

We present highlights from three experiments that test the readability of current state-of-the art system output from (1) an automated English speech-to-text system (2) a text-based Arabic-to-English machine translation system and (3) an audio-based Arabic-to-English MT process. We measure readability in terms of reaction time and passage comprehension in each...

READ MORE
Measuring human readability of machine generated text: three case studies in speech recognition and machine translation

The 2004 MIT Lincoln Laboratory speaker recognition system

March 19, 2005
  |
Conference Paper
Author:
Douglas A. Reynolds
…
Published in:
Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, ICASSP, Vol. 1, 19-23 March 2005, pp. I-177 - I-180.
Topic:
speaker recognition
R&D area:
R&D group:

Summary

The MIT Lincoln Laboratory submission for the 2004 NIST Speaker Recognition Evaluation (SRE) was built upon seven core systems using speaker information from short-term acoustics, pitch and duration prosodic behavior, and phoneme and word usage. These different levels of information were modeled and classified using Gaussian Mixture Models, Support Vector Machines and N-gram language models and were combined using a single layer perception fuser. The 2004 SRE used a new multi-lingual, multi-channel speech corpus that provided a challenging speaker detection task for the above systems. In this paper we describe the core systems used and provide an overview of their performance on the 2004 SRE detection tasks.
READ LESS

Summary

The MIT Lincoln Laboratory submission for the 2004 NIST Speaker Recognition Evaluation (SRE) was built upon seven core systems using speaker information from short-term acoustics, pitch and duration prosodic behavior, and phoneme and word usage. These different levels of information were modeled and classified using Gaussian Mixture Models, Support Vector...

READ MORE
The 2004 MIT Lincoln Laboratory speaker recognition system

Design considerations and results for an overlapped subarray radar antenna

March 5, 2005
  |
Conference Paper
Author:
Jeffrey S. Herd
…
Published in:
2005 IEEE Aerospace Conf., 5-12 March 2005, pp. 1087-1092.
Topic:
antennas
R&D area:
R&D group:

Summary

Overlapped subarray networks produce flattopped sector patterns with low sidelobes that suppress grating lobes outside of the main beam of the subarray pattern. They are typically used in limited scan applications, where it is desired to minimize the number of controls required to steer the beam. However, the architecture of an overlapped subarray antenna includes many signal crossovers and a wide variation in splitting/combining ratios, which make it difficult to maintain required error tolerances. This paper presents the design considerations and results for an overlapped subarray radar antenna, including a custom subarray weighting function and the corresponding circuit design and fabrication. Measured pattern results will be shown for a prototype design compared with desired patterns.
READ LESS

Summary

Overlapped subarray networks produce flattopped sector patterns with low sidelobes that suppress grating lobes outside of the main beam of the subarray pattern. They are typically used in limited scan applications, where it is desired to minimize the number of controls required to steer the beam. However, the architecture of...

READ MORE
Design considerations and results for an overlapped subarray radar antenna

Evaluating static analysis tools for detecting buffer overflows in C code

March 1, 2005
  |
Thesis
Author:
Kendra J. Kratkiewicz
Published in:
Thesis (MLA)--Harvard University, 2005.
Topic:
software
R&D area:
R&D group:

Summary

This project evaluated five static analysis tools using a diagnostic test suite to determine their strengths and weaknesses in detecting a variety of buffer overflow flaws in C code. Detection, false alarm, and confusion rates were measured, along with execution time. PolySpace demonstrated a superior detection rate on the basic test suite, missing only one out of a possible 291 detections. It may benefit from improving its treatment of signal handlers, and reducing both its false alarm rate (particularly for C library functions) and execution time. ARCHER performed quite well with no false alarms whatsoever; a few key enhancements, such as in its inter-procedural analysis and handling of C library functions, would boost its detection rate and should improve its performance on real-world code. Splint detected significantly fewer overflows and exhibited the highest false alarm rate. Improvements in its loop handling, and reductions in its false alarm rate would make it a much more useful tool. UNO had no false alarms, but missed a broad variety of overflows amounting to nearly half of the possible detections in the test suite. It would need improvement in many areas to become a very useful tool. BOON was clearly at the back of the pack, not even performing well on the subset of test cases where it could have been expected to function. The project also provides a buffer overflow taxonomy, along with a test suite generator and other tools, that can be used by others to evaluate code analysis tools with respect to buffer overflow detection.
READ LESS

Summary

This project evaluated five static analysis tools using a diagnostic test suite to determine their strengths and weaknesses in detecting a variety of buffer overflow flaws in C code. Detection, false alarm, and confusion rates were measured, along with execution time. PolySpace demonstrated a superior detection rate on the basic...

READ MORE
Evaluating static analysis tools for detecting buffer overflows in C code
1381-1390 of 2318