Publications
Tagged As
Application of a development time productivity metric to parallel software development
May 15, 2005
Conference Paper
Published in:
SE-HPCS '05, 2nd Int. Worskhop on Software Engineering for High Performance Computing System Applications, 15 May 2005, pp. 8-12.
Topic:
R&D group:
Summary
Evaluation of High Performance Computing (HPC) systems should take into account software development time productivity in addition to hardware performance, cost, and other factors. We propose a new metric for HPC software development time productivity, defined as the ratio of relative runtime performance to relative programmer effort. This formula has been used to analyze several HPC benchmark codes and classroom programming assignments. The results of this analysis show consistent trends for various programming models. This method enables a high-level evaluation of development time productivity for a given code implementation, which is essential to the task of estimating cost associated with HPC software development.
Summary
Evaluation of High Performance Computing (HPC) systems should take into account software development time productivity in addition to hardware performance, cost, and other factors. We propose a new metric for HPC software development time productivity, defined as the ratio of relative runtime performance to relative programmer effort. This formula has...
READ MORE
Evaluating static analysis tools for detecting buffer overflows in C code
March 1, 2005
Thesis
Published in:
Thesis (MLA)--Harvard University, 2005.
Topic:
R&D area:
R&D group:
Summary
This project evaluated five static analysis tools using a diagnostic test suite to determine their strengths and weaknesses in detecting a variety of buffer overflow flaws in C code. Detection, false alarm, and confusion rates were measured, along with execution time. PolySpace demonstrated a superior detection rate on the basic test suite, missing only one out of a possible 291 detections. It may benefit from improving its treatment of signal handlers, and reducing both its false alarm rate (particularly for C library functions) and execution time. ARCHER performed quite well with no false alarms whatsoever; a few key enhancements, such as in its inter-procedural analysis and handling of C library functions, would boost its detection rate and should improve its performance on real-world code. Splint detected significantly fewer overflows and exhibited the highest false alarm rate. Improvements in its loop handling, and reductions in its false alarm rate would make it a much more useful tool. UNO had no false alarms, but missed a broad variety of overflows amounting to nearly half of the possible detections in the test suite. It would need improvement in many areas to become a very useful tool. BOON was clearly at the back of the pack, not even performing well on the subset of test cases where it could have been expected to function. The project also provides a buffer overflow taxonomy, along with a test suite generator and other tools, that can be used by others to evaluate code analysis tools with respect to buffer overflow detection.
Summary
This project evaluated five static analysis tools using a diagnostic test suite to determine their strengths and weaknesses in detecting a variety of buffer overflow flaws in C code. Detection, false alarm, and confusion rates were measured, along with execution time. PolySpace demonstrated a superior detection rate on the basic...
READ MORE
Application of a Relative Development Time Productivity Metric to Parallel Software Development
January 1, 2005
Conference Paper
Published in:
SE-HPCS '05: Proceedings of the second international workshop on Software engineering for high performance computing system applications
Topic:
R&D area:
R&D group:
Summary
Evaluation of High Performance Computing (HPC) systems should take into account software development time productivity in addition to hardware performance, cost, and other factors. We propose a new metric for HPC software development time productivity, defined as the ratio of relative runtime performance to relative programmer effort. This formula has been used to analyze several HPC benchmark codes and classroom programming assignments. The results of this analysis show consistent trends for various programming models. This method enables a high-level evaluation of development time productivity for a given code implementation, which is essential to the task of estimating cost associated with HPC software development.
Summary
Evaluation of High Performance Computing (HPC) systems should take into account software development time productivity in addition to hardware performance, cost, and other factors. We propose a new metric for HPC software development time productivity, defined as the ratio of relative runtime performance to relative programmer effort. This formula has...
READ MORE
Testing static analysis tools using exploitable buffer overflows from open source code
October 31, 2004
Conference Paper
Published in:
Proc. 12th Int. Symp. on Foundations of Software Engineering, ACM SIGSOFT, 31 October - 6 November 2004, pp. 97-106.
Topic:
R&D area:
R&D group:
Summary
Five modern static analysis tools (ARCHER, BOON, PolySpace C Verifier, Splint, and UNO) were evaluated using source code examples containing 14 exploitable buffer overflow vulnerabilities found in various versions of Sendmail, BIND, and WU-FTPD. Each code example included a "BAD" case with and a "OK" case without buffer overflows. Buffer overflows varied and included stack, heap, bss and data buffers; access above and below buffer bounds; access using pointers, indices, and functions; and scope differences between buffer creation and use. Detection rates for the "BAD" examples were low except for PolySpace and Splint which had average detection rates of 87% and 57%, respectively. However, average false alarm rates were high and roughly 50% for these two tools. On patched programs these two tools produce one warning for every 12 to 46 lines of source code and neither tool accurately distinguished between vulnerable and patched code.
Summary
Five modern static analysis tools (ARCHER, BOON, PolySpace C Verifier, Splint, and UNO) were evaluated using source code examples containing 14 exploitable buffer overflow vulnerabilities found in various versions of Sendmail, BIND, and WU-FTPD. Each code example included a "BAD" case with and a "OK" case without buffer overflows. Buffer...
READ MORE
The radar Correlation and Interpolation (C&I) algorithms deployed in the ASR-9 Processor Augmentation Card (9PAC)
June 29, 2001
Project Report
Published in:
MIT Lincoln Laboratory Report ATC-299
Summary
The Airport Surveillance Radar 9 (ASR-9) is a terminal radar that was deployed by the Federal Aviation Administration (FAA) during the early 1990's at more than 130 of the busiest airports in the United States. The ASR-9 Processor Augmentation Card (9-PAC), developed at MIT Lincoln Laboratory, is a processor board enhancement for the ASR-9 Array Signal Processor (ASP) that provides increases in processing speed, memory size, and programming. The increased capabilities of the 9PAC hardware made it possible for new surveillance algorithms to be developed in software to provide improved primary radar and beacon surveillance performance. The 9PAC project was developed in two phases. Phase I, which addressed the beacon reflection false target problem, was completed, and is currently being deployed nationwide by the FAA on a plug and play basis. Phase II addresses the primary radar surveillance problems, which include automation of the road and ground clutter censoring process, improving the rejection of false targets, and improving the detection and tracking of aircraft targets. The 9PAC also reduces the life-cycle maintenance cost of the ASR-9 in the Phase II configuration, in which a single 9PAC card replaces four ASP cards. This report describes the improvements to the radar Correlation and Interpolation (C&I) process, which is responsible for creating aircraft target reports and filtering out false targets. [Not Complete]
Summary
The Airport Surveillance Radar 9 (ASR-9) is a terminal radar that was deployed by the Federal Aviation Administration (FAA) during the early 1990's at more than 130 of the busiest airports in the United States. The ASR-9 Processor Augmentation Card (9-PAC), developed at MIT Lincoln Laboratory, is a processor board...
READ MORE
Controller-human interface design for the final approach spacing tool
June 17, 1995
Conference Paper
Published in:
Proc. IFAC Man-Machine Systems Conf., 27-29 June 1995, pp. 559-564.
Summary
The Federal Aviation Administration is developing a set of software tools, known as the Center-TRACON Automation System (CTAS) to assist air traffic controllers in their management and control tasks. CTAS originated at National Aeronautics and Space Administration (NASA) Ames Research Center, where prototypes continue to evolve. In parallel, Massachusetts Institute of Technology/Lincoln Laboratory (MIT/LL) is refining and testing the software, including the Computer-Human Interface (CHI). This paper focuses on the CHI designed by MIT/LL for the Final Approach Spacing Tool (FAST) part of CTAS. The FAST design approach, CHI development and operational concept is presented.
Summary
The Federal Aviation Administration is developing a set of software tools, known as the Center-TRACON Automation System (CTAS) to assist air traffic controllers in their management and control tasks. CTAS originated at National Aeronautics and Space Administration (NASA) Ames Research Center, where prototypes continue to evolve. In parallel, Massachusetts Institute...
READ MORE
Results of L band multipath measurements at operational United States (U.S.) airports in support of the Microwave Landing System (MLS) Precision Distance Measuring Equipment (DME/P)
July 23, 1981
Project Report
Published in:
MIT Lincoln Laboratory Report ATC-109
Summary
This report presents the results of a short duration L band multipath measurement program at five major U.S. airports (St. Louis, Tulsa, Wright Patterson Air Force Base, Philadelphia and Washington National) and one smaller airport (Quonset, RI) to better quantify the expected multipath environment for the Microwave Landing System (MLS) Precision Distance Measuring Equipment (DME/P). Specific objectives included: (1) Measurements of the principal multipath parameters (amplitude and time delay) with realistic aircraft/ground site locations at runways which had the major DME/multipath sources (large buildings) identified in previous analytical (simulation) studies. (2) Determination of whether significant DME/P multipath sources exist which had not been considered to date and (3) Comparison of the measured results with computer simulation results obtained with simplified airport models (such as have been used for DME/P system design to date). Particular emphasis was placed on the final approach region including the flare and rollout regions since these areas correspond to the most stringent DME/P accuracy requirements and, have not been utilized operationally with the current L band DME. All of the above objectives were achieved although in some cases the experimental data in the flare/rollout region was of poor quality due to low signal to noise ratio. The spatial region and time delay of specular multipath generally correlated well with expectations based on simple ray tracing. With the exception of Washington National, no significant (multipath to direct signal ratio (M/D >110 dB) multipath was encountered in operationally relevant areas which was not predicted. The quantitative predictions of the simple airport models agreed with the experimental data, although in some cases, (especially, near threshold) the measured M/D values were considerably higher than predictions.
Summary
This report presents the results of a short duration L band multipath measurement program at five major U.S. airports (St. Louis, Tulsa, Wright Patterson Air Force Base, Philadelphia and Washington National) and one smaller airport (Quonset, RI) to better quantify the expected multipath environment for the Microwave Landing System (MLS)...
READ MORE
MLS Multipath Studies, Phase 3 Final Report, Volume III: Application of Models to MLS Assessment Issues, Part 1
June 8, 1981
Project Report
Published in:
MIT Lincoln Laboratory Report ATC-88,III,PT-1
Summary
This report presents work done during phase 3 of the US national Microwave Landing System (MLS) program toward developing a computer simulation model of the MLS multipath effects, the experimental validation ot the model, and the application of the model to investigate multipath performance of ICAO proposals for the new approach and landing guidance system. The first two volumes of the report presented an overview of the simulation effort as well as describing in detail the propagation and MLS technique mathematical models and their validation by comparison with experimental data. In this volume, we describe the results of comparative simulations for the various MLS techniques in various scenarios and analyze in detail certain multipath performance features which were found to be significant in the scenario simulations. Simulation results are presented for several scenarios, and shadowing of the MLS azimuth by taxiing and overflying aircraft is analyzed. The remainder of the report focuses on multipath performance factors specific to various individual techniques. These include: (1) the effects of angle data outlier tests and filtering in the TRSB receivers, (2) the effects on the DMLS system due to receiver AGC, receiver motion-induced Doppler shifts, and the use of commutated reference systems, and (3) acquisition/validation algorithms for all three techniques. The report concludes with a summary and suggestions for future work. Part I of this volume consists of Chapters I through IV; Part II contains Chapters V through VIII and the Appendices.
Summary
This report presents work done during phase 3 of the US national Microwave Landing System (MLS) program toward developing a computer simulation model of the MLS multipath effects, the experimental validation ot the model, and the application of the model to investigate multipath performance of ICAO proposals for the new...
READ MORE
MLS Multipath Studies, Phase 3, Volume II: Development and Validation of Model for MLS Techniques
February 7, 1980
Project Report
Published in:
MIT Lincoln Laboratory Report ATC-88,II
Summary
This report presents work done during phase 3 of the US national Microwave Landing System (MLS) program toward developing a computer simulation model of the MLS multipath effects, the experimental validation ot the model, and the application of the model to investigate multipath performance of ICAO proposals for the new approach and landing guidance system. This second volume of the report presents the mathematical models and validation data for the MLS techniques which were assessed in detail by the All Weather Operations Panel of the Interational Civil Aviation Organization. The specific techniques modeled are: 1. The Time Reference Scanning Beam (TRSB) system proposed by the United States (US) and Australia, with prime emphasis on the US equipment implementation and field test data, 2. the Doppler scan (DMLS) proposed by the United Kingdom, and 3. the DME Based Landing System (DLS) proposed by the Federal Republic of Germany.
Summary
This report presents work done during phase 3 of the US national Microwave Landing System (MLS) program toward developing a computer simulation model of the MLS multipath effects, the experimental validation ot the model, and the application of the model to investigate multipath performance of ICAO proposals for the new...
READ MORE
MLS Multipath Studies, Phase 3, Volume I: Overview and Propagation Model Validation/Refinement Studies
April 25, 1979
Project Report
Published in:
MIT Lincoln Laboratory Report ATC-88,I
Summary
This report presents work done during phase 3 of the US national Microwave Landing System (MLS) program toward developing a computer simulation model of the MLS multipath effects, the experimental validation ot the model, and the application of the model to investigate multipath performance of ICAO proposals for the new approach and landing guidance system. This first volume of the report presents an overview of the overall simulation results as well as a description of the refined mathematical models and validation of the propagation portion of the simulation. Specific propagation topics include: 1) preliminary results for validation of models for reflections from rough and/or rising terrain based on L-band field data. 2) validation of the models for building reflections based on field measurements at a number of operational airports. 3) validation and refinement of the models for angle guidance system shadowing by obstacles such as buildings and other objects.
Summary
This report presents work done during phase 3 of the US national Microwave Landing System (MLS) program toward developing a computer simulation model of the MLS multipath effects, the experimental validation ot the model, and the application of the model to investigate multipath performance of ICAO proposals for the new...
READ MORE