Ada Compiler Evaluation System

ACES 2.1



Contract Number F33600-92-D-0125

CDRL A0014

Prepared for:

High Order Language Control Facility

Business Software Support Branch


Wright-Patterson AFB OH 45433-5707

Prepared by:


5100 Springfield Pike, Suite 100

Dayton OH 45431

Availability of the Ada Compiler Evaluation System

The ACES software and documentation are available by anonymous FTP from the host "" in the directory "public/AdaIC/testing/aces/v2.0" and from other Ada-related hosts. Document files are included in PostScript format and as ASCII text. The ACES files are also accessible via the World-Wide Web. The home page URL is "".

For further information about the ACES, contact the High Order Language Control Facility. As of 1 March 1995, the appropriate contact is:

Mr. Brian Andrews


3810 Communications, Suite 1

Wright-Patterson AFB, OH 45433-5707

(513) 255-4472


Go to: Section Summary or Table of Contents

This document serves as an introduction to the nature and use of the Ada Compiler Evaluation System (ACES), Version 2.1. The intent of the Primer is to provide the minimum information needed to assess an implementation of the Ada language using the ACES and/or the ACES Quick-Look Facility. It addresses only those issues that are expected to arise in a straight-forward application of the ACES. Other documents in the ACES documentation set should be referenced if issues arise that are not covered in the Primer.

The Primer is meant to be usable by any person who has knowledge of the operating systems and compilation system being tested. Previous ACES experience is not necessary.

The document consists of eight sections, each of which is briefly described in the following list:

* Section 1, "Overview of ACES"

Summarizes the purpose and structure of the ACES and gives a high-level view of its use.

* Section 2, "File Names and Installation"

Describes the ACES files, the default directory structure, and the installation procedures.

* Section 3, "Setup"

Describes the use of the automated Pretest process that must be completed before performance testing can begin.

* Section 4, "Performance Testing"

Describes the use of the Harness tool in executing and tracking the performance tests.

* Section 5, "Performance Analysis"

Describes the use of the Condense, Comparative Analysis, and Single System Analysis tools in analyzing the data produced by the performance tests.

* Section 6, "Assessors"

Describes the use of the Assessor software and scenarios for determining system capacities and the capabilities of the symbolic debugger, the library management system, and the diagnostics system.

* Section 7, "Interpretation of Results"

Describes the most useful reports that are produced by the Analysis tools and the assessors.

* Section 8, "Quick-Look"

Describes the use of the ACES Quick-Look facility which provides a subset of key ACES performance tests.

The user is expected to refer to other documents when issues arise that are not anticipated in straight-forward uses of the ACES. Information on the execution of the tests and tools is maintained in the User's Guide. Information on the use of the results, including discussions of analysis techniques, is maintained in the Reader's Guide.

If the user wishes to do only performance testing, then he/she should read Primer Sections 1 through 4. (Note that it is necessary to perform the steps described in Section 3 before doing performance testing.) If he/she then wishes to use the Analysis tools, Section 5 is important. Section 7 will be helpful in this case, also. If the user does not wish to use the ACES analysis techniques, then he/she should follow the instructions in the Condense subsection of Section 7, choosing to produce comma-delimited output. These files can then be imported into the analysis tools of the user's choice.

If the user wishes to use only the Assessors, then he/she should use Primer Sections 1 through 3 and Section 6. Note that some of the steps described in Section 3 must be performed before using the Assessors. The Section 7 paragraphs on the Assessors are also useful in this case.

If the user wishes to use the Quick-Look facility, he/she should use Primer Section 8.