Home/Compilers

Ada Flyer The Ada Compiler
Validation Process

An Introduction to the Validation Process
An "Ada implementation" comprises an Ada compiler, linker, any other necessary software, its host computer (on which the compiler is run), and the target computer (on which the generated code will be run).

The purpose of validation is to provide reasonable assurance that implementations conform to ANSI/ISO/IEC 8652:1995. Compliance is measured only within the limits of the collection of test programs contained in the Ada Compiler Validation Capability (ACVC). Characteristics not specified by the standard, such as performance or suitability for a particular application, are outside the scope of Ada validation.

The validation process is carried out by the Ada certification body. This body consists of the Ada Joint Program Office (AJPO), the Ada Validation Organization (AVO), the ACVC Maintenenace Organization (AMO) and the Ada Validation Facilities (AVFs).

The AJPO establishes and provides policy guidance for the certification body. The AJPO maintains current operating agreements with the AVFs, issues validation certificates for AVF-tested Ada implementations, and maintains the official list of implementations validated by AVF testing and by registration. The AVO provides technical guidance of the certification system, registers Ada implementations that are untested by an AVF, reviews all Validation Summary Reports (VSRs), and reviews and adjudicates (with the assistance of the Fast Reaction Team of advisors) all disputes regarding the Ada test instrument. The AMO maintains the Ada Compiler Validation Capability (ACVC). The AVFs perform the actual testing.

The Ada Compiler Validation Capability

The ACVC is designed to demonstrate the conformity of an Ada implementation with the standard. The ACVC is distributed as a collection of test programs, support programs that facilitate processing the tests, and an ACVC User's Guide that explains the criteria for evaluating the results. The test suite is available on-line from the Ada Information Clearinghouse's (AdaIC's) Internet host.

For organizations requiring Ada 83 compiler testing, AJPO procedures allow an AVF to perform testing with ACVC 1.11; no certificate will be issued, but the AJPO will provide a letter affirming the successful testing by an AVF.

For Ada 95 compiler testing, ACVC 2.1 is the only version for which testing can lead to certification. However, testing with an expired version of the Ada 95 ACVC (versions 2.0 and 2.0.1) may be tested by an AVF, and the AJPO will issue a letter of affirmation as described above for Ada 83.

For Ada 95 compilers, compliance is measured only within the limits of the collection of test programs contained in the ACVC for the core language and specialized needs annexes. An Ada implementation passes a given ACVC version if it processes each core language test of the customized test suite in accordance with criteria for individual tests. For each Specialized Needs Annex, the implementation chooses whether to attempt the relevant tests. The behavior of the implementation with respect to the Specialized Needs Annexes does not affect the issuance of a validation certificate.

Each Ada 95 validation certificate is accompanied by a matrix displaying the test result profiles for all the Specialized Needs Annexes. The information contained in the matrix is reformatted and provided in the Validated Compilers List (VCL) to allow easy access for buyers and users who need to understand the levels of support provided by these implementations.

The matrix displays the number of tests that were Passed, Not Applicable, Not Supported, and Withdrawn for each of six Specialized Needs Annexes: System Programming, Real-Time Systems, Distributed Systems, Information Systems, Numerics, and Safety and Security. Tests allocated to these annexes are processed only when the vendor claims support.

Test Profile for Specialized Needs Annexes
Test Categories Passed Not Applicable Not Supported Withdrawn Totals
Annex C System Programming      
Annex E Distributed Systems      
Annex D Real Time Systems      
Annex F Information Systems      
Annex G Numerics      
Annex H Safety and Security      
Totals      

Validation by AVF Testing

In order to obtain a validation certificate, the following six steps must be completed by the customer and the Ada certification body:

  1. A formal validation agreement between the customer and an AVF is required in order to obtain validation services.

  2. Pre-validation, consisting of customer testing, submission of results to the AVF, and resolution of any test issues (e.g., a missing or incomplete result to a test)must precede the actual validation.

  3. Validation testing will be performed by an AVF at a site mutually agreed upon by the customer and the AVF (usually the customer's site).

  4. A Declaration of Conformance must then be completed and signed by the customer no later than at the time of validation testing.

  5. A Validation Summary Report (VSR) will be prepared by the AVF to document the validation.

  6. A Validation Certificate (VC) will then be issued to the customer by the authority of the AJPO for a successfully tested Ada implementation.

Key to Validation Certificate (VC) Number

YYMMDDFX.XX-NNN

For the certificate number above, YYMMDD marks the date (Year-Month-Day) of completion of on-site testing. F refers to the Ada Validation Facility. X.X, X.X.X, or X.XX is the ACVC version. NNN is a unique sequence of numbers assigned at the successful completion of testing.

For complete information on the validation process and on validation by registration for Ada 95 compilers, refer to the latest version of the Ada Compiler Validation Procedures, Version 5.0. Electronic copies of the Validation Procedures may be downloaded from the Ada Information Clearinghouse's (AdaIC's) Internet host.

Validated Compilers List

The Ada 95 Validated Compilers List is a comprehensive database report of Ada 95 compilers that have been validated by ACVC testing. There are 73 base compilers and 14 derived compilers reported at this time. Using the AdaIC Ada 95 Compiler On-Line Database, users may perform a keyword search within the following fields: compiler vendor, compiler name, host type, and target.

[For instructions on accessing the AdaIC's Internet host, refer to the section of this document labeled Accessing Validation Information.]

Contacting the AVFs

For the most current information on compiler validation testing, contact any AVF. There is one AVF in North America, and two AVFs are based in Europe.

North America:

EDS Ada Validation Facility
Mr. Phil Brashear
Electronic Data Systems
1230 E. Dayton-Yellow Springs Road
Fairborn, OH 45324
USA
Phone: +1 937 754 4848
Fax: +1 937 754 4949
E-mail: adaval@dysmailpo.deisoh.msd.eds.com, brashear@sw-eng.falls-church.va.us

Europe:

IABG Ada Validation Facility
Mr. Michael Tonndorf
IABG, Dept IS24
Einsteinstrasse 20
D-85521 Ottobrunn
GERMANY
Phone: +49 89 6088 2477
Fax: +49 89 6088 3418
E-mail: tonndorf@iabg.de, tonndorf@sw-eng.falls-church.va.us

NCC Validation Facility
Mr. Jon Leigh
The National Computing Centre, Ltd.
Oxford Road
Manchester
England, MI7ED
Phone: +44-61-228-6333
Email: jon@ncc.co.uk

Accessing Validation Information

Users may also access information on compiler validation on the AdaIC's Internet host. The AdaIC's Internet host is available to all Internet users 24 hours a day via the following Internet access, search, and retrieval utilities:

anonymous file transfer protocol (ftp)
address:
ftp sw-eng.falls-church.va.us
login: anonymous
password: your e-mail address
path:: ftp://sw-eng.falls-church.va.us/public/AdaIC/compilers/

Gopher
address: gopher sw-eng.falls-church.va.us
path:: /AdaIC/compilers/

World Wide Web (WWW)
address: http://sw-eng.falls-church.va.us/AdaIC/compilers/

Computer users who don't have Internet access may access reuse information on the AdaIC Internet host via our dial-up line. The phone number is: 703/681-2845. Set your communications parameters as follows:

Baud Rate: 300-28,800
Data bits: 8
Parity: None
Stop Bits: 1
Flow Control: XON/XOFF
Emulation: VT100
Once a connection is achieved,
login: guest
password: Ada4sweng

Direct any questions concerning access to the AdaIC telephone Help Desk staff at 1/800-AdaIC-11 (232-4211).


Form