Faa ams lifecycle verification and validation guidelines. V&V Implementation Guidance. Corporate Mission Analysis and Service Analysis, страница 5

DT supports the objectives of verification, ensuring that the product or product component under test meets all specified technical and performance requirements.  Additionally, for final products, DT verifies that the product is fully integrated and stable, and has no adverse effect on the rest of the NAS.

OT and IOT&E support the objectives of validation, ensuring that major product components and the final product are operationally effective and suitable for use in the NAS and that the NAS infrastructure is ready to accept the product.  OT is performed by the appropriate FAA service organization with the operational assistance of Air Traffic and Technical Operations field personnel.  IOT&E is performed by the Air Traffic Organization (ATO) Office of Safety, SMS Safety Assurance and provides decision-makers with an independent determination of operational readiness in support of the production and in-service decisions.

The primary verification methods for products and product components are listed below.  The verification of a specific product or product component uses one or more of these methods.  Definitions and descriptions of these methods can be found in the Acquisition Processes, FAST, and TSB websites.

Product and Product Component Verification Methods

  • Inspections
  • Peer reviews
  • Audits
  • Analyses
  • Checklists
  • Testing
  • Demonstrations
  • Simulations
  • Accreditation

The primary validation methods for products and major product components are listed below.  The validation of a specific product or major product component will use one or more of these methods.  Definitions and descriptions of these methods can be found in the Acquisition Processes, FAST, and TSB websites.

Product and Product Component Validation Methods

  • Discussions with users
  • User evaluation questionnaires
  • Functional presentations
  • Inspections
  • Peer reviews
  • Audits
  • Analyses
  • Checklists
  • Testing
  • Demonstrations
  • Simulations

2.3  V&V Reporting

V&V reporting supports AMS decision points and should be factored into the entrance criteria for these major decisions.  Quality V&V reporting supports informed decision-making and contributes to the overall effectiveness and efficiency of the program.  V&V reports also support performance measurement and analysis.

The following practices are essential to quality V&V reporting:

1)  V&V events must be documented and the corresponding documentation must be controlled and archived to ensure that historical records are kept

2)  V&V reporting should take into account that specific decision-making events and risk management will be based on the information contained in the report

3)  V&V reporting of the quality of work products should identify how well the work product supports the development of an operationally effective and suitable end product

4)  V&V reporting of the results of test and evaluation activities (contained in final test reports) should identify how well the product or product component is built and to what degree it fulfills operational needs

5)  V&V reporting should take into account that subsequent work products, product components, and products can be premised off the information contained in the report

2.4  V&V Decision Support

The performance of structured V&V prior to a planned decision point reduces the risk of defects in a work product, product components, or product that supports the decision by ensuring completeness and quality.  This structured V&V aids decision-makers by providing assessments of critical work products for each acquisition management phase and by discovering risk levels (both technical and non-technical) that affect program success.  For example, V&V applied against program planning documentation may uncover inconsistencies within the document and its predecessor documents which could lead to increased risk, increased cost, and schedule delays.