Faa ams lifecycle verification and validation guidelines. V&V Implementation Guidance. Corporate Mission Analysis and Service Analysis, страница 6

The following practices are essential to V&V decision support:

1)  V&V events and results should be formally identified in plans as entrance criteria for associated decision points

2)  V&V events and their results should be scheduled and planned well in advance of decision points

3)  V&V results must be consistently applied so that decision-makers have reliable data and information for making sound and low-risk decisions based on the maturity and quality of the work products

4)  V&V results must support the objectives of the associated decision point prior to accepting/approving results


3  V&V Approach in the AMS Lifecycle

The AMS lifecycle is comprised of the following phases:

  • Mission Analysis (MA)
  • Investment Analysis (IA)
  • Solution Implementation (SI)
  • In-Service Management (ISM)

In addition to these formal phases, Research and Systems Analysis (R&SA) is a separate activity in the AMS lifecycle which may provide information that supports MA, IA, and the early stages of SI.  The responsible V&V stakeholders for R&SA activities are the same as those for MA, IA, and SI.

The V&V process incorporates common tools and techniques for verifying and validating work products, product components, and products.  However, the specific items undergoing V&V and the responsible stakeholders vary depending on the phase or activity of the AMS lifecycle.  For every phase and activity, it is imperative that stakeholders take an active role in V&V.

All critical work products, product components, and products are subject to systematic V&V by various program disciplines during every activity/phase of the lifecycle.  Each functional discipline plans, executes, and reports on V&V in accordance with AMS and standardized integrated processes maintained by the respective organization.

While both verification and validation activities occur throughout the AMS lifecycle, Figure 3 depicts the primary emphasis of V&V between the major decision points.  The figure also illustrates the relationship of R&SA to the lifecycle phases.


Figure 3.  AMS Lifecycle Primary V&V Activities


3.1  V&V in Research and Systems Analysis

R&SA activities overarch the early AMS phases primarily supporting MA and IA.  R&SA activities may continue into SI to support the program and facilitate implementation.  R&SA generates information that supports the development and evaluation of:

1)  Mission and capability shortfalls

2)  Future service needs

3)  Concepts of operation and concepts of use

4)  Capability and product requirements (enterprise architecture operational and system views), including human performance requirements

5)  Expectations of benefits

6)  Design alternatives (technology and non-material)

7)  Standards

8)  Safety and certification requirements

Concept validation early in the development cycle provides an opportunity to assess each concept to determine its impact on operations prior to significant investment expenditure.  Additionally, validation provides an opportunity to begin assessing the procedures necessary for implementing concepts, thus ensuring that such procedures are in place when the capability becomes available.  R&SA adheres to a concept validation strategy as documented in The Operational Concept Validation Strategy Document (OCVSD) (2007), applying standardized processes, best practices, and appropriate and validated models and simulation tools and methods.

Work products from R&SA, such as the National Aviation Research Plan and the FAA Research and Development Portfolio, are verified and validated by the individuals responsible for R&SA to ensure that they provide correct and accurate input to the decision process.