E2E Testing and Evaluation of High Assurance Systems

DoD E2E Testing and Evaluation (T&E) technology for high assurance system has evolved from specification and analysis of thin threads, through system scenarios, and to the scenario-driven system engineering including reliability, security, and safety assurance, as well as dynamic verification and validation. Currently, E2E T&E technology is entering the fourth generation and being applied to the development and verification of systems in Service-Oriented Architecture (SOA) and Web Services (WS). The technology includes a series of techniques, including automated generation of thin threads from system scenarios; automated dependency analysis; completeness and consistency analysis based on condition-event pairs in the system specification; automated test case generation based on verification patterns; test case generation based on the topological structure of Boolean expressions; automated code generation for system execution as well as for simulation, automated reliability assurance based on the system design structure, dynamic policy specification, analysis, enforcement and simulation; automated state model generation; automated sequence diagram generation; model checking on system specifications; and test case generation based model checking. The E2E T&E technology has been applied to several DoD command and control applications as well civilian projects successfully.