BS ISO 10303-31:1994

1. Scope
1.1 Applicability of this series of parts
1.2 Applicability of this part of ISO 10303
1.3 Coverage of this series of parts
1.4 Coverage of this part of ISO 10303
2. Normative references
3. Definitions
3.1 Terms defined in ISO 10303-1
3.2 Other definitions
3.2.1 abstract test case (ATC)
3.2.2 abstract test group
3.2.3 abstract test method
3.2.4 (laboratory) accreditation
3.2.5 accreditation body
3.2.6 assessor
3.2.7 attestation of conformity
3.2.8 basic tests
3.2.9 capabilities of an IUT
3.2.10 capability tests
3.2.11 certificate of conformance
3.2.12 certificate of conformity; certificate of
        conformance
3.2.13 certification body
3.2.14 certification mark
3.2.15 certification of conformity
3.2.16 certification system
3.2.17 client (of a testing laboratory)
3.2.18 comparability (of results)
3.2.19 conformance
3.2.20 conformance assessment process
3.2.21 conformance log
3.2.22 conformance testing
3.2.23 (conformance) test report
3.2.24 conforming implementation
3.2.25 conformity; conformance
3.2.26 control board
3.2.27 declaration of conformance
3.2.39 declaration of conformity; (manufacturer's)
        declaration of conformance
3.2.29 executable test case
3.2.30 executable test suite
3.2.31 fail (verdict)
3.2.32 falsification testing
3.2.33 Implementation Under Test (IUT)
3.2.34 inconclusive (verdict)
3.2.35 in-house testing
3.2.36 manufacturer's declaration of conformance
3.2.37 non-conformance
3.2.38 non-conformity; non-conformance
3.2.39 pass (verdict)
3.2.40 PIXIT proforma
3.2.41 postprocessor
3.2.42 preprocessor
3.2.43 proficiency testing
3.2.44 Protocol Implementation eXtra Information for
        Testing (PIXIT)
3.2.45 repeatability (of results)
3.2.46 resolution tests
3.2.47 selected abstract test suite
3.2.48 selected executable test suite
3.2.49 System Under Test (SUT)
3.2.50 test campaign
3.2.51 test case
3.2.52 test case error
3.2.53 test purpose
3.2.54 test realiser
3.2.55 test report
3.2.56 test verdict
3.2.57 testing laboratory
3.2.58 (test) verdict
3.2.59 verdict criteria
3.2.60 verification testing
4. Abbreviations
5. Conformance
5.1 The meaning of conformance in ISO 10303
5.2 Conformance requirements
5.3 Protocol Implementation Conformance Statement
5.4 A conforming system
6. Conformance testing
6.1 Introduction
6.2 Types of conformance tests
6.2.1 Basic tests
6.2.2 Capability tests
6.3 Protocol Implementation eXtra Information for
        Testing
6.4 Conformance assessment process overview
6.5 Preparation for testing
6.6 Test campaign
6.7 Analysis of results
6.8 Conformance test report production
6.9 Intrinsic properties of the conformance assessment
        process
6.9.1 Repeatability of results
6.9.2 Comparability of results
6.9.3 Auditability of results
7. Abstract test methods
8. Abstract and executable test suites
8.1 Structure
8.2 Test purposes
8.3 Abstract test cases
8.4 Executable test cases
8.5 Relationship between abstract and executable test
        cases
Annexes
A. Information object registration
B. Optional conformance requirements
C. Resolution tests
D. Supporting organisations
D.1.1 Purpose
D.1.2 Scope
D.1.3 Intended readership
D.1.4 Background
D.1.5 General philosophy of conformance testing
D.2 Responsible authorities
D.2.1 Control board
D.2.2 Accreditation body
D.2.3 Testing laboratory
D.2.4 Certification body
D.3 Administration and certification
D.3.1 Guidelines for role of the certification body
D.3.2 Sponsoring a laboratory accreditation programme
D.3.3 Conditions for testing laboratory accreditation
D.3.4 Criteria for accrediting testing laboratories
D.3.5 Testing laboratory assessment
D.4 The process of certification
D.4.1 Initial contact
D.4.2 Certificate of conformity content and presentation
D.4.3 National responsibilities
D.4.4 International (ISO TC 184/SC4) responsibilities
E. Bibliography
Index
Figures
1. Relationship between conformance testing standards
        and other series of parts
2. Overview of the conformance assessment process
3. Example structure of an abstract test suite
D.1 Infrastructure for conformance testing
D.2 Sample certificate of conformity
D.3 Sample form for additional claims made by the
        client

Specifies a general methodology and framework for testing conformance during implementation. Gives definitions of common terms and concepts; also gives introductory material. Does not cover: (user) acceptance testing, interoperability testing, performance testing and robustness testing.

This part of ISO 10303, which introduces the series of parts devoted to conformance testing, specifies a general methodology and framework for testing the conformance of an implementation of ISO 10303. During conformance testing, such an implementation is termed an IUT (implementation under test). NOTE - Figure 1 is a pictorial representation of the relation between the various standards and some of the concepts of conformance testing. The roles of other parts of ISO 10303 are documented in ISO 10303-1. 1.1 Applicability of this series of parts This series of parts is applicable to the phases of the conformance testing process, these phases being characterised by the following major activities: the definition of abstract test suites for ISO 10303 application protocols; the definition of abstract test, methods for ISO 10303 implementation methods; the conformance assessment process carried out by a testing laboratory for a client, culminating in the production of a conformance test report. 1.2 Applicability of this part of ISO 10303 This part of ISO 10303 is applicable to all of the above activities, providing introductory material, normative requirements on each part of this series, and definitions of common terms and concepts. 1.3 Coverage of this series of parts This series of parts specifies the requirements for and gives guidance on the procedures to be followed in conformance testing for ISO 10303. This series of parts includes only such information as is necessary to meet the following objectives: Figure 1 Relationship between conformance testing standards and other series of parts to achieve an adequate level of confidence in the tests as a, measure of conformance; to achieve comparability between the results of the corresponding tests applied in different places at different times; to facilitate communication between the parties responsible for the activities described in (a) and (b). Requirements for procurement and contracts are outside the scope of this series of parts. Testing by means of test methods which are specific to particular applications or systems is outside the scope of this series of parts. The framework established by this part of ISO 10303 includes the concept of executable test suites. These, by their very nature, cannot be standardised; consequently, standardisation of executable test suites is outside the scope of this series of parts. 1.4 Coverage of this part of ISO 10303 This part of ISO 10303 provides introductory material, which is expanded further in the remaining parts of this series of parts of ISO 10303, including: an exposition of the meaning of conformance in the context of ISO 10303; a description of basic and capability tests; an introduction to the conformance assessment process; an introduction to the abstract test methods and their applicability; an introduction to the concepts of abstract test suite design. The procedures required for testing the conformance of an implementation of ISO 10303 are outside the scope of this part of ISO 10303, but are addressed in ISO 10303-34. The following types of testing are all outside the scope of this part of ISO 10303. (user) acceptance testing: the process of determining whether an implementation satisfies acceptance criteria and enables the user to determine whether to accept the system. This includes the planning and execution of several kinds of tests (e.g., functional, volume, performance tests) to demonstrate the implemented software satisfies the user requirements. interoperability testing: related to acceptance testing, but applied to the examination of the information exchange and sharing between two specific IUTs and the ability of each IUT to use such information. performance testing: measures the performance characteristics of an IUT, such as its throughput, response time, number of transactions, and responsiveness under various conditions. robustness testing: the process of determining how well an IUT processes data which contains errors. This part of ISO 10303 provides a framework for certification (an administrative procedure which may follow conformance testing) in annex D. However, there is no ISO requirement for an implementation of ISO 10303 to undergo certification or conformance testing.