Testing TEST
Investigating products, systems and services to assess behaviour and whether this meets specified or unspecified requirements and characteristics.
Guidance notes
The scope of testing includes technology, system components, configurations, packages and their interfaces. This skill is applicable to all testing methodologies — which can be delivered using predictive (plan-driven) approaches or adaptive (iterative/agile) approaches.
Activities may include — but are not limited to:
- planning, designing, managing, executing and reporting of tests
- functional testing of capabilities or features
- non-functional testing of qualities such as — but not limited to — performance, security, access, backup and recovery, archiving and retention, robustness, availability, capacity, scalability, reliability, performance, stress, volume, maintainability and portability
- static testing and static analysis
- managing risks associated with testing and taking preventative action when needed
- adopting and adapting testing methods including waterfall, incremental or agile approaches
- conforming to agreed process standards, industry-specific regulations and data protection legislation
- engineering, using and maintaining testware to measure and improve the quality of the software being tested
- promoting productivity through test automation, tools and best practices
- developing scalable and reliable automated tests and frameworks.
1 | 2 | 3 | 4 | 5 | 6 |
Levels of responsibility for this skill
Testing: Level 1
Executes given manual test scripts under supervision.
Uses basic automated testing tools.
Records results and reports issues.
Develops an understanding of the role of testing as a tool for design improvement and a validation process.
Testing: Level 2
Designs test cases, creates test scripts and test data, and automates repeatable tasks working to the requirements or specifications provided.
Defines test conditions for given requirements.
Executes and records manual and automated testing in accordance with test plans.
Analyses and reports on test activities, results, issues and risks.
Testing: Level 3
Designs test cases and test scripts under own direction, mapping back to pre-determined criteria, recording and reporting test outcomes.
Participates in requirement, design and specification reviews, and uses this information to design test plans and test conditions.
Applies agreed standards to specify and perform manual and automated testing. Automates testing tasks and builds test coverage through existing or new infrastructure.
Analyses and reports on test activities, results, issues and risks.
Testing: Level 4
Selects appropriate testing approach, including manual and automated testing.
Develops and executes test plans and test cases. Implements scalable and reliable automated tests and frameworks.
Collaborates across parties involved in product, systems or service design and development to enable comprehensive test coverage. Identifies improvements in requirements, design or specification processes to increase the effectiveness and efficiency of testing.
Analyses and reports on test activities, results, issues and risks, including the work of others.
Testing: Level 5
Plans and drives testing activities across all stages and iterations of product, systems and service development.
Provides authoritative advice and guidance on any aspect of test planning and execution. Adopts and adapts appropriate testing methods, automated tools and techniques to solve problems in tools and testing approaches.
Measures and monitors applications of standards for testing. Assesses risks and takes preventative action.
Identifies improvements and contributes to the development of organisational policies, standards, and guidelines for testing.
Testing: Level 6
Develops organisational policies, standards, and guidelines for testing.
Plans and leads strategic, large and complex testing activities. Leads activities to manage risks and opportunities associated with testing.
Adapts or develops organisational testing capabilities and methods to solve complex business and engineering problems in tools and testing.
Promotes a culture of quality throughout the organisation and drives adoption of and adherence to testing policies and standards.
Testing: Level 7
This skill is not typically observed or practiced at this level of responsibility and accountability.