Non-functional testing NFTS

(new)

Investigating products, systems and services to assess behaviour and whether this meets specified or unspecified non-functional requirements and characteristics

SFIA 9 is in development

SFIA 9 beta due in early July 2024
SFIA 9 planned for publication October 2024

This is a prototype for SFIA 9. It is subject to change before publication.

Guidance notes

(new)

Non-functional testing assesses the behaviour of technology, system components, configurations, and packages, ensuring they work together to support the system’s operation. It considers various risks, leverages distinct tools, and requires specific contextual knowledge.

Activities may include, but are not limited to:

testing qualities like performance, security, backup and recovery, availability, scalability, reliability, and maintainability
planning, designing, managing, executing, and reporting non-functional tests
performing static testing and analysis
managing risks and taking preventative actions
adopting and adapting testing methods (e.g. waterfall, incremental, agile)
ensuring compliance with standards, regulations, and data protection laws
developing and maintaining testware to improve software quality
promoting test automation, tools, and best practices
developing scalable and reliable automated tests and frameworks.

Examples of the risks addressed by Non-functional testing:

inability to back up and restore the system during failure
ineffective monitoring and control by operators
failure to meet user response time expectations
system failure under high concurrent usage
excessive resource consumption impacting other systems or causing unnecessary costs
non-compliance with technical standards, such as auditability.

Understanding the responsibility levels of this skill

Where lower levels are not defined...

Specific tasks and responsibilities are not defined because the skill requires a higher level of autonomy, influence, and complexity in decision-making than is typically expected at these levels. You can use the essence statements to understand the generic responsibilities associated with these levels.

Where higher levels are not defined...

Responsibilities and accountabilities are not defined because these higher levels involve strategic leadership and broader organisational influence that goes beyond the scope of this specific skill. See the essence statements.

Developing skills and demonstrating responsibilities related to this skill

The defined levels show the incremental progression in skills and reponsibilities.

Where lower levels are not defined...

You can develop your knowledge and support others who do have responsibility in this area by:

Learning key concepts and principles related to this skill and its impact on your role
Performing related skills (see the related SFIA skills)
Supporting others with tasks (generic examples are provided by the essence statements for each level)

Where higher levels are not defined...

You can progress by developing related skills which are better suited to higher levels of organisational leadership.

Levels

Defined at these levels:

Click to learn why SFIA skills are not defined at all 7 levels.

Show/hide extra descriptions and levels.

Non-functional testing: Level 1

Level 1 - Follow: Essence of the level: Performs routine tasks under close supervision, follows instructions, and requires guidance to complete their work. Learns and applies basic skills and knowledge.

(new)

Executes given manual non-functional test scripts under supervision.

Uses basic testing tools.

Records results and reports issues.

Develops an understanding of the role of non-functional testing as a tool for design improvement and a validation process.

Non-functional testing: Level 2

Level 2 - Assist: Essence of the level: Provides assistance to others, works under routine supervision, and uses their discretion to address routine problems. Actively learns through training and on-the-job experiences.

(new)

Designs test cases, creates test scripts and test data, and implements test tools where appropriate to the non-functional requirements or specifications provided.

Defines test conditions for given non-functional requirements.

Executes and records manual and automated non-functional testing in accordance with test plans.

Analyses and reports on test activities, results, issues and risks.

Non-functional testing: Level 3

Level 3 - Apply: Essence of the level: Performs varied tasks, sometimes complex and non-routine, using standard methods and procedures. Works under general direction, exercises discretion, and manages own work within deadlines. Proactively enhances skills and impact in the workplace.

(new)

Designs non-functional test cases and test scripts under own direction, mapping back to pre-determined criteria, recording and reporting test outcomes.

Participates in requirement, design and specification reviews, and uses this information to design non-functional test plans and test conditions.

Applies agreed standards to specify and perform manual and tools-based non-functional testing. Undertakes tools-based testing tasks and builds test coverage through existing or new infrastructure.

Analyses and reports on test activities, results, issues and risks.

Non-functional testing: Level 4

Level 4 - Enable: Essence of the level: Performs diverse complex activities, supports and supervises others, works autonomously under general direction, and contributes expertise to deliver team objectives.

(new)

Selects appropriate non-functional testing approach, including manual and tools-based testing.

Develops and executes non-functional test plans and test cases. Implements scalable and reliable tools-based non-functional tests and frameworks.

Collaborates across parties involved in product, systems or service design and development to enable comprehensive functional test coverage. Identifies improvements in requirements, and related design or specification processes, to increase the effectiveness and efficiency of non-functional testing.

Analyses and reports on test activities, results, issues and risks, including the work of others.

Non-functional testing: Level 5

Level 5 - Ensure, advise: Essence of the level: Provides authoritative guidance in their field and works under broad direction. Accountable for achieving workgroup objectives and managing work from analysis to execution and evaluation

(new)

Plans and drives non-functional testing activities across all stages and iterations of product, systems and service development.

Provides authoritative advice and guidance on any aspect of non-functional test planning and execution. Adopts and adapts appropriate testing methods, tools and techniques to solve problems in tools and testing approaches.

Measures and monitors applications of standards for testing. Assesses risks and takes preventative action.

Identifies improvements and contributes to the development of organisational policies, standards, and guidelines for non-functional testing.

Non-functional testing: Level 6

Level 6 - Initiate, influence: Essence of the level: Has significant organisational influence, makes high-level decisions, shapes policies, demonstrates leadership, fosters organizational collaboration, and accepts accountability in key areas.

(new)

Develops organisational policies, standards, and guidelines for non-functional testing.

Plans and leads strategic, large and complex non-functional testing activities. Leads activities to manage risks and opportunities associated with non-functional testing and in coordination with other types of testing.

Adapts or develops organisational non-functional testing capabilities and methods to solve complex business and engineering problems in tools and testing.

Promotes a culture of quality throughout the organisation and drives adoption of and adherence to testing policies and standards, with special focus on non-functional testing.

Level 7

Level 7 - Set strategy, inspire, mobilise: Essence of the level: Operates at the highest organisational level, determines overall organisational vision and strategy, and assumes accountability for overall success