User experience evaluation USEV
(unchanged)
Validating systems, products or services against user experience goals, metrics and targets.
SFIA 9 is in development
- SFIA 9 beta due in early July 2024
- SFIA 9 planned for publication October 2024
Guidance notes
(modified)
This skill is inclusive of a full range of user tasks not just digital tasks. The skill can be applied in various contexts, such as, but not limited to customer experience, products, services, applications, devices, learning experience and employee experience.
Evaluation is typically part of an iterative user experience design process and contributes to the improvement of the product or service. An evaluation can also be the starting point if an existing system, product or service is to be replaced or improved. Methods include user trials, expert review, survey and analysis.
Activities may include, but are not limited to:
- providing assurance that user stories or requirements have been met and required practice has been followed to address accessibility, usability, security, health and safety
- applying a range of qualitative and quantitative evaluation techniques
- selecting from lightweight/rapid techniques or more thorough and resource-intensive approaches
- selecting appropriate use of formative or summative evaluations
- facilitating both moderated and unmoderated tests.
Understanding the responsibility levels of this skill
Where lower levels are not defined...
- Specific tasks and responsibilities are not defined because the skill requires a higher level of autonomy, influence, and complexity in decision-making than is typically expected at these levels. You can use the essence statements to understand the generic responsibilities associated with these levels.
Where higher levels are not defined...
- Responsibilities and accountabilities are not defined because these higher levels involve strategic leadership and broader organisational influence that goes beyond the scope of this specific skill. See the essence statements.
Developing skills and demonstrating responsibilities related to this skill
The defined levels show the incremental progression in skills and reponsibilities.
Where lower levels are not defined...
You can develop your knowledge and support others who do have responsibility in this area by:
- Learning key concepts and principles related to this skill and its impact on your role
- Performing related skills (see the related SFIA skills)
- Supporting others with tasks (generic examples are provided by the essence statements for each level)
Where higher levels are not defined...
- You can progress by developing related skills which are better suited to higher levels of organisational leadership.
Levels
| Defined at these levels: | 2 | 3 | 4 | 5 | 6 |
Click to learn why SFIA skills are not defined at all 7 levels.
Show/hide extra descriptions and levels.
Level 1
User experience evaluation: Level 2
(unchanged)
Assists in preparing and operating the environment, facilities and tools needed to evaluate systems, products, services or devices.
Assists in the collection of feedback on prototypes and designs from users and others.
User experience evaluation: Level 3
(unchanged)
Evaluates design options and prototypes to obtain user feedback on requirements of developing systems, products, services or devices.
Tests the usability and accessibility of components and alternative designs. Administers a range of evaluations, recording data and feedback. Analyses evaluation data and recommends actions. Identifies areas for future user research.
Checks systems, products, services or devices for adherence to applicable standards, guidelines, style guides, and legislation.
Evaluates the usability of existing or competitor systems to provide benchmark values and as input to design.
User experience evaluation: Level 4
(unchanged)
Selects appropriate tools and techniques to evaluate user experiences of systems, products, services or devices.
Validates that security, usability and accessibility requirements have been met.
Checks operational systems, products, services or devices for changes in usability and accessibility needs.
Interprets and presents results of evaluations, prioritises issues and reports on remedial actions. Collates input for future user research.
User experience evaluation: Level 5
(unchanged)
Manages user experience evaluation of systems, products, services or devices.
Assures that the security, usability and accessibility requirements have been met and that required practices have been followed.
Advises on what to evaluate, the type of evaluation to use and the extent of user involvement required.
Works iteratively with design teams to ensure that feedback from the evaluation is understood and acted upon by designers and developers. Advises on the achievement of required usability and accessibility levels of specific designs or prototypes. Prioritises input for future user research.
User experience evaluation: Level 6
(unchanged)
Champions high standards in user interaction with the organisation’s systems, products and services including involvement of users in evaluation activities.
Specifies standards and methods for security, usability and accessibility and ensure that this is addressed in future designs.
Develops or sources resources and capabilities to conduct effective user experience evaluation, including specialist user-centred facilities and communities of users. Leads the provision of input and resources for future user research.
Collaborates with internal and external partners to facilitate an effective evaluation of systems, products and services.