User experience evaluation USEV
Validating systems, products or services against user experience goals, metrics and targets.
Updates for SFIA 9
- There is an updated version of this skill for SFIA 9.
- Content changes have been made to level 5.
- You can move to SFIA 9 when you are ready - SFIA 8 skill descriptions will still be available to use.
- Previous SFIA assessments or skills mapping are not impacted by this change.
Guidance notes
This skill is inclusive of a full range of user tasks not just digital tasks. The skill can be applied in various contexts — such as — but not limited to customer experience, products, services, applications, devices, learning experience and employee experience.
Evaluation is typically part of an iterative user experience design process and contributes to the improvement of the product or service. An evaluation can also be the starting point if an existing system, product or service is to be replaced or improved. Methods include user trials, expert review, survey and analysis.
Activities may include — but are not limited to:
- providing assurance that user stories or requirements have been met and required practice has been followed to address accessibility, usability, security, health and safety
- applying a range of qualitative and quantitative evaluation techniques
- selecting from lightweight/rapid techniques or more thorough and resource-intensive approaches
- selecting appropriate use of formative or summative evaluations.
- facilitating both moderated and unmoderated tests.
Levels of responsibility for this skill
| 2 | 3 | 4 | 5 | 6 |
User experience evaluation: Level 1
This skill is not typically observed or practiced at this level of responsibility and accountability.
User experience evaluation: Level 2
Assists in preparing and operating the environment, facilities and tools needed to evaluate systems, products, services or devices.
Assists in the collection of feedback on prototypes and designs from users and others.
User experience evaluation: Level 3
Evaluates design options and prototypes to obtain user feedback on requirements of developing systems, products, services or devices.
Tests the usability and accessibility of components and alternative designs. Administers a range of evaluations, recording data and feedback. Analyses evaluation data and recommends actions. Identifies areas for future user research.
Checks systems, products, services or devices for adherence to applicable standards, guidelines, style guides, and legislation.
Evaluates the usability of existing or competitor systems to provide benchmark values and as input to design.
User experience evaluation: Level 4
Selects appropriate tools and techniques to evaluate user experiences of systems, products, services or devices.
Validates that security, usability and accessibility requirements have been met.
Checks operational systems, products, services or devices for changes in usability and accessibility needs.
Interprets and presents results of evaluations, prioritises issues and reports on remedial actions. Collates input for future user research.
User experience evaluation: Level 5
Manages user experience evaluation of systems, products, services or devices.
Assures that the security, usability and accessibility requirements have been met and that required practices have been followed.
Advises on what to evaluate, the type of evaluation to use and the extent of user involvement required.
Works iteratively with design teams to ensure that feedback from the evaluation is understood and acted upon by designers and developers. Advises on the achievement of required usability and accessibility levels of specific designs or prototypes. Prioritises input for future user research.
User experience evaluation: Level 6
Champions high standards in user interaction with the organisation’s systems, products and services including involvement of users in evaluation activities.
Specifies standards and methods for security, usability and accessibility and ensure that this is addressed in future designs.
Develops or sources resources and capabilities to conduct effective user experience evaluation, including specialist user-centred facilities and communities of users. Leads the provision of input and resources for future user research.
Collaborates with internal and external partners to facilitate an effective evaluation of systems, products and services.
User experience evaluation: Level 7
This skill is not typically observed or practiced at this level of responsibility and accountability.