User experience evaluation USEV

(modified)

Validating systems, products or services against user experience goals, metrics and targets.

Guidance notes

(new)

This skill is inclusive of a full range of user tasks not just digital tasks. The skill can be applied in a number of contexts - such as - but not limited to customer experience, products, services, applications, devices, learning experience, employee experience.

Evaluation is typically part of an iterative user experience design process and contributes to the improvement of the product. An evaluation can also  be the starting point - if an existing system, product or service is to be replaced or improved.  Methods include user trials, expert review, survey and analysis.

Activities include - but not limited to...

  • Providing assurance that requirements have been met and required practice has been followed including health and safety, and accessibility
  • applying a range of qualitative and quantitative evaluation techniques
  • selecting from lightweight/rapid techniques or more thorough and resource intensive
  • selecting appropriate use of formative or summative evaluations.
  • facilitating both moderated and unmoderated tests

User experience evaluation: Level 6

(unchanged)

Champions high standards in all aspects of the interaction between users and the organisation’s systems, products and services including involvement of users in evaluation activities. Specifies standards and methods to achieve organisational objectives for usability and accessibility and to ensure that this is addressed in future design. Develops or sources organisational resources and capabilities to conduct effective user experience evaluation including specialist user-centred facilities, communities of users. Collaborates with internal and external partners to facilitate effective evaluation of systems, products and services.

User experience evaluation: Level 5

(modified)

Manages user experience evaluation of systems, products or services. Assures that the usability and accessibility requirements have been met and that required practice has been followed. Advises on what to evaluate and the type of evaluation to use and the extent of user involvement required. Works iteratively with design teams to ensure that feedback from evaluation is understood and acted upon by designers and developers. Advises on achievement of required usability and accessibility levels of specific designs or prototypes.

User experience evaluation: Level 4

(modified)

Selects appropriate tools and techniques to evaluate user experiences of a product, system or service. Validates that usability and accessibility requirements have been met. Interprets and presents results of evaluations and prioritises issues. Checks systems, products, or services which are in-use for changes in usability and accessibility needs and to ensure that these needs continue to be met.

User experience evaluation: Level 3

(unchanged)

Evaluates design options and prototypes to obtain user feedback on requirements of developing systems, products or services. Tests the usability and accessibility of components and alternative designs. Administers a range of evaluations, recording data and feedback. Analyses evaluation data and recommend actions. Checks systems, products or services for adherence to applicable standards, guidelines, style guides, and legislation. Evaluates the usability of existing or competitor systems to provide benchmark values and as input to design.

User experience evaluation: Level 2

(modified)

Assists in preparations for evaluation of systems, products or services, and in the operation of the environment, facilities tools needed for effective evaluations. Assists in collection of feedback on prototypes and designs from users and others.