Home > User Experience > Heuristic Evaluation in the age of AI-driven Tech

Heuristic Evaluation in the age of AI-driven Tech

Heuristic Evaluation in the age of AI-driven Tech


  1. Choose who is going to join you. These people don’t need to be experts, however, they should have some level of appreciation to the software engineering process. It is not advised that you recruit users to do this. Use it as an opportunity to bond with your team. 👥
  2. Allocate between 45 minutes to 2 hours for you and whoever (if available) will join the process. There are no rules but, naturally, the more screens you have, the more time you need. ⏱️
  3. Print the screens of your interface. Yes, print on paper. You should do this offline, so you can focus and not waste time. Phones in airplane mode would help you make sure that you are focusing and sticking to the allocated time. Once done, organise the screens on a single flat surface such as a table, whiteboard, notice board or even the floor if you really want to go low cost! 🗒️📴
  4. Link the screens in the form of a sitemap. I am assuming that you went through the design of the flow before coming up with the actual interface. I have witnessed horror stories of wannabe pro teams who built their UI on gut feeling and ended up thrilling the very same guts two months down the line. 🕸️
  5. Individually, look at one screen at a time, noting any violations. These have to be classified as a Heuristic and graded with a severity level, as explained below. 🧐
  6. Repeat this for the entire flow for some 2 or 3 more times. Still individually and silently 🤐
  7. Get together and exchange notes from the process. Agree on a single set of violations with an agreed level of severity. 🙌
  8. Sort out an action plan to address the violations. ☑️

1 = Cosmetic Problem Only: Need not be fixed unless extra time is available on the project

2 = Minor Usability Problem: Fixing should be given low priority

3 = Major Usability Problem: essential to fix, so should be given high priority

4 = Usability Catastrophe: Imperative to fix this problem before the product is released.

Theoretically, there is a zero grade which in other words, means that it is no issue with the violation. This is mostly useful when you’re going through the violations as a team

1- Visibility of the System

We shouldn’t be asking any software “what’s going on in there?”. Users need to be informed about what is happening inside. This heuristic was introduced in 1994, and it is intended for the interface to provide visibility to how it is working.

A clean and simple concept of providing feedback during uploading.

AI Tip: Today, in the age of AI, we expect AI to be explainable (XAI). The UI happens to be an essential tool to communicate this explainability, and this is a very relevant contemporary interpretation of this heuristic.

2- Match between the System and the Real World

It is strongly encouraged that icons and graphics used to describe or list features are good enough to understand what the feature does without much explanation. You can find this set and more over here.

AI tip: personalisation and context are expected in today’s software. We all expect our devices to know us and know us well. Today’s technology provides excellent opportunities for this heuristic to deliver beautifully tailored experiences.

3- User Control and Freedom

Giving freedom to users and a way to manage your own organisation of content is very important. Check out this WP content builder.
While it may be annoying at times for the users themselves, it is important to give an experience of control over important decision related to meaningful content such as user data.

AI Tip: With enough data about the different states of your app, the sitemap of your app and goals of the user, you can design an intelligent algorithm to advise about the most efficient emergency exit out of this situation.

4- Consistency and Standards

Screenshots of MS Word (top) and MS Excel (bottom). Note how the first 3 tabs and the last 2 tabs are identical in both cases so the user can feel a sense of familiarity across different apps.

AI Tip: Adaptable interfaces are becoming more popular. If your application is adjusting the UI elements to specific users, it is nonetheless advised that it maintains a certain level of consistency across the adaptation. The adaptation should also follow some general external consistency with other applications.

5- Error Prevention

This approach can also use regular expressions to detect any incoherences in situations such as form-filling.

Assistance during form filling is nowadays expected. This is an interesting case where the designer takes it for granted that the users know the general structure of an email and the message is that there is something wrong with the address. However, they take a very detailed approach when it comes to the quality of the password.

6- Recognition rather than Recall

The effort is, therefore, to minimise the memory effort of the user in carrying out tasks using your UI. The elements, objects, actions and options need to be clearly presented. With the right presentation and design thought, you can also do without long instructions.

The difference between various fonts can difficult to recall, especially when the list is extensive. This was cleverly solved by writing the font name in its actual font so users (such as me) can recognise the font without the need of a lot of trial and error during the choice.

AI Tip: Through the usage data of your app, you can understand where users are repeating specific useless patterns to reach a goal or finish a task. By applying the right machine learning techniques, you can identify cases where users are feeling lost. Once there, you can either redesign to eliminate the flaws (ideal) or build further intelligence within your software to guide users out of such situations. On the other hand, if you managed to classify what adds this memory load correctly, you can also build an intelligent program that highlights potential issues before they happen, hence taking the design process to the next level.

7- Flexibility and Ease of Use

Consider the most cross-application and cross-platform feature: copy/cut/paste. There are so many ways of how you can carry out these fundamental functions:

  1. Through the “Edit” menu;
  2. Through buttons in toolbars or ribbons;
  3. Through the menu presented as you left-click;
  4. or by using the keyboard shortcuts!

These different ways of doing the same thing (aka Accelerators) allow users with varying levels of experience to carry out exactly the same task but according to their skill. The keyboard shortcut approach is naturally the fastest; however, one cannot expect someone who just learnt about the existence of computers to make use of it. In that case, it would be probably more comfortable to go through menu items or click the button on the toolbar with a pair of scissors and follow the metaphor.

Another way to copy and paste? (GIF-Source)

AI Tip: monitoring whether users are exploiting alternative ways of achieving tasks can help you deliver a better experience through your app. With the right data, you can learn which type of users are not exploiting all the functionality you put in your app and gently guide them towards making more efficient use of your software.

8- Aesthetic and Minimalist Design

A fresh and recent concept that follows this line of thought is that of “The best interface is no interface”. I strongly suggest you have a look at it.

All you need if you are searching for information. Moreover, Google also introduced the idea of taking you directly to the results page as soon as you are typing, keeping the process even simpler. Fun Fact: did you know that Google has an entire design team to keep on improving this interface? It’s actually hard work.

AI Tip: you can use straightforward machine learning techniques to understand better what is mostly needed for users and how to create a path between the landing screen and the task achievement. Optimise towards reaching that as efficiently as possible with minimal clatter along the way.

9- Help users recognise, diagnose and recover from errors

There are different levels at which one can look at this. The most obvious is the avoidance of cryptic errors that can be only understood by a handful of programmers. So the language has to be the same as the user. The correct choice of language on its own does not entirely solve the problem. “catch-all” errors that fire up when a range of issues take place should also be avoided since they’re ultimately not helpful. When errors are presented to users, I suggest the following:

  1. A clear, easy to understand and relevant message that explains the situation.
  2. A solution for the user to fix the problem.
  3. Ideally, a link or reference to what caused the error.
  4. A neatly presented error code in case the user would need to escalate it with customer care. The error code is only (and only) there to complement the process and must not replace the rest. It is extremely useful when contacting support since the error code can assist agents to swiftly understand what the issue is and assist in recovery.
An example from Google’s People and AI Research team (PAIR) on good practice for errors and graceful failures in the PAIR Guidebook.

Besides all this, if you really and really care about the UX rather than only the UI, you can get creative and spice up the experience that would otherwise be quite dull and negative. Here’s a classic from Google’s Chrome:

This is what in my opinion is an outstanding way to present errors, offer further detail, suggest a recovery and above all help the user relax when everything goes wrong. If this made you feel like a quick break, you don’t have to break your Internet for one…just play it here: https://chromedino.com

AI Tip: besides assistance discussed in the next point and assuming that error prediction and avoidance failed, there is still room for AI to assist in this situation. An error needs to be seen as a state in the app that needs to be efficiently changed, and the user steered away from it. AI can help by walking the user through the error recovery process by also explaining what is going on within the app at the right dose or level of detail.

10- Help and Documentation

However, providing help tooltips and the right level of documentation delivers an experience that feels safe and increases the users’ confidence when using your app. It also demonstrates a level of deep thought about what you designed and built, improving your trust.

Tooltips still offer a strong opportunity for an excellent experience. Check out this repo with an implementation for React.

Voice User Interface (VUI) place a crucial role in delivering a helpful experience. On the other hand, it is also vital to ensure that the actual commands of the VUI are clear to the user. In that case, just make sure that users can just ask the app or device to outline more information or commands.

VUI is rendering help and documentation more ubiquitous (GIF Source)

AI Tip: with the dramatic and definite improvement in AI conversational technology, in-app assistants can efficiently support the user as issues happen and provide a systematic approach of how to recover from the error. The error data collected and recover can also offer a variety of machine learning opportunities.



Source link