Web Usability

Your BEST Source for Usability Information and Usability Tools

  • Home
  • Blog
  • Usability Tools
    • Testing and Evaluation
    • Prototyping and Mockups
    • Card Sorting & Navigation
    • Display (Screen) Design
    • Content Design
  • Usability Books
  • Research / Guidelines
    • Journals and Conferences
    • Website Publishing
    • User Interface Update
    • Usability Guidelines
  • User-Computer Issues
    • OS, Browsers, Connecting
    • User Demographics
    • User Languages
  • About Us
    • Contact Us
    • Bio Sketches
You are here: Home / Usability Tools / Test and Evaluation / Mouse Tracking Evaluations / FirstClick Usability Testing

FirstClick Usability Testing

10/08/2013 by Bob Bailey 8 Comments

In 2006, the Centers for Disease Control and Prevention (CDC) elected to revise and update their website (CDC.gov). One of their primary goals during this redesign process was to optimize the usability of the homepage, as well as some of the second-level pages. As part of this usability testing process, Cari Wolfson and I conducted a series of usability tests – one of these was the first FirstClick usability test. A more detailed account of this testing program can be found in a later blog posting, and is also found as Case Study 10.3 in Tom Tullis’ and Bill Albert’s book, Measuring the User Experience (2008).

We studied the factors contributing most to each person’s success on a task. By looking at click streams and success rates, we found an interesting relationship between the user’s success in making their first click and their eventual success with the entire task.

After this first experience, we continued to investigate the ‘firstclick’ concept from 2007 through 2009 in a series of tests conducted at several different agencies in the U.S. Government. We continued to observe that the first click was a very critical click. When participants had difficulty with their original decision, they frequently had problems finding the overall correct answer for the entire task scenario.

We focused on the first click participant’s made after reading the scenario. Because each scenario took participants less than 30 seconds, this type of testing enabled us to considerably increase the number of scenarios we used. For example, in one test each participant completed 136 scenarios during a one-hour testing period.

Eventually, we had data collected on 12 usability studies. For each study, we reported data on (a) the overall success rate, (b) the percentage correct of ‘firstclicks’, (c) the percentage incorrect of ‘firstclicks’, and (d) the ratio of correct to incorrect clicks. All studies were conducted on different websites, and used different participants. This table shows the results.

We found that if the first click was correct, the probability of getting the entire scenario correct was .87 (range from .72 to 1.00). On the other hand, if the first click was incorrect, the chance of eventually getting the scenario correct was only .46 (range from .29  to .70).  This means that there was less than a 50-50 chance of being successful. Overall, participants were about twice as likely to succeed on a task if they selected the correct response on their first click.FirstClick Statistics Table

Based on our findings, we suggest that you work hard to ensure that the first click is a correct click. Many times, the first click is made on the homepage, but not always. Because of the success of many search engines, at least 50% of users may access a site from pages that are not the homepage.

_____________________________

Bailey, R.W. (2007), User Interface Update – 2007: Annual review of the usability literature for practitioners, Computer Psychology Training Course.

Bailey, R.W., Wolfson, C.A. and Nall, J. (2008), Revising a Homepage: Applying Usability Methods that Guarantee Success, Proceedings of the UPA.

Tullis, T.S. and Albert, B. (2008), Measuring the User Experience, Boston: Morgan Kaufmann Publishers, 256-257.

Wolfson, C.A., Bailey, R.W., Nall, J. and Koyani, S. (2008), Contextual card sorting (or ‘firstclick’ testing): A new methodology for validating information architectures, Proceedings of the UPA.

Filed Under: Mouse Tracking Evaluations, User Performance Testing

Trackbacks

  1. Optimal Workshop | Can remote tree testing predict moderated results? A fascinating study by a UX expert says:
    11/05/2014 at 8:59 PM

    […] Treejack, therefore, is brutally strict compared to a good page design. And that’s ok, since getting those top level categories right is crucial to task success, particularly in mobile designs, where hover isn’t available. The point is that Treejack helps create designs with clear well-defined categories, where people are more likely to get that important first-click correct, and therefore are twice as likely to succeed , as shown in Bob Bailey’s First Click Usability Testing study. […]

    Reply
  2. Redesigning Yelp: Design Methods Driven By Usability - Designmodo says:
    12/17/2014 at 12:21 AM

    […] of the first click is best understood by a test that Bob Bailey, Senior Innovator at Adobe, ran on the CDC.gov website in 2006. He found that when the user’s first click is on the right path, 87% will succeed at the task. […]

    Reply
  3. How to gather quantitative data on user behaviors and mental models | Startup Products says:
    01/22/2015 at 11:34 AM

    […] once, and then move on to the next task. First-click testing is becoming increasingly important: studies have shown that if a user gets their first click right, they’re 87 percent likely to complete the task they […]

    Reply
  4. Tips, Tricks and Tools of Screenshot Click Testing says:
    03/05/2015 at 12:11 AM

    […] to a study by WebUsability, you should “work hard to ensure that the first click is a correct click”. They found a […]

    Reply
  5. Optimal Workshop | An improved results platform for tree testing with Treejack says:
    04/25/2015 at 6:21 PM

    […] people clicked where for their first click. We think this data is particularly valuable because a 2009 study by Bob Bailey and Cari Wolfson showed a clear link between first click and task success. Their analysis of 12 scenario-based […]

    Reply
  6. Optimal Workshop | Does the first click really matter? Treejack says yes says:
    04/25/2015 at 6:21 PM

    […] 2009, Bob Bailey and Cari Wolfson published a paper entitled “FirstClick Usability Testing: A new methodology for predicting […]

    Reply
  7. The foundations of clear navigation | Web Communication | Washington State University says:
    06/30/2015 at 2:02 PM

    […] diminished experience of mobile navigation lessens the chance of getting the first click right. A series of studies for government agencies show that getting the first click correct for a task […]

    Reply
  8. Optimal Workshop | Chalkmark rolls out a new animation video says:
    10/24/2015 at 3:42 PM

    […] Studies have shown that if your customer’s first click takes them down the right path, there’s an 87% chance they’ll complete the task they came to your site for. […]

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

© Copyright 1995 - 2016 Webusability · All Rights Reserved · Powered by Webusability ·