Mobile handheld usability testing - why it matters

Mobile phone and PDA usability testing is critical to your business. In fact, mobile and handheld usability testing could be even more important than computer-based usability testing. The main reasons for this are:

- The number of people accessing the Internet from mobile and handheld devices is increasing at a massive rate - in 2008 alone there'll be an estimated 58 million PDAs sold worldwide (source: eTForecast).

- People generally have a lot less experience of using their mobile to go online than they do of using their computer. This means that computer-based users can be assumed to have a higher level of existing expertise than mobile and handheld users.

- The platform through which users access your site is far less predictable when using mobile phones. Computer-based site visitors generally only differ from one another in their browser and operating system (i. e. most people will use a screen, mouse and keyboard), whereas the different types of mobile phones and PDAs differ can drastically.

Which mobile phones and PDAs do you need to consider?

Mobile phones and PDAs can differ from one another dramatically, and this will radically change how people experience and use websites. Some of the ways in which handheld devices can differ include:

- Screen size (small vs. large)

- Screen layout (portrait vs. landscape)

- Input device (stylus, numeric keypad, dial-wheel, QWERTY keypad)

Because the mobile phone / PDA that someone is using will have such a profound effect on their experience of your site, you should try to test with as many mobile phones and PDAs as possible.

Of course, testing with every mobile phone and PDA is impossible. Here are some ideas to help narrow down the number of devices you'll need to test with:

- Your mobile site visitors may belong to a specific audience. Certain audiences tend to prefer particular types of phones (e. g. phones with big screens that are designed to support online access vs. small-screen models that aren't).

- There are 'phone families' that offer a very similar user experience (and will not need to be tested individually).

- You may only want to test with the most popular mobile phones in Europe or the most popular models that are being used to access your site (you can check your site statistics to find out this information).

Who do you want to test with?

The people you want to conduct your mobile phone usability testing sessions with will, of course, depend on your particular business and its audience. Some things to bear in mind include:

- How much experience they should have of using their mobile phones to access services. This is particularly important as the market for accessing online services through mobile phones is growing and the percent of 'complete novices' (i. e. people using the technology for the first time) will be far higher than for computer users of your website.

- Which mobile phone or PDA they have. We would usually recommend that people use their own mobile phone in a session, so the test can focus on your website and not on the way the handheld device works.

Where should mobile usability testing sessions be conducted?

Mobile phones and PDAs are used in the real world so usability testing of handheld devices should therefore not only take place in a usability laboratory.

Where, when and how a mobile phone is used is critical to a person's experience of the site they are accessing. Any of the following circumstances could influence this experience and therefore considerations of the site's usability:

- Lighting

- Background noise

- Distractions

- Concurrent tasks (i. e. anything the person is doing at the same time)

- Physical movement

As such, we'd recommend, if possible, that any mobile phone and PDA usability testing is conducted both in a laboratory and also in the 'outside world'.

How you plan and run mobile phone usability sessions will be based on your business and its audience, but the most popular methods of mobile usability testing include:

- Lab-based (using a camera to record the session)

- Diary-studies (asking people to keep a diary of how they have used their mobile phone and any problems they encounter)

- Paper prototypes (running usability testing on a paper-based version of the site, using mobile phone screen-sized pieces of paper)

Benefits of an accessible website part 1 - increase in reach

The DDA (Disability Discrimination Act) states that service providers must not discriminate against disabled people. A website is regarded as a service and therefore falls under this law, and as such must be made accessible to everyone.

Some organisations are making accessibility improvements to their websites, but many are seemingly not making the accessibility adjustments. Disabled people don't access their website, they say, so why should they care?

Why you should care about disabled Internet users

The statistics on the number of users who may face difficulties due to your website's accessibility are quite startling:

* There are 8.6 million registered disabled people in the UK - 14% of the population (source: DRC)

* One in 12 men and one in 200 women have some form of colour blindness - 9% of the UK population (source: Institution of Electrical Engineers)

* Two million UK residents have a sight problem - 4% of the population (source: RNIB)

* There are 12 million people aged 60 or over - 21% of the UK population (source: UK government)

Although there is inevitably some overlap between the aforementioned groups, adding up these numbers provides a total of 48% of the UK population that could potentially face problems with your website's accessibility. That's an extraordinarily high number.

It's not just disabled users who can't access your website

Non-disabled people may also experience difficulties with your website's accessibility. Not everyone is viewing your website on the latest version of Internet Explorer, with all the plug-ins and programs that you may require them to have for optimal access.

If your website relies on images, Flash or JavaScript, and fails to provide alternatives, then your website won't be accessible to a number of web users. The following examples are a common occurrence:

* Users on slow connections regularly turn images off to enable a quicker download time. Some browsers, such as the text-only Lynx browser do not display images at all.

* Not every user has downloaded the latest Flash program that's needed to access your site. Additionally, the download time on Flash websites often takes so long that users lose patience and don't even wait to see the content. Just 25% of web users in the UK are connected to the Internet via broadband (source: National Statistics).

* JavaScript is a scripting language that can cause changes to a page, often through mouse functions, buttons, or other actions from the user. For example, pop-ups are opened using JavaScript. JavaScript is unsupported by about 5% of web users, either because they have turned it off to prevent pop-up adverts or because their browser doesn't support it (source: The Counter). Any JavaScript-driven content provided on your website won't be accessible to these users.

* PDAs, mobile phones and WebTV have limited support for large images, Flash and JavaScript. You can test your website by downloading the free WebTV viewer. You can also check how your website looks on a mobile phone with the Wapalizer. Don't underestimate the importance of this: in 2008 alone an estimated 58 million PDAs will be sold (source: eTForecast) and one third of the world's population will own a wireless device (source: ClickZ)