Existing User Testing Videos that Need Write-Ups

A write up should include:

  • A Summary of notable items/issues in the video (Bulleted list)
  • Points of Confusion with notes. (Bulleted list or screenshots, etc.  Whatever works to make the point.)
  • Observations (Not necessary but helpful)
  • Your Suggestions based on the specific video test results (Not necessary but helpful)
# Link Summary Available (yes/no) Link to Summary
1 Set 1 User 1  no  na
2 Set 1 User 2  no  na
3 Set 1 User 3  no  na
4 No Change to Help Tab Location – User 1  no  na
5 No Change to Help Tab Location – User 2  no  na
6 No Change to Help Tab Location – User 3  no  na
7 Help moved to Admin Bar – User 1  no  na
8 Help moved to Admin Bar – User 2  no  na
9 Help moved to Admin Bar – User 3  no  na
10 Help Tab a Different Color – User 1  no  na
11 Help Tab a Different Color – User 2  no  na
12 Help Tab a Different Color – User 3  no  na

Please comment with the number of the video you’d like to do a write up on.

#admin-help, #user-testing, #user-testing-videos

Admin Help Videos (round two)

Some interesting results. Keep in mind (if you watch these all the way through) that some of these had multiple users doing things at the same time, so there are a few occasions where theme or widget changes disappeared because someone else was doing it, too.

No change to the help tabs

User 1
This person didn’t have any issues. Never used the help.

User 2
This person didn’t have any issues. They did leave this comment:

I would want a help section for each category/section as well as a help search box so I can quickly find an answer

…and I can’t tell if they are saying that because they didn’t find the help, or if they are saying that because they *did* but it wasn’t how they expected. I assume the former (never found it) since they never clicked the tab.

User 3
This person did have problems, never found the help tab.

Help in the admin bar

User 1
This person commented on the lack of help documentation, but his LastPass bar was covering up the help button in the admin bar. (I guess that could be an argument against the admin bar being the final location of the help button/tab.)

User 2
This person found the help button, but it seemed to be because he was specifically looking for it (because the task said “use help if you need to”). It wasn’t natural.

User 3
Had problems, but they went to Google for help. Never found the help button.

Help tab a different color

User 1
This person never needed/never used the help tab.

User 2
This person didn’t need the help but they did find it.

User 3
This person found the help tab AND ACTUALLY USED IT (but it didn’t give him the answer he was looking for).

Conclusions

1. I think it’s safe to say the current help tabs are hard to see/find. Not one person even noticed they existed.

2. The admin bar solution doesn’t seem to work. Placement conflicts with popular password management browser extensions and it’s pretty nondescript sitting up there. The only person who did find it had to look for it.

3. The color seemed to make the help tab easier to find (maybe?). At any rate, 2/3 people found the help tab when we gave it a color. Maybe we can use MP6 themes to bring in a color that goes with the admin color scheme?

Next steps/ideas

I’m open. Here are a few things I’m thinking:

1. Replace the tab with a ? icon in the same location. Ideally colored.
2. Use a plugin that adds help in the sidebar (this will require someone to write up some help documentation for the tasks we are looking for people to accomplish for them to find).
3. Maybe another location? Like the Feedback tabs that hang on the right side of the window with GetSatisfaction stuff?
4. Possibly extend the color help plugin to pull in styles from the active MP6 theme, if possible.

Any other thoughts/ideas?

#3-8, #admin-help, #dashboard-help, #user-testing

Admin Help User Testing Videos

Here are the first videos from the user testing. We used the following questions:

You have just set up your first WordPress website – go you! Now that you’re set up, you want to get straight to customizing and using your website. You’re going to do some basic tasks in the administration panel. If you get confused please feel free to look for help both in the admin and elsewhere.

Log in the your website with the following details: username: test1 pw: m0byd1ck

You want to change the design of your website. Find the menu item that lets you do that and choose a new design (use the help in the admin or on other sites on the internet to if you need help to do this).

When you have found a design that you like, preview it, and activate it on your website. View the front page of your website.

Next, add a blog post. Find the menu item that lets you do that and click it. Add a title and some text to your blog post, and add an image. When you’re done, publish your post and view it on the front end.

Return to the admin of your website. Your website has a sidebar and you want to add a calendar of your blog posts to it. Find the menu item that allows you to do this and add a calendar. (use the help in the admin or on other sites on the internet to if you need help to do this). When you’re done, save and view it on the front end.

#admin-help, #user-testing