Shiny Updates User Testing

We wanted to get some user research around the Shiny Updates plugin (and the plugin process in general).

The first tests were done with basic tasks like installing, activating, and deleting plugins. These were without the Shiny Update plugin installed. I also had the user answer a few questions after the tasks as well.

User 1

Questions:

  1. How often do you visit the Plugin page on your own WordPress website?Rarely. I used WordPress.com over a year ago, but had extensive experience with the product.
  2. How many plugins do you typically have installed on your WordPress sites?I would estimate 5-10 plugins.
  3. Is it easy to see which plugins you have installed and to see the status of those plugins?Yes.
  4. Is there anything you’d like to change with the Plugins process?I personally thought it was very easy to use. Any wordpress user would have an easy time using it.

 


 

User 2

Questions:

  1. How often do you visit the Plugin page on your own WordPress website?Everytime I am working on my sites.
  2. How many plugins do you typically have installed on your WordPress sites?2 or 3
  3. Is it easy to see which plugins you have installed and to see the status of those plugins?Yes
  4. Is there anything you’d like to change with the Plugins process?No

 

The next test involved installing Shiny Updates. I really bombed here in the wording of my questions and basically confused the user which lead to uncompleted tasks, but this is a good jump off point. I learned a lot about the differences in the processes myself. 🙂 I’ll document these differences soon.  I’m currently refining the test to help improve the task flow.

User 1 (of next test)

Questions:

  1. How often do you visit the Plugin page on your own WordPress website?I have never visited the Plugin page before. I am familiar with Plugins but have never added them to my WordPress site before this exercise.
  2. How many plugins do you typically have installed on your WordPress sites?I only have any plugins that are automatically installed on my WordPress site. I have never installed any additional plugins.
  3. Is it easy to see which plugins you have installed and to see the status of those plugins?Yes, very easy. The list format is easy to see and read; I like that the status of the plugin is stated directly below the name. It makes it quick and easy to visually know what is installed and activated/deactivated on the site.
  4. Is there anything you’d like to change with the Plugins process?My only suggested change would be to include all of the options offered on the drop down “Bulk Actions” menu directly below the names of each added Plugin. This might make the process of making changes a bit quicker and easier for users. Also. the name Bulk Actions makes it sound as though that is only to be used if making changes to multiple plugins so it may be a bit misleading for users who are attempting to make changes to only one plugin at a time.

 

 

Some takeaways:

  • Doing away with the ‘bleak screen of sadness’ is a great start. That screen tended to cause confusion and required a full read to understand what was happening on that page.
  • The bulk update dropdown and button seem to get a lot of attention even though the user may only be targeting one plugin at a time. This could be due to the fact that that is the primary button in the most relevant place which might misguide them. Users also are not necessarily selecting a plugin before clicking the ‘apply’ button which doesn’t return any useful feedback.

I’ll be modifying the next test and sharing the results shortly.

#shiny-updates, #user-research, #user-testing, #ux