Shiny Updates User Testing – Plugins

This is another Shiny Updates user test focused on the plugin flow of Installing, Activating, Updating, and Deleting. I tried to be more specific with the questions so that we could push the user in the direction we needed them to go without allowing them to ‘discover’ their own way through. While I understand this request, I’m not entirely sure this is the best course of action. Even with specific instructions, the user still had trouble.




2.22 – The user completely missed the ‘Activation’ task. My assumption is she considered ‘activation’ as part of the ‘installation’ process, or the fact that the plugin card doesn’t offer a way to ‘activate’ the plugin after install alludes to it not being a manual task. Or she just completely missed it.

3:05 – Rather than going to her list of installed plugins, she remains in the Plugin Dir and performs the update process from there by searching for the specific plugin I mentioned in the task. This caused a bit of confusion.

4:29 – It bothered her that the Updated icon and the Install Now icon were the same. I wonder if the Install Now icon should be something like a ‘download’ icon to help differentiate?

5:46 – When deleting a plugin with Shiny Updates installed, the deletion process still took her to the Bleak Screen of Sadness.

6:51 – After performing a bulk update on two plugins, an error appeared and no updates happened. She didn’t notice the Error Message at the top, nor did she initially notice the inline messages in the plugin rows themselves.

8:27 – The inline message in the plugin row after Updating the plugin still reads “Updating…” even though it’s done and should just read “Updated”.

9:18 – The green left border on the Updating message looked like the update only got so far. Because the message still reads “Updating…” she thinks that the dark green border is supposed to fill in as the updating process occurs.



I’m going to refine the tasks a bit more and work with @obenland to make sure the errors are resolved before creating more tests.

#shiny-updates, #upgrade-install