The Test Team helps manage testing and triage across the WordPress ecosystem. They focus on user testing of the editing experience and WordPress dashboard, replicating and documenting bug reports, and supporting a culture of review and triage across the project.
I know this is a bit late, but I’ve got several usability tests to share from January 2020. I spent that month looking into the Columns blockBlockBlock is the abstract term used to describe units of markup that, composed together, form the content or layout of a webpage using the WordPress editor. The idea combines concepts of what in the past may have achieved with shortcodes, custom HTML, and embed discovery into a single consistent API and user experience. in GutenbergGutenbergThe Gutenberg project is the new Editor Interface for WordPress. The editor improves the process and experience of creating new content, making writing rich content much simpler. It uses ‘blocks’ to add richness rather than shortcodes, custom HTML etc. https://wordpress.org/gutenberg/. The Gutenberg Team has been making several changes to help the experience and these videos can help continue the improvements.
This particular test proved to be quite difficult and long due to the nature of the Columns block. Next time around I’ll be sure to limit the set of tasks.
Imagine you’ve just been tasked with creating a webpage about pies. WordPress offers a Columns block in its new block-based editor. This is what you’ll focus on during this usability test. Let’s create a webpage about pies using the Columns block!
Create a new post.
Add a title to your post.
Under the title add a Separator block. Once it is added, make sure you set it to “wide.”
Next, add a Columns block to the page, and choose the 3-column setting.
In the left column, add an Image block and set the image to be a pie.
In the middle column, add this text:
Key lime pie withdrawal
Not as easy as it sounds
Especially if you are totally addicted.
I can walk past pumpkin all day long
And not dig into it with a tablespoon.
If it has whipped cream, I might take a bite.
Who am I kidding?
Let’s put it where it lives.
If it has sugar, it is mine.
And get out of the way!
In the right column, add another Image block with another picture of a pie.
Set the right column’s width to 20%.
Set the left column’s width to 40%.
Did you notice anything change when you did that? Check the right column again and readjust the width to 20% if needed.
In this right column, change it so the image aligns to the bottom of the column.
Below this Columns block, add a Cover block.
Set the background image to be another picture of a pie.
Add a Columns block inside this Cover block, and choose the 2-column setting.
Make the left column width 70%.
In the right column, add the text “PIES” and change the font to be “Large.”
Below the Cover block, add another Columns block with 2 columns.
In the left column, add the text, “When Alice’s Aunt Polly, the Pie Queen of Ipswitch, passes away, she takes with her the secret to her world-famous pie-crust recipe. Or does she? In her will, Polly leaves the recipe to her extraordinarily fat, remarkably disagreeable cat, Lardo . . . and then leaves Lardo in the care of Alice.”
In the right column, add the text, “Suddenly, the whole town is wondering how you leave a recipe to a cat. Everyone wants to be the next big pie-contest winner, and it’s making them pie-crazy. It’s up to Alice and her friend Charlie to put the pieces together and discover the not-so-secret recipe for happiness: Friendship. Family. And the pleasure of doing something for the right reason.”
Preview your post, and then publish it.
Video 1 (Jan 8)
The change sign (block transform icon) made me think I was restarting something.
[looking at the multiple + icons everywhere] “It looks like I have multiple columns now. I don’t know what went wrong with this.”
The user struggled with adjusting the width of a single column. It was not clear how to do that.
It’s really hard to find how to adjust the width of this.
Video 2 (Jan 15)
[trying to select the single column block] How do you stop selecting the image?
To me it’s not clear. How do I select the column?
Video 3 (Jan 22)
I’ve never used this software before and I’m not sure how to set the column width.
Up to this point, everyone who has tried to add a Cover block below the Columns block has just added the block inside one of the Columns under the image. At this point things start falling apart because it’s just too many blocks inside a narrow space.
Video 4 (Jan 29)
I can’t find where I can do this. [setting column width]
The instructions were very hard to follow. It’s hard to know where to look and what to click on.
As with all the prior videos being shared, please leave some feedback! What are some patterns that pop out to you? What successes do these users have in navigating and creating a post? What challenges become evident in their flowFlowFlow is the path of screens and interactions taken to accomplish a task. It’s an experience vector. Flow is also a feeling. It’s being unselfconscious and in the zone. Flow is what happens when difficulties are removed and you are freed to pursue an activity without forming intentions. You just do it.
Flow is the actual user experience, in many ways. If you like, you can think of flow as a really comprehensive set of user stories. When you think about user flow, you’re thinking about exactly how a user will perform the tasks allowed by your product.Flow and Context
As a reminder, if you’re interested in helping with usability testing, there’s a number of things you can try: