The Test Team helps manage testing and triage across the WordPress ecosystem. They focus on user testing of the editing experience and WordPress dashboard, replicating and documenting bug reports, and supporting a culture of review and triage across the project.
Please drop by any time in SlackSlackSlack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. with questions or to help out.
During WCEU there were a number of usability tests run. For each test, there was a form to follow through and questions. In this first part, five videos will be shared with the answers, then a second post with another five will be made. Thank you every person that both helped run tests and also took part in them. It’s really important to have opportunities to test like this.
As you watch through have a think about a few things:
What bugs or enhancements could be made from this?
What insights do you gain in the way people use GutenbergGutenbergThe Gutenberg project is the new Editor Interface for WordPress. The editor improves the process and experience of creating new content, making writing rich content much simpler. It uses ‘blocks’ to add richness rather than shortcodes, custom HTML etc. https://wordpress.org/gutenberg/?
Any ideas that spring up from this of ways to make the editor even better for people?
Share anything you have as a comment and part two will be along in a few days.
Test one
Notes: video comes on at end of test and the sound is a little far away
What role would you say matches you (you can say more than one
Developer
How often do you use WordPress
Daily
Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?
Looks familiar, as I worked wit Gutenberg before. I like the way, that the editor is very structured and simple and that the paragraph blockBlockBlock is the abstract term used to describe units of markup that, composed together, form the content or layout of a webpage using the WordPress editor. The idea combines concepts of what in the past may have achieved with shortcodes, custom HTML, and embed discovery into a single consistent API and user experience. is the default block.
Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?
Works almost as expected. I was using the shortode “/cover” to add the cover block. Unfortunately, I wasn’t able to select the block via cursor and to add it via return. I thought, I was able to do that in the past, but I might be mistaken.
Make the Cover block full-width. How was that?
No problem at all! 🙂
Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?
A piece of cake. ?
Now add a heading for the cupcakes section. What was adding a heading like?
Straight forward!
Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?
Except that I forgot the name of the “media/text” block, adding the block itself was easy, as expected.
Add a sentence or two below to finish off the cupcake section. How was adding the sentences?
No problem at all.
Add a new heading about cookies. How was adding a heading?
Straight forward, again.
Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?
As I used the media/text block before, adding another one was easy.
Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?
The quote was initially formatted bold. I tried making it italic as well, but it didn’t worked. Once I’ve made the text non-bold, I was then able to make it both bold and italic separate as well as combined. (This might be a bug that the default bold text cannot be formatted italic initially.)
At the bottom, add a horizontal divider. What was adding a divider like?
Once you know how to add one block, you can literally add every block. You only need to know the correct name of the corresponding block.
Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?
No problem. ?
Now, publish your post. What was the experience of publishing like?
Oh, I’ve published it already as I’m so used to hit the publish button after every change.
Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?
Gutenberg looks great and I see the potential. Unfortunately, it seems that the keyboard control hasn’t been implemented 100% yet and I think there’s still one or the other bug, e.g. the formatting issue I faced while adding the quote.
Is there any feature you’d love to see added you didn’t see?
Not at the moment, but I should work on a real life project to see what the demands of customers are.
Did the experience leave you wanting to use Gutenberg again?
Definitely! ?
Test two
Notes: No talking on this through the test
What role would you say matches you (you can say more than one
Developer
How often do you use WordPress
Daily
Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?
Disorientation
Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?
Wondering how the content will be displayed
Make the Cover block full-width. How was that?
easy
Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?
easy
Now add a heading for the cupcakes section. What was adding a heading like?
how does the position get selected?
Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?
same
Add a sentence or two below to finish off the cupcake section. How was adding the sentences?
easy
Add a new heading about cookies. How was adding a heading?
same
Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?
counter-intuitive/ difficult to find the correct block. Also, add block button doesn’t show up until you leave the previous block by pressing enter
Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?
easy
At the bottom, add a horizontal divider. What was adding a divider like?
difficult to discern which categoryCategoryThe 'category' taxonomy lets you group posts / content together that share a common bond. Categories are pre-defined and broad ranging. each block belongs to
Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?
easy
Now, publish your post. What was the experience of publishing like?
can’t tell if the post has already been published or not / no publish button (only ‘Update’)
Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?
I think it’s an interesting step, but wondering how the visual representation in WordPress is supposed to match the actual template and results.
Is there any feature you’d love to see added you didn’t see?
Forms
Did the experience leave you wanting to use Gutenberg again?
Yes
Test three
Notes: Recording happened at the end, not during the session. This is more of a user interview with some interesting insights into their experience.
What role would you say matches you (you can say more than one
Developer
How often do you use WordPress
Daily
Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?
nice looking, very strange to a user that is to standard editor
Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?
easy, could not move the block, probably just me
Make the Cover block full-width. How was that?
COOOOOL 🙂
Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?
nice, I can easily modify it and I see changes right on the spot
Now add a heading for the cupcakes section. What was adding a heading like?
easy
Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?
it was fine, up to now I got used to easy and fun part
Add a sentence or two below to finish off the cupcake section. How was adding the sentences?
fail doing it. text still appears right to image, not below
Add a new heading about cookies. How was adding a heading?
just like previous 🙂
Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?
Cool, I used search for finding certain block
Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?
easy as adding text
At the bottom, add a horizontal divider. What was adding a divider like?
nice, I can only choose from 3 preset line types
Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?
feels good
Now, publish your post. What was the experience of publishing like?
did not like pre-publish check
Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?
fun, it is hard to detach from old logic 🙂 but I could get used to it
Is there any feature you’d love to see added you didn’t see?
have no idea, I would have to play for a little longer
Did the experience leave you wanting to use Gutenberg again?
yes and no.
Test four
What role would you say matches you (you can say more than one
Security
How often do you use WordPress
Weekly
Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?
Different background colour for text boxes as not obvious, and need to click to see where to input text. Clean and simple.
Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?
Easy, intuitive. Maybe add ability to add overlaying text within the media library.
Make the Cover block full-width. How was that?
Did not find it easy to find the full width icon. Was looking in the sidebarSidebarA sidebar in WordPress is referred to a widget-ready area used by WordPress themes to display information that is not a part of the main content. It is not always a vertical column on the side. It can be a horizontal rectangle below or above the content area, footer, header, or any where in the theme. for the setting, which was not there.
Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?
I added a block, which was easy.
Now add a heading for the cupcakes section. What was adding a heading like?
I could not see the block icon, but immediately used the search feature, which I found intuitive.
Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?
Did not find the way to add text to right of image by myself. Didn’t realise you could expand and detract image.
Add a sentence or two below to finish off the cupcake section. How was adding the sentences?
Easy. Just clicked and started writing.
Add a new heading about cookies. How was adding a heading?
Easy
Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?
Tried to drag the image placeholder to the right, but was not possible. Eventually noticed the icon at the top.
Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?
Was easy to find the correct block.
At the bottom, add a horizontal divider. What was adding a divider like?
Searched for divider, used separator block.
Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?
Searched for block, didn’t find one, then added text and used the paragraph menu bar.
Now, publish your post. What was the experience of publishing like?
Clicked the publish button but post was not published, needed to then click publish again. Was expecting to publish on first click.
Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?
It’s different, will take getting used to, but not necessarily as bad thing, just need to get familiar with the new interface. Very clean interface, and largely intuitive.
Is there any feature you’d love to see added you didn’t see?
No
Did the experience leave you wanting to use Gutenberg again?
Yes
Test five
Notes: No sound really on this one as user didn’t talk through.
What role would you say matches you (you can say more than one
Developer
How often do you use WordPress
Daily
Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?
ok
Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?
A bit confusing.
Make the Cover block full-width. How was that?
I was looking for the option in a wrong place in first.
Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?
I added a paragraph, that was easy. Im not sure if it is intro paragraph.
Now add a heading for the cupcakes section. What was adding a heading like?
easy
Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?
The folding was not really intuitive.
Add a sentence or two below to finish off the cupcake section. How was adding the sentences?
Confusing and pretty unsuccessful
Add a new heading about cookies. How was adding a heading?
still confusing because of the folding issue.
Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?
Easy
Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?
ok
At the bottom, add a horizontal divider. What was adding a divider like?
ok
Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?
ok
Now, publish your post. What was the experience of publishing like?
ok
Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?
First time ever using Gutenberg. I do everything in Divi.
Is there any feature you’d love to see added you didn’t see?
Consistant nomenclature
Did the experience leave you wanting to use Gutenberg again?
