WCEU usability test results: part one

During WCEU there were a number of usability tests run. For each test, there was a form to follow through and questions. In this first part, five videos will be shared with the answers, then a second post with another five will be made. Thank you every person that both helped run tests and also took part in them. It’s really important to have opportunities to test like this.

As you watch through have a think about a few things:

  • What bugs or enhancements could be made from this?
  • What insights do you gain in the way people use Gutenberg?
  • Any ideas that spring up from this of ways to make the editor even better for people?

Share anything you have as a comment and part two will be along in a few days.

Test one

Notes: video comes on at end of test and the sound is a little far away

What role would you say matches you (you can say more than one

Developer

How often do you use WordPress

Daily

Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?

Looks familiar, as I worked wit Gutenberg before. I like the way, that the editor is very structured and simple and that the paragraph block is the default block.

Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?

Works almost as expected. I was using the shortode “/cover” to add the cover block. Unfortunately, I wasn’t able to select the block via cursor and to add it via return. I thought, I was able to do that in the past, but I might be mistaken.

Make the Cover block full-width. How was that?

No problem at all! 🙂

Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?

A piece of cake. ?

Now add a heading for the cupcakes section. What was adding a heading like?

Straight forward!

Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?

Except that I forgot the name of the “media/text” block, adding the block itself was easy, as expected.

Add a sentence or two below to finish off the cupcake section. How was adding the sentences?

No problem at all.

Add a new heading about cookies. How was adding a heading?

Straight forward, again.

Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?

As I used the media/text block before, adding another one was easy.

Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?

The quote was initially formatted bold. I tried making it italic as well, but it didn’t worked. Once I’ve made the text non-bold, I was then able to make it both bold and italic separate as well as combined. (This might be a bug that the default bold text cannot be formatted italic initially.)

At the bottom, add a horizontal divider. What was adding a divider like?

Once you know how to add one block, you can literally add every block. You only need to know the correct name of the corresponding block.

Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?

No problem. ?

Now, publish your post. What was the experience of publishing like?

Oh, I’ve published it already as I’m so used to hit the publish button after every change.

Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?

Gutenberg looks great and I see the potential. Unfortunately, it seems that the keyboard control hasn’t been implemented 100% yet and I think there’s still one or the other bug, e.g. the formatting issue I faced while adding the quote.

Is there any feature you’d love to see added you didn’t see?

Not at the moment, but I should work on a real life project to see what the demands of customers are.

Did the experience leave you wanting to use Gutenberg again?

Definitely! ?


Test two

Notes: No talking on this through the test

What role would you say matches you (you can say more than one

Developer

How often do you use WordPress

Daily

Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?

Disorientation

Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?

Wondering how the content will be displayed

Make the Cover block full-width. How was that?

easy

Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?

easy

Now add a heading for the cupcakes section. What was adding a heading like?

how does the position get selected?

Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?

same

Add a sentence or two below to finish off the cupcake section. How was adding the sentences?

easy

Add a new heading about cookies. How was adding a heading?

same

Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?

counter-intuitive/ difficult to find the correct block. Also, add block button doesn’t show up until you leave the previous block by pressing enter

Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?

easy

At the bottom, add a horizontal divider. What was adding a divider like?

difficult to discern which category each block belongs to

Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?

easy

Now, publish your post. What was the experience of publishing like?

can’t tell if the post has already been published or not / no publish button (only ‘Update’)

Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?

I think it’s an interesting step, but wondering how the visual representation in WordPress is supposed to match the actual template and results.

Is there any feature you’d love to see added you didn’t see?

Forms

Did the experience leave you wanting to use Gutenberg again?

Yes


Test three

Notes: Recording happened at the end, not during the session. This is more of a user interview with some interesting insights into their experience.

What role would you say matches you (you can say more than one

Developer

How often do you use WordPress

Daily

Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?

nice looking, very strange to a user that is to standard editor

Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?

easy, could not move the block, probably just me

Make the Cover block full-width. How was that?

COOOOOL 🙂

Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?

nice, I can easily modify it and I see changes right on the spot

Now add a heading for the cupcakes section. What was adding a heading like?

easy

Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?

it was fine, up to now I got used to easy and fun part

Add a sentence or two below to finish off the cupcake section. How was adding the sentences?

fail doing it. text still appears right to image, not below

Add a new heading about cookies. How was adding a heading?

just like previous 🙂

Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?

Cool, I used search for finding certain block

Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?

easy as adding text

At the bottom, add a horizontal divider. What was adding a divider like?

nice, I can only choose from 3 preset line types

Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?

feels good

Now, publish your post. What was the experience of publishing like?

did not like pre-publish check

Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?

fun, it is hard to detach from old logic 🙂 but I could get used to it

Is there any feature you’d love to see added you didn’t see?

have no idea, I would have to play for a little longer

Did the experience leave you wanting to use Gutenberg again?

yes and no.


Test four

What role would you say matches you (you can say more than one

Security

How often do you use WordPress

Weekly

Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?

Different background colour for text boxes as not obvious, and need to click to see where to input text. Clean and simple.

Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?

Easy, intuitive. Maybe add ability to add overlaying text within the media library.

Make the Cover block full-width. How was that?

Did not find it easy to find the full width icon. Was looking in the sidebar for the setting, which was not there.

Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?

I added a block, which was easy.

Now add a heading for the cupcakes section. What was adding a heading like?

I could not see the block icon, but immediately used the search feature, which I found intuitive.

Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?

Did not find the way to add text to right of image by myself. Didn’t realise you could expand and detract image.

Add a sentence or two below to finish off the cupcake section. How was adding the sentences?

Easy. Just clicked and started writing.

Add a new heading about cookies. How was adding a heading?

Easy

Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?

Tried to drag the image placeholder to the right, but was not possible. Eventually noticed the icon at the top.

Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?

Was easy to find the correct block.

At the bottom, add a horizontal divider. What was adding a divider like?

Searched for divider, used separator block.

Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?

Searched for block, didn’t find one, then added text and used the paragraph menu bar.

Now, publish your post. What was the experience of publishing like?

Clicked the publish button but post was not published, needed to then click publish again. Was expecting to publish on first click.

Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?

It’s different, will take getting used to, but not necessarily as bad thing, just need to get familiar with the new interface. Very clean interface, and largely intuitive.

Is there any feature you’d love to see added you didn’t see?

No

Did the experience leave you wanting to use Gutenberg again?

Yes


Test five

Notes: No sound really on this one as user didn’t talk through.

What role would you say matches you (you can say more than one

Developer

How often do you use WordPress

Daily

Go to “Posts -> Add New” to create a new post. Once the new editing experience shows, what are your first impressions?

ok

Add a Cover block to your post, include a background image, and a message overlaying the image that reads, “The sweetest place on earth”. What was the experience like?

A bit confusing.

Make the Cover block full-width. How was that?

I was looking for the option in a wrong place in first.

Add an intro paragraph below that reads, “This bakery is committed to using the finest ingredients from all over the world ensuring that quality remains the cornerstone of their business. In fact, quality is the number one ingredient in everything they do.” What was adding that text like?

I added a paragraph, that was easy. Im not sure if it is intro paragraph.

Now add a heading for the cupcakes section. What was adding a heading like?

easy

Under the Cupcake heading, add an image of cupcakes with some text along the right side of it. What was the experience of this like?

The folding was not really intuitive.

Add a sentence or two below to finish off the cupcake section. How was adding the sentences?

Confusing and pretty unsuccessful

Add a new heading about cookies. How was adding a heading?

still confusing because of the folding issue.

Under the Cookie heading, add a Media+Text block with an image of cookies on the right, and some text on the left side. What was that like?

Easy

Below the Media+Text block, add a quote you heard someone say about this bakery. Maybe something like, “This bakery is almost as good as Grandma’s house!” How was adding a quote?

ok

At the bottom, add a horizontal divider. What was adding a divider like?

ok

Finally, include a link to the bakery site. Type the bakery name, and then link it to any website. How was the experience of adding a link?

ok

Now, publish your post. What was the experience of publishing like?

ok

Thank you for taking part in this test. Is there anything you’d like to share about the experience of creating content with Gutenberg?

First time ever using Gutenberg. I do everything in Divi.

Is there any feature you’d love to see added you didn’t see?

Consistant nomenclature

Did the experience leave you wanting to use Gutenberg again?

not really


#wceu-usability-testing #usability-testing #gutenberg