WordCamp San Francisco User Testing Results

WordCampWordCamp WordCamps are casual, locally-organized conferences covering everything related to WordPress. They're one of the places where the WordPress community comes together to teach one another what they’ve learned throughout the year and share the joy. Learn more. San Francisco, @johnbillion and I conducted some user tests.  We focused on three feature plugins planned for 4.1: Focus, Author Select, Session Manager.  When possible, we created an editor account for users and had them participate on there own device.  When they didn’t have a device, they participated on one of our laptops.

Below are the notes.

Dan – developer. using a macbook

“Wow” was first reaction to focus. Kind of felt like it was shocking and he needed some frame of reference. Maybe keep 5px or so of menu so you know you can go back to it. Fading of buttons kind of makemake A collection of P2 blogs at make.wordpress.org, which are the home to a number of contributor groups, including core development (make/core, formerly "wpdevel"), the UI working group (make/ui), translators (make/polyglots), the theme reviewers (make/themes), resources for plugin authors (make/plugins), and the accessibility working group (make/accessibility). it feel like they are disabled.
Author select – Immediately knew what to do. super natural
“Where are you logged in” – knew to go to profile page, found the panel right away.

Michelle – designer/developer. using a macbook

It’s disconcerting not to see all the things. “If the point of things is to be distraction free, it’s weird not to see publish since that is what people want to do”. Fading of buttons seems a bit weird. Not sure she like automatically going into distraction free. It’s jarring.
Author select -didn’t search, just selected.

Janneke – Developer. using an iPad mini

Author select on iPad mini – Super hard to use. Can’t really scroll down. Not at all intuitive.
Profile manager – Looks horrible on iPad mini
Focus – She is building it, so I didn’t test it 🙂

Josh – Developer. using a macbook

Likes not having the sidebarSidebar A sidebar in WordPress is referred to a widget-ready area used by WordPress themes to display information that is not a part of the main content. It is not always a vertical column on the side. It can be a horizontal rectangle below or above the content area, footer, header, or any where in the theme. menu. Losing the metaMeta Meta is a term that refers to the inside workings of a group. For us, this is the team that works on internal WordPress sites like WordCamp Central and Make WordPress. boxes seems odd. Might be weird for some people.
Author select. Select 2. Using display name instead of user name. Seems odd.
First looked to tools to find where he was logged in.

Joe – Developer. using a macbook

Lag on the editor screen makes things feel slow and confusing.
Author – Not used to to having it enabled by default is different. Seems to be able to use

Cory – WP business owner. using his macbook

Loves the focus. Seems super natural.
Author – Very usable.
Profile – Didn’t quite understand question at first, but once he did, made it and found that info right away.

Mel – designer. using our laptop

Focus – It’s weird that it’s not centered. Less things on the page makes it harder to focus.
Author – “I heart Select2”

Jen –  Freelance writer and photographer. Has her own blogblog (versus network, site), using a MacBook.

Initially wasn’t enthusiastic about the fact that the meta boxes and menu disappeared, “oh, what’s going on?”. Was confused about how to get them to re-appear, erroneously clicked an unrelated button in the browser in an attempt to get the UIUI User interface to reappear. After figuring out that the UI re-appears when you move your mouse or tab away, actually very much liked the behaviour.

I mentioned that we were considering adding a feature pointer pointing to the DFW button. Jen said she thinks this will be important. User has no other idea of what’s going on otherwise.

Couldn’t find where the user sessions may be listed. Mentioned that she is the only user on her sitesite (versus network, blog) so she would have no interest in it. Expected it to be on the dashboard, or on the same screen as Jetpack analytics.

Christen –  blogger

“Create a new post” – First went to quick draft. When I sent her to the regular draft screen, it seemed natural to her. She liked the “Distraction free writing”. It felt natural to her. Once it was in place though, she didn’t really look for anything else on the page.

Andre – Theme Builder. Design and build.

Focus Was natural. Really liked and it seemed 100% natural to him.
Author – Select two was a natural choice and he really likes it.
Went to tools page to find sessions.

Matt – developer and project manager

Not enthusiastic about using the editor focus improvements himself, but said he would leave it enabled for his clients who write more long form content than he does. Suggested that some form of A/B testing may be desirable if we have the time. No other feedback.

User session list will be of interest to him as a project/site manager, not so much use to his clients themselves. Suggested that we could implement a dashboard widgetWidget A WordPress Widget is a small block that performs a specific function. You can add these widgets in sidebars also known as widget-ready areas on your web page. WordPress widgets were originally created to provide a simple and easy-to-use way of giving design and structure control of the WordPress theme to the user. which displayed the “last accessed” time for the current user, or listed other current sessions if there is more than one. Also suggested adding an “active sessions” column to the user list screen, visible to site admins.

#user-testing, #wcsf2014

Feature Testing at WordCamp San Francisco

Getting feedback from real users is incredibly valuable, and WCSF occurs at a great time in the 4.1 dev cycle to do that. We will have a space next to the happiness bar to solicit feedback on upcoming features. In order to accomplish this, if you will be at WordCampWordCamp WordCamps are casual, locally-organized conferences covering everything related to WordPress. They're one of the places where the WordPress community comes together to teach one another what they’ve learned throughout the year and share the joy. Learn more. SF this weekend and want to get feedback on a feature that you are working on, please comment below.

I will setup some test sites with trunktrunk A directory in Subversion containing the latest development code in preparation for the next major release cycle. If you are running "trunk", then you are on the latest revision. and the trunk version of the feature plugins (along with some test data) to help expedite this. The plugins I am planning on having are:

https://github.com/johnbillion/wp-session-manager
https://github.com/avryl/focus
https://github.com/helenhousandi/wp-19867-9864/tree/select2-19867

If you can help with staffing this area, please comment below.

#wcsf2014

WCSF Final Planning

If you are not attending WCSF this year, you can ignore this post. If you are coming and planning to participate as part of the coreCore Core is the set of software required to run WordPress. The Core Development Team builds WordPress. team, please click through and read it all. 🙂

Continue reading

#wcsf, #wcsf2014

WCSF Tickets, Meetup Info

Anyone planning to attend WCSF this year from the core team, please read the post at https://make.wordpress.org/updates/2014/09/08/wcsf-tickets-and-stuff/ for information about WCSF ticket sales and the contributor days following the main conference. Thanks!

P.S. If you are planning to attend the coreCore Core is the set of software required to run WordPress. The Core Development Team builds WordPress. team meetupMeetup All local/regional gatherings that are officially a part of the WordPress world but are not WordCamps are organized through https://www.meetup.com/. A meetup is typically a chance for local WordPress users to get together and share new ideas and seek help from one another. Searching for ‘WordPress’ on meetup.com will help you find options in your area. but I have not been in touch with you regarding hotels, please pingPing The act of sending a very small amount of data to an end point. Ping is used in computer science to illicit a response from a target server to test it’s connection. Ping is also a term used by Slack users to @ someone or send them a direct message (DM). Users might say something along the lines of “Ping me when the meeting starts.” me in IRCIRC Internet Relay Chat, a network where users can have conversations online. IRC channels are used widely by open source projects, and by WordPress. The primary WordPress channels are #wordpress and #wordpress-dev, on irc.freenode.net. (jenmylo) or shoot me an email (same username @wordpress.org) so I can include you in the planning. If we have talked in general but you haven’t actually booked anything, don’t freak out — we have a spot on hold for you and you’ll be able to book it this week when we send out the booking codes.

#core-team-meetup, #wcsf2014

WCSF 2014: Are You Coming?

Heads up, core team! We’re getting ready to publish details about the plans for WordCamp this October (which includes a mini team meetup), so if you’re thinking of attending, please read the post at https://make.wordpress.org/updates/2014/06/12/wordcamp-san-francisco-travel-contributor-days/ and take the short survey linked at the end of it so I’ll know how many team members to plan for (don’t worry, this isn’t a commitment or anything, I just need to get some rough numbers for budgeting purposes). Thanks!

#core-team-meetup, #wcsf, #wcsf2014