The Test Team helps manage testing and triage across the WordPress ecosystem. They focus on user testing of the editing experience and WordPress dashboard, replicating and documenting bug reports, and supporting a culture of review and triage across the project.
If you’d like to help test Full Site Editing, please join the FSE Outreach Program. You can find current calls for testing for this program here and you can join the fun in #fse-outreach-experiment.
Here is the agenda for the upcoming Test Team meeting scheduled for 2021-06-08 13:00.
This meeting is held in the #core-test channel in the Making WordPress slackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/..
The following posts are calls for testing (CfT):
Do you have something to propose for the agenda? Please leave a comment below.
Can’t make the meeting? Share anything relevant for the discussion in a comment below.
The following is a summary of the bi-weekly Test Team triage meeting that occurred on 2021-06-01 13:00. A full transcript can be found here in the #core-test channel in the Make WordPress Slack. Meeting was moderated by @hellofromtonya.
Triage meetings are held every other Tuesday at 13:00 UTC. Reference to triage meetings announcement.
Following links were shared:
@hellofromtonya shared tickets #34012 and #16773 are scheduled for testing.
@francina shared that she didn’t work on #39827 but it’s still in her queue. @boniu91 to send a copy of the premium pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party license for testing.
<!--more--> is still relevant@francina and @justinahinon raised creating a P2 to announce adoption of Jest + Puppeteer as the e2e setup for Core and need for handbook updates. This is a follow-up to a previous P2 by @francina.
Action: Create a draft for team review
@francina raised suggestion to restart the team’s meetings.
Team agreed to do these meetings same day and time but on alternating Tuesdays starting next week.
Action: @hellofromtonya to add to meetings calendar. Done ✅
Action: @hellofromtonya to gather topics from team and create agenda for 1st team meeting
The following is a summary of the bi-weekly Test Team triage meeting that occurred on 2021-05-28 13:00. A full transcript can be found here in the #core-test channel in the Make WordPress Slack. Meeting was moderated by @hellofromtonya.
Triage meetings are held every other Tuesday at 13:00 UTC. Reference to triage meetings announcement.
Following links were shared:
Started triage session using this ticket query report. During the meeting, this report was refined to this report.
needs-testing-info keywordTrac link https://core.trac.wordpress.org/ticket/50924
needs-testing keyword be removed?dev-feedback keywordThe following is a summary of the bi-weekly Test Team triage meeting that occurred on 2021-05-04 13:00. A full transcript can be found here in the #core-test channel in the Make WordPress Slack. Meeting was moderated by @hellofromtonya.
Triage meetings are held every other Tuesday at 13:00 UTC. Reference to triage meetings announcement.
Team planned to triage each 5.8 ticket marked as needs testing to determine if:
Once the session started, shifted to discuss keywords and workflows for collective understanding.
Started reviewing ticket 37255 which has these testing keywords:
has-patch means it has code to be testedneeds-testing indicates a call for manual testing needs-testing-info means it needs step-by-step instructions of how to test it. Here’s where the comment asking for those instructions.This ticket is not in a testable state. Team decided to discuss the meaning and usage of the keywords as well as how this team will know when it’s ready to be tested.
Discussed needs-testing keyword:
needs-testing keyword should be removed until all the testing details are added. has-testing-info requirement.Discussed workflow to know when a ticket is ready for Test Team action:
ready-to-testhas-patch needs-testing has-testing-info.Team decisions:
@hellofromtonya shared the needs-testing-info script she used during 5.6 @hellofromtonya shared the needs-testing-info script she used during 5.6 and 5.7 cycles:
Please provide need more information to help testers manually test the patch (including at Test Scrubs):
– What are the steps to test?
– Are there any testing dependencies, such as a pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the WordPress.org Plugin Directory https://wordpress.org/plugins/ or can be cost-based plugin from a third-party or script?
– What is the expected behavior after applying the patch?
Team briefly discussed. Ran out of time.
Meeting went past the planned hour. @hellofromtonya wrapped up by encouraging further async discussion and Q&A.
Thanks to everyone who attended!
Last week, the Test Team agreed to do bi-weekly test triage sessions. These meetings will happen every other Tuesday at 13:00 UTC (starting this week).
Next test triage meeting will be held on 2021-05-04 13:00 in the #core-test on SlackSlack Slack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/.. Come join to triage with the team.
The meetings are now in the calendar.
In context of bug repositories such as TracTrac Trac is the place where contributors create issues for bugs or feature requests much like GitHub.https://core.trac.wordpress.org/. or GitHubGitHub GitHub is a website that offers online implementation of git repositories that can can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/, triage means sorting, labeling, and closing duplicate incoming issues and testing means manually testing bug reports, questions, and feature requests.
Triage & Testing Issues in Test Team’s handbook
The goals are:
There are multiple “testable” states in a ticket’s lifecycle including these (keyword shown in parentheses):
has-testing-info)has-patch)needs-testing)has-testing-info)has-patch)needs-unit-tests)has-testing-info)Props to @francina for peer review.
We would love to have you! GutenbergGutenberg The Gutenberg project is the new Editor Interface for WordPress. The editor improves the process and experience of creating new content, making writing rich content much simpler. It uses ‘blocks’ to add richness rather than shortcodes, custom HTML etc. https://wordpress.org/gutenberg/ releases are happening every few weeks right now.
To help with general testing after opting in to the “Try Gutenberg” callout in the WordPress 4.9.8 dashboard, please comment here or say hello in #core-test on WordPress Slack.
To help with pre-release testing, or regression testing, first get a testing environment setup.
If you find a new bug, file it in gutenberg on GitHub.
Anyone can jump in to help with issues labeled Needs Testing and if you are a developer then issues labeled Needs Technical Feedback would be a great place to lend a hand. See the bug testing guidelines in the handbook for some tips.
If you want to help and aren’t sure where to start, just ask!
