The Test Team helps manage testing and triage across the WordPress ecosystem. They focus on user testing of the editing experience and WordPress dashboard, replicating and documenting bug reports, and supporting a culture of review and triage across the project.
Please drop by any time in SlackSlackSlack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. with questions or to help out.
After one month of very intensive activity, we have finally reached the end of the test team program. We would like to thank all the participants for their dedication and hard work throughout this period. The program has been a great success in many areas, and we have gathered valuable insights and feedback that will help us improve our whole contribution onboarding process.
During the program, we started with a total of 9 participants, but after some expected dropouts, we ended with 6 members, with most participants doing a fantastic job during the entire process. They were involved in tasks such as testing, documentation improvements, leading meetings, and a lot of feedback to support the team’s growth.
In a dedicated SlackSlackSlack is a Collaborative Group Chat Platform https://slack.com/. The WordPress community has its own Slack Channel at https://make.wordpress.org/chat/. channel, we have been able to work very closely with the participants, gathering information about their experience through the process and also sharing the progress of this program. There was no clear starting program structure, but one happened to begin shaping as weeks went by that could be described as follows for the record:
Program Weekly Structure
The first week was focused on onboarding all members on the testing protocol as soon as possible, because one of the main targets was to go through a significant amount of tickets through the program period.
During the second week, we started introducing the meeting protocols, both for patch testing scrubbing and how to run the weekly test meetings with the corresponding agenda and summary post publishing. We also started to gather feedback on the testing protocol because the initial test results started to pop up.
For the third week, we switched the focus to documentation improvements, and we started to gather feedback on the meeting protocols and keep it up on the testing part. The contributor pathway video program began to come together.
Finally, for the last week, we tried to clear up all the final questions and analyze the current state of WordPress in correlation with the testing team to set future goals for the coming months.
Program Results
Overall, the program has exceeded our expectations in terms of engagement and results. Some goals were shared with the participants in the first interview, but from the experience we had from past programs, we knew that generally these goals were challenging to meet and could not be met. However, in this case, we have been able to achieve most of the goals and even exceed some of them. Here are some of the key results we have achieved:
Testing Reports
At the beginning of the program, there were a total of 487 tickets with the needs-testing label. By the end of the program, this number has dropped to 264, which is a significant decrease of almost 50%. This is by far one of the biggest achievements. We are pleased to observe that the protocol has been refined to a point that members were able to go through tickets at an excellent pace, understanding the whole process with proficiency. This will probably translate into a more efficient process in the future.
Documentation Improvements
Improving internal protocol documentation is something that requires more experience and time inside the team. However, we have been able to gather a lot of feedback and proposals for documentation improvements in our GitHub repository, which is a great starting point for the future. We have already started working on some proposals, and we hope to have them published in the following weeks.
The Crown Jewel: Test Contributor Pathway in Progress
One of the main goals of this program was to create a video training with a clear pathway for future contributors. We are delighted to announce that the program is almost completed, and we are planning to have it ready in a couple of weeks. A lot of feedback has been gathered through the program, and soon there will be an announcement in case anyone wants to join the “betaBetaA pre-release of software that is given out to a large group of users to trial under real conditions. Beta versions have gone through alpha testing in-house and are generally fairly close in look, feel and function to the final product; however, design changes often occur as part of the process. program” to test the training and provide feedback before the official launch.
Participant Engagement Analysis as a Blueprint for Future Test Team Aspirants
We believe that sharing the results of the program participants could be useful for future WordPress contributors to understand which level of engagement is expected from them if they want to be part of the Test Team. And furthermore, to discover the different ways they can contribute to the team.
1. Ozgur (@ozgursar): Worked on a total of 68 testing reports, drove a test-chat and started leading to a documentation improvement regarding email testing. For the next few weeks, we expect the docs page to get published and a patch testing scrubbing meeting to be led to complete the whole circle. He is the first participant proposed to join the Test Team and continue his journey with us.
2. Huzaifa (@huzaifaalmesbah): Worked on a whopping total of 89 testing reports, which has been massive, and also proposed a documentation improvement regarding the `Getting started for testing` page structure. The only thing he has missed is leading some different meeting sessions, but there is already one scheduled for next week, and we are sure that with all the knowledge he has now, he is more than ready to lead more sessions in the future. He is the second participant suggested for joining the team.
3. Juanma (@juanmaguitar): He has been extremely active leading proposals for documentation improvements and providing a ton of feedback during all sessions, including a triaging guide, test-chat protocol guide, and some tips on post-tag improvement during a test-chat session. He has also led one test-chat session, but the only downside is that he has only been involved in testing 3 tickets, clearly the only weaker point that we hope could be improved in the following weeks to be somewhat on par with the rest of the participants. He is the third participant proposed for joining the team, and we are sure that with a bit more involvement in the reporting part, he can be a great asset for the team.
4. Erick (@r1k0): He worked through a grand total of 52 testing reports and also led one of the patch testing scrubs. There is only one thing that he has missed to go through the whole process, and it is the documentation improvement work and jumping into a couple more meeting leading sessions, but we are sure that he is more than ready to do it in the following weeks. He is the fourth participant recommended for joining the team, and we hope he jumps into the documentation part as soon as possible to be able to be on the team with a more complete profile.
5. Shazzad (@sajib1223): He was already active as a test team contributor before the program, but during the program, he has been able to consolidate many doubts he had about the test team protocols. He was able to run a patch testing scrub, but still in the other areas he has been lagging a bit. With no documentation proposals yet, only 10 tickets, and no test-chat sessions, we hope he can get quickly up to speed in the following weeks to be able to join the Test Team officially.
6. Mohammed (@mohkatz): He has been the last participant that has attended the whole program sessions, but unfortunately, he has not met the minimal requirements. With no testing reports, no documentation proposals, and no meeting-leading sessions. Hopefully, if he gives the team more time, he can get up to speed in the following weeks and be able to join the Test Team in the near future.
As I commented in the beginning, the other 3 participants that were selected dropped out in the beginning of the program for different reasons, and we hope that they can get involved in the future if they’d like to.
Future Directions and Organizer Personal Thoughts
As the organizer, I can’t stress anymore that this program has gone great, but simultaneously, I have to acknowledge that it has been very exhausting to organize. Running future programs like this is uncertain, and probably more organization and resource gathering will be required to be able to make it happen again in the following months. The dedication required from the organizers and participants is very high. Not only the two hours required for the live weekly sessions, but also the time to go through questions in the Slack chat, manually review most of the reports done and the documentation proposals, and also the time to create the training ideas.
Results of a program like this are proven to be excellent, but we need to find a way to make it more sustainable for the future. Luckily, now we have a couple of members onboarding in the team now and some additional ones probably soon, and we hope that they can take some of the leading load that has been driven by the current members in all testing areas, including, maybe, running future programs like this one.
The program is designed to provide comprehensive training for new and existing members of the Test Team. It will cover various aspects of testing, including testing practices, test team processes, and a lot of feedback and introspection to improve collaboration pathways.
The training sessions are not strictly structured. They will include a mix of presentations, hands-on activities, group discussions, and Q&A sessions to ensure an engaging learning experience. This training is meant to be interactive and to shape the future of the Test Team.
There will be no recorded sessions to encourage live participation and interaction, and one of the main intentions will be to materialize the participants experiences into a comprehensive guide for future members of the Test Team.
Introductory Material
To prepare for the training sessions, participants are encouraged to review the following introductory materials:
If you don’t have good experience with local testing environments, please check the Local Testing Environment Setup Guide (Part 1)(Part 2).
At present, the Test Team operates with limited active resources, and a significant portion of the workload is handled by a tiny number of contributors. This creates bottlenecks and increases the risk of fatigue for those who remain consistently involved.
Over time, participation patterns within the Test Team have changed. Many past members are no longer actively involved, which reflects the absence of clear long-term participation expectations in earlier years. As a result, previous team members were recognized under practices that did not clearly distinguish between short-term involvement and sustained contribution. These recognitions will be respected, as they were granted under the rules and understanding in place at that time.
Starting in 2026, the Test Team will introduce clearer participation guidelines. Earning “emeritus” status will be based on sustained and consistent contribution over time, rather than short-term or representative involvement alone. New members are expected to remain actively engaged, to the best of their ability, over an extended period.
Towards an easier-to-join but easier-to-leave team
Historically, joining any WordPress team is moderately easy and difficult at the same time.
Mainly there are two ways to join:
The easy way: joining as a team representative. There is a window every year if you want to join this way, just for the sake of accomplishment, and you’re good to move on after that year. Many members have nominated themselves to try to witness if, by any chance, they got selected. The sole difficulty of this was the fact that only two members could join (three members in some teams), and in numerous instances, gaining reputation was not even relevant: by manipulating the vote system, some managed to join hideously.
The hard way: an extremely rare way, where some members do an epic task and they are recognized as team members for a real merit. Exceptional tasks are things like triaging a couple hundred tickets or managing dozens of meetings, scrubs, or any other activity in the given team. This path is much less common and requires significant dedication and effort, making it the true recognition of commitment and contribution. For the past decade, less than a handful of members have been able to achieve the Test Team role through this method for many reasons, including poor guidelines to clearly help direct efforts.
To address these challenges, we must redefine the criteria for becoming and remaining a Team member, emphasizing sustained contribution and active participation over time rather than just initial entry.
The proposal comes with lowering the barrier for joining “the hard way” but dismissing those “reps” as the sole way to access. We should not forget that representatives are not team leaders; it’s just a shared commitment to support the team over a year-long period. Ideally, already established contributors should be taking this role instead of new members aspiring to get the role just to get the accomplishment or, even worse, the badge.
Lowering the entry barrier will facilitate the access of many more members to the team, but at the same time, new rules should come by to help remove the non-emeritus team members that have not fulfilled a consistent expectation over time. This way we will switch the sense of accomplishment with a sense of duty. Only those that stay for long enough will receive the “emeritus status,” as already introduced, which means preserving the status forever. More details will be commented on in next year’s meetings and further discussed in the Test Handbook GitHub issue tracker.
Announcing: The Test Team Training Program
To support these new guidelines and help members develop the skills needed for meaningful contributions, we are excited to announce the launch of the Test Team Training program. This initiative aims to provide structured learning opportunities and resources to empower both new and existing members to engage more effectively with testing activities.
Starting in January 2026, we will be covering 4 main areas during the 4-week program duration
Development of handbook and training resources.
Collaboration and communication within the team.
Testing fundamentals and best practices.
Meetings and scrub management.
Members willing to join the program should be available to invest at least 20 hours during the program’s month (expecting 2-hour live sessions + 3 hours of individual practice per week). “Graduating” will not necessarily warrant a spot on the Test Team but will provide precise guidance on the steps to get there with ease.
Be aware that this is not a mentorship but a guided trainer’s training. Instead, it focuses on equipping participants with precise knowledge and tools to effectively contribute to and support the team’s testing efforts. We may consider future trainings depending on the results. It will be open only to 5 spots. Even though, theoretically, Team members don’t need to be technical for this training, a basic level of technical familiarity (i.e., GitHubGitHubGitHub is a website that offers online implementation of git repositories that can easily be shared, copied and modified by other developers. Public repositories are free to host, private repositories require a paid subscription. GitHub introduced the concept of the ‘pull request’ where code changes done in branches by contributors can be reviewed and discussed before being merged be the repository owner. https://github.com/, WordPress testing workflows, and reading code) is required. In case that there are more spot requests than the 5-cap limit, we will be selecting by technical skill level.
If you have come this far and you want to join, please fill out the following form:
The starting date will probably be the 8th or 15th of January, but it is still pending confirmation. Each of the two one-hour live sessions will most likely be around 3 or 4 PM GMT Tuesdays and Thursdays, and they won’t be recorded.
On the 4th and 18th of July, two feedback sessions were held with many contributors in the current Test Team. Valuable insights were gathered to shape a future to improve the overall Quality of CoreCoreCore is the set of software required to run WordPress. The Core Development Team builds WordPress. contributions. If you are here just for the steps to join, go straight to the bottom.
According to the last report, several key areas for improvement were identified, including a communication gap and the misguided efforts driven by this team. On top of that, the committer activity base has been significantly declining in the past few months. The gap between contributors and committing attempts has been increasing overtime without a clear solution upfront.
To address these challenges, the idea with the biggest consensus that has raised is the following: Developing a focused group with those Test Contributors looking to gather and share knowledge, a group open to anyone to join at anytime without seniority restrictions. This initiative is made to develop a way to fill that gap: Networking comes first, and Seniority comes next.
Vision & Mission
The vision of this project is to provide such a degree of quality that any committer could be so confident that the code has gone through enough quality checks that it could be ultimately merged blindly and fearlessly.
And the mission will be to guide contributors making concentrated efforts to build specialized talent and encourage networking with the rest of the team to polish their results over time.
Tackling the Hindrances: A Workflow Overview
Looking at the current simplified but flawed workflow:
Both Report Triaging (Bug Reproduction Report) and Patch Testing (Patch Testing Report) are the areas where historically the Test Team has been doing main efforts. But we have identified two main problems with this:
The triaging challenge
Reviewing and triaging a new ticket could feel the easiest task in this world: checking if what the user reports is happening and confirming in case all seems good.
However, this simplicity can lead to overlooking more in-depth issues or missing important details that might be relevant to the whole component.
For example, not being able to recognize if the ticket poses a real problem or if this is what’s expected for many reasons (like supporting backwards compatibility expectations).
Confirming that the issue is there, and tagging it subsequently as it Needs a Patch without enough perspective, is always leading to another contributor to take it blindly, and then making a patch on a report that is probably going to end being ditched for multiple reasons we did not consider. Without a top-level triage, we are wasting the efforts of contributors unnecessarily.
The testing dilemma
Most of the reasons were already explained here. But summarizing a bit, the main issue here is that most of the patches are not valid on a first attempt because the code provided could not be attending to similar concerns as stated in the triaging part: It could cause a backwards compatibility troubles or even a potential regression, code could be too repetitive, or too verbose, it could be poorly optimized, missing coding standards and further checks etc.
So testing these weak patches, without a code review, could be valid but not ideal and definitely insufficient for further progressing on a ticket. Testing should be done in a very late-stage and just like the last check that everything is perfectly in order, ready to commit.
Not only to mention that a lack of Unit Tests is one of the main elements that leads to a lower Quality Score (according to the Quality Report). No Playwright tests have been submitted in months, and most of the PHPPHPPHP (recursive acronym for PHP: Hypertext Preprocessor) is a widely-used open source general-purpose scripting language that is especially suited for web development and can be embedded into HTML. https://www.php.net/manual/en/preface.php. code commits don’t even have enough Test Coverage.
First Proposal
The proposal that has brought more attention to achieve a new level of Quality to the organization has been the idea of having contributors specializing in one single area or component within WordPress or GutenbergGutenbergThe Gutenberg project is the new Editor Interface for WordPress. The editor improves the process and experience of creating new content, making writing rich content much simpler. It uses ‘blocks’ to add richness rather than shortcodes, custom HTML etc. https://wordpress.org/gutenberg/.
This approach aims to deepen expertise, improve efficiency, and enhance the overall quality of contributions within specific domains.
For example, contributors focusing exclusively on the Media component to identify and resolve issues more effectively, gaining knowledge, knowing their real limitations, and becoming an expert voice being able to discuss on the same level as any other more experienced generalist contributor.
Moreover, being able to achieve such a degree of knowledge could enable fluid and informal conversations with other members of the group when conflicts arise among different parts of the whole system and also, while a contributor’s self-confidence gets significantly boosted through the process more polished ideas will probably arise in the future.
Structure & Organization
The intention is to organize this group in a flat leadership structure, ensuring maximum autonomy and collaboration among the members. The mentorship figure could always be present, but the target is that each member becomes their mentor in his area to provide help on such and instruct and maybe introduce future generations.
Which are the Steps to Join and Participate?
Choose a Component in Core could you be willing to start with. Note: You can pick an area you are interested in to dive deeper, or a component you have successfully contributed to already. In the Gutenberg, we have still not decided any component subdivision because there are too many Blocks & Features (92 in total) so we might need a little more time to put more thought on how to regroup them to be more affordable and logical. But if Gutenberg is your way, and you want to put some effort into it as soon as possible, just open a new conversation and will start looking at it with thoughtfulness. Also, don’t be too mindful of the selection: there is no perfect component for you, and ideally choosing one that doesn’t overlap with another contributor is preferable than overthinking this.
Once you have selected a Component (or at least you are undecided with a handful of them), join the group on our weekly onboarding sessions (First session 25th of July @ 1PM GMT, and from there, every Thursday @ 1PM GMT, 3PM CET, 6.30 IST), or directly PMing any of the current members of the group.
As soon as we agree on where you are going to start, any current member will help you to get started and progress, to make your journey as comfortable and fun as possible.
Provide the feedback and share your experience with the group.
What to expect
Nothing here is written in stone. We will be adapting to everyone and to what actually works best. We will be in a learning process for long, and maybe, in 5 or 6 months, we might start to see the initial results when the group members start to reach that level we are talking about here. Mastering the whole WordPress codebase is an almost impossible task, but mastering on a full focus is very affordable, and we definitely have big expectations for all of you.
You must be logged in to post a comment.