Support Forum Progress Report

I began backfilling all valid closed support forumSupport Forum WordPress Support Forums is a place to go for help and conversations around using WordPress. Also the place to go to report issues that are caused by errors with the WordPress code and implementations. topics and replies last Thursday. The current rate of about 500 topics/minute includes all topic tags, replies, and subscription information and discards spam and deleted topics. I’ve outlined the upgrade path with a tentative timeline for this week below.

Pre-maintenance window (this week):

  • Import all valid topics and replies from more than a year ago. Topics are considered valid if they are public, not a pluginPlugin A plugin is a piece of software containing a group of functions that can be added to a WordPress website. They can extend functionality or add new features to your WordPress websites. WordPress plugins are written in the PHP programming language and integrate seamlessly with WordPress. These can be free in the Plugin Directory or can be cost-based plugin from a third-party or theme review (more on that later), and are not spam or trashTrash Trash in WordPress is like the Recycle Bin on your PC or Trash in your Macintosh computer. Users with the proper permission level (administrators and editors) have the ability to delete a post, page, and/or comments. When you delete the item, it is moved to the trash folder where it will remain for 30 days.. These are all topics that are closed and have no activity. I’m currently at offset 2,197,000 of 2,400,000 of the desired topic set. (@jmdodd)
  • Post a small notification message regarding the maintenance window once it is scheduled at the top of all pages in the support forum. (@jmdodd)

Switch over forum registration to be handled on The community site where WordPress code is created and shared by the users. This is where you can download the source code for WordPress core, plugins and themes as well as the central location for community conversations and organization. This will be done after the forum upgrade; “one catastrophe at a time”.

  • Change “topic closed” plugin date to two months rather than one year. Any topics older than two months will be considered closed in bbPressbbPress Free, open source software built on top of WordPress for easily creating forums on sites. 1. This allows us to import much more of the existing database rather than relying on the maintenance window for all of the import. These topics will still be open once we switch over to bbPress 2. (@jmdodd)
  • Import the last ten months of topics from offset 2,400,000 to a set topic ID outside of the two month window. (@jmdodd)

Maintenance window (about 6 hours, very tentatively set for Friday, 26 August 2016):

  • Close the bbPress 1 forums. They will still be searchable, and users can browse them, but they will not be available for posting new topics or replies. (@jmdodd)
  • Run the import for valid topics and replies from the last two months. Do not include reviews. (@jmdodd)
  • Testing shakedown pre-nginxNGINX NGINX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. It started out as a web server designed for maximum performance and stability. In addition to its HTTP server capabilities, NGINX can also function as a proxy server for email (IMAP, POP3, and SMTP) and a reverse proxy and load balancer for HTTP, TCP, and UDP servers.; make sure that registration/login/posting/etc. are all functional. (@jmdodd)
  • Update the forum site URLURL A specific web address of a website or web page on the Internet, such as a website’s URL (@jmdodd)
  • DeployDeploy Launching code from a local development environment to the production web server, so that it's available to visitors. nginx rewrites for the support forums only. Rosetta forums still need nginx rewrites, but in the interests of restoring access to the support forum and not complicating the maintenance window, those can be done in a separate action. (@jmdodd)
  • Testing shakedown post-nginx; make sure that registration/login/posting/etc. are all functional. (@jmdodd)
  • Open all bbPress 2 forums except for reviews. (@jmdodd)

Post-maintenance window (at least 12 hours, hopefully on Saturday, 27 August 2016):

  • User role backfill for any users that are not the default bbPress user role. (@jmdodd)
  • Import all 300k reviews into bbPress 2. Reviews are editable by the poster and involve an external table that holds the actual rating data; the external table will need to be scanned and matched with the new post id of the imported topic. Reviews are also far more dense than normal topics; we gain some efficiency because most reviews have no replies, but no reviews will be discarded. The plugin and theme directories rely on the review data for their current designs; their queries will continue to work from stale pre-maintenance-window data until they are updated to use the new bbPress 2 tables. Doing the review import after the main switchover will allow us to deploy query updates against the plugin and theme directory code as well as the support forum to avoid errors, and reduce the time of the maintenance window from needing to import 360k topics to only needing to guarantee import of about 60k topics. (@jmdodd)
  • Import user favorites and topic, topic tag, and plugin subscriptions. Users will potentially miss some subscription emails during this period, but this should not be updated until all topics are available in the new tables. Plugin subscriptions will be the last data retrieved from the old bbPress 1 tables, as they are unrelated to any topics and will need to be crawled separately on a term-by-term basis. (@jmdodd)