Update of the Manual Testing Strategy documentation page

Development
,
1

Hi!

Following the discussion from When to drop the previous LTS branches when a new Cycle LTS is released? , I would like to propose updating the Manual Testing Strategy documentation page with the following:

  1. Remove the Release Candidate Releases section, since in practice we lack the time to test them;

  2. Update the LTS Releases section to introduce the “Cycle LTS” and “Intermediate LTS” concepts:

    “According to the release strategy, an LTS version is released at the end of the cycle (a.k.a. Cycle LTS) and another LTS (a.k.a. Intermediate LTS) around the middle of the cycle.

    From testing point of view, these are special stable releases and should be tested more in-depth. The time-box indicated for these releases is 3 weeks/person.”

  3. Update the Test planning and priorities section with the following:

    “In order to systematize the process of manual testing and to make sure the time is allocated properly, the following guidelines must be taken into consideration:

    • the manual testing for LTS must start as soon as N.4.0 and N.10.0 are released, i.e. if tests are underway on some other versions of XWiki, then they are paused until all the priority testing is finished (or finish them if there’s only 1 or 2 more days needed);
    • priorities should be as follows: first current Cycle LTS branch release (i.e. N.10.0) > current Cycle LTS branch bugfixes (i.e. N.10.x, x > 0) > previous Cycle LTS bugfixes (e.g. N-10.10.x, x > 0) > first Intermediate LTS branch release (i.e. N.4.0) > Intermediate LTS branch bugfixes (i.e. N.4.x, x > 0) > Stable bugfix releases (i.e. N.x.y, x != 4, x != 10 and y > 0) > Stable releases (i.e. N.x.0, x != 4 and x != 10) > Extension releases.

    Also, the tests are categorized in a list of testing priorities corresponding to their importance.

    […]”

  4. Remove the mentions about recommended extensions from Test planning and priorities along with the lists of tests: P1.Extensions, P2.Extension and P3.Extensions and adding the following note at the end:

    “NOTE: The quality of the extensions is validated by the extensions supporters."

What do you think?

Thanks!

2

LGTM, thanks!

Please mention “Contrib Extensions” as otherwise it’s a bit misleading (since XS also has extensions but those are supported by the XWiki Core Dev Team).

Thanks

3

Updated the Manual Testing Strategy page.

Thanks!