Page MenuHomePhabricator

Prepare V2 experiment for improved mobile account creation form (builds on V1)
Open, HighPublic3 Estimated Story Points

Description

Prepare the V2 A/B experiment for the improved mobile account creation form, building on the existing V1 experience.

Background:

The V1 experiment for improving the mobile account creation form has shown positive results, with increased account creation. To maintain momentum and accelerate learning, we will proceed directly to a V2 experiment that builds on V1 improvements.

Instead of pausing to merge V1 into core and deploy it globally, V2 will incorporate those changes and introduce additional enhancements. This approach allows us to iterate more quickly while continuing to validate impact through experimentation.

User stories:

As a mobile web user, I want a cleaner and less verbose account creation form so that I can view all required fields at a glance without scrolling and complete registration with less friction.

As a mobile web user, I want simple and clear guidance when creating a username so that I am more likely to follow the username policy.

Proposed approach:

Rationale for approach:

  • Avoids delay from communication & scaling V1
  • Allows us to build upon and improve from what we learned in V1 (reduce the impact of the decrease in username policy CTR)

The downside of this approach is that if we find that the V2 version is NOT leading in a positive change in account creation rates, then we will need to revert back to V1 and scale that work instead.

Acceptance criteria:

Event Timeline

KStoller-WMF triaged this task as High priority.
KStoller-WMF moved this task from Inbox to Needs Refinement on the Growth-Team board.
KStoller-WMF added a subscriber: Etonkovidova.

@Etonkovidova - adding you to this task as an "other assignee" as Michael and I think this work will require some extra testing and QA awareness. (Nothing to do yet, but next sprint this task will be a top priority for the Growth team).

Change #1286930 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/WikimediaEvents@master] Support NCS-experiments for Account Creation

https://gerrit.wikimedia.org/r/1286930

Change #1289344 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/GrowthExperiments@master] feat(V2): support both url-param based and cookie based enrollment

https://gerrit.wikimedia.org/r/1289344

KStoller-WMF set the point value for this task to 3.

Change #1290797 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/core@master] signup.js: use JS var instead of TestKitchen to show experiment

https://gerrit.wikimedia.org/r/1290797

Change #1290798 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/GrowthExperiments@master] ConfirmEmailHooks: add a JS var for the account creation V2 experiment

https://gerrit.wikimedia.org/r/1290798

Change #1290799 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/WikimediaEvents@master] specialCreateAccount: use GECreateAccountExperimentV2 instead of hook

https://gerrit.wikimedia.org/r/1290799

Change #1292894 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/WikimediaEvents@master] Add experiment params to links for Account Creation

https://gerrit.wikimedia.org/r/1292894

Change #1292895 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/WikimediaEvents@master] CreateAccount: adjust instrumentation for V2 and URL-enrollment

https://gerrit.wikimedia.org/r/1292895

Change #1292897 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/GrowthExperiments@master] feat: preserve experiments URL parameter

https://gerrit.wikimedia.org/r/1292897

The associated changes are now largely up for review.

Change #1289344 abandoned by Michael Große:

[mediawiki/extensions/GrowthExperiments@master] feat(V2): support both url-param based and cookie based enrollment

Reason:

The changes from this patch should be squashed into the parent Id1c5f16bbe8b43f6cd2bc6ba275cad9dbe9cc599 as needed.

https://gerrit.wikimedia.org/r/1289344

Change #1292897 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat: preserve experiments URL parameter

https://gerrit.wikimedia.org/r/1292897

Change #1292894 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] Add experiment params to links for Account Creation

https://gerrit.wikimedia.org/r/1292894

Change #1286930 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] testKitchen: Add UrlEnrolledExperiment

https://gerrit.wikimedia.org/r/1286930

Change #1292895 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] CreateAccount: adjust instrumentation for V2 and URL-enrollment

https://gerrit.wikimedia.org/r/1292895

Change #1290798 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] feat(V2): toggle experiment features based on custom url override

https://gerrit.wikimedia.org/r/1290798

Change #1290797 merged by jenkins-bot:

[mediawiki/core@master] signup.js: use JS var instead of TestKitchen to show experiment

https://gerrit.wikimedia.org/r/1290797

Change #1290799 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] specialCreateAccount: use GECreateAccountExperimentV2 instead of hook

https://gerrit.wikimedia.org/r/1290799

This is now testable in Beta cluster, it is particularly tricky to test end-to-end because of the lack of entry-point links to the Create account page on mobile/Minerva.

A way of testing it is via the logged out warning create account CTA. The initial url for the tester must contain TestKitchen's mpo=we-1-8-account-creation-form-v2:treatment param, this URL should work straight forward: https://en.wikipedia.beta.wmcloud.org/w/index.php?title=Special:Random&mpo=we-1-8-account-creation-form-v2:treatment&mobileaction=toggle_view_mobile#/editor/all. The resulting Create account button-link should/will include the parameter experiments=we-1-8-account-creation-form-v2:treatment:overridden, including the overriden string which is used for not capturing traffic coming from QA. Clicking on that annotated link should take the user to the create account screen with all the features included in the task description.

Requirements to meet for the experiment treatment experience to kick in:

  • Wiki is enwiki
  • User is anon
  • Skin is minerva
  • Initial URL has mpo param with we-1-8-account-creation-form-v2:treatment

(Hopefully the URL above should meet all criteria in non-logged in browser)

Change #1297697 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/GrowthExperiments@master] GrowthExperiments: one-off warn shouldShowCreateAccountV2 inputs

https://gerrit.wikimedia.org/r/1297697

Change #1297697 abandoned by Sergio Gimeno:

[mediawiki/extensions/GrowthExperiments@master] GrowthExperiments: one-off warn shouldShowCreateAccountV2 inputs

Reason:

The unexpected results were due to beta being out of sync, not needed

https://gerrit.wikimedia.org/r/1297697

Change #1298758 had a related patch set uploaded (by Michael Große; author: Michael Große):

[mediawiki/extensions/GrowthExperiments@wmf/1.47.0-wmf.5] feat(V2): toggle experiment features based on custom url override

https://gerrit.wikimedia.org/r/1298758

Change #1298762 had a related patch set uploaded (by Michael Große; author: Sergio Gimeno):

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.5] specialCreateAccount: use GECreateAccountExperimentV2 instead of hook

https://gerrit.wikimedia.org/r/1298762

Change #1298765 had a related patch set uploaded (by Michael Große; author: Sergio Gimeno):

[mediawiki/core@wmf/1.47.0-wmf.5] signup.js: use JS var instead of TestKitchen to show experiment

https://gerrit.wikimedia.org/r/1298765

Change #1298758 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@wmf/1.47.0-wmf.5] feat(V2): toggle experiment features based on custom url override

https://gerrit.wikimedia.org/r/1298758

Change #1298762 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@wmf/1.47.0-wmf.5] specialCreateAccount: use GECreateAccountExperimentV2 instead of hook

https://gerrit.wikimedia.org/r/1298762

Change #1298765 merged by jenkins-bot:

[mediawiki/core@wmf/1.47.0-wmf.5] signup.js: use JS var instead of TestKitchen to show experiment

https://gerrit.wikimedia.org/r/1298765

Mentioned in SAL (#wikimedia-operations) [2026-06-08T13:29:02Z] <lucaswerkmeister-wmde@deploy1003> Started scap sync-world: Backport for [[gerrit:1298758|feat(V2): toggle experiment features based on custom url override (T424646)]], [[gerrit:1298762|specialCreateAccount: use GECreateAccountExperimentV2 instead of hook (T424646)]], [[gerrit:1298764|fix: correctly read experiments param on Special:UserLogin]], [[gerrit:1298765|signup.js: use JS var instead of TestKitchen to show expe

Mentioned in SAL (#wikimedia-operations) [2026-06-08T13:30:47Z] <lucaswerkmeister-wmde@deploy1003> migr, lucaswerkmeister-wmde: Backport for [[gerrit:1298758|feat(V2): toggle experiment features based on custom url override (T424646)]], [[gerrit:1298762|specialCreateAccount: use GECreateAccountExperimentV2 instead of hook (T424646)]], [[gerrit:1298764|fix: correctly read experiments param on Special:UserLogin]], [[gerrit:1298765|signup.js: use JS var instead of TestKitchen to show

Mentioned in SAL (#wikimedia-operations) [2026-06-08T13:38:27Z] <lucaswerkmeister-wmde@deploy1003> Finished scap sync-world: Backport for [[gerrit:1298758|feat(V2): toggle experiment features based on custom url override (T424646)]], [[gerrit:1298762|specialCreateAccount: use GECreateAccountExperimentV2 instead of hook (T424646)]], [[gerrit:1298764|fix: correctly read experiments param on Special:UserLogin]], [[gerrit:1298765|signup.js: use JS var instead of TestKitchen to show exp

This is now testable in Beta cluster, it is particularly tricky to test end-to-end because of the lack of entry-point links to the Create account page on mobile/Minerva.

A way of testing it is via the logged out warning create account CTA. The initial url for the tester must contain TestKitchen's mpo=we-1-8-account-creation-form-v2:treatment param, this URL should work straight forward: https://en.wikipedia.beta.wmcloud.org/w/index.php?title=Special:Random&mpo=we-1-8-account-creation-form-v2:treatment&mobileaction=toggle_view_mobile#/editor/all. The resulting Create account button-link should/will include the parameter experiments=we-1-8-account-creation-form-v2:treatment:overridden, including the overriden string which is used for not capturing traffic coming from QA. Clicking on that annotated link should take the user to the create account screen with all the features included in the task description.

Requirements to meet for the experiment treatment experience to kick in:

  • Wiki is enwiki
  • User is anon
  • Skin is minerva
  • Initial URL has mpo param with we-1-8-account-creation-form-v2:treatment

(Hopefully the URL above should meet all criteria in non-logged in browser)

Checked - works as expected.