Page MenuHomePhabricator

Scale updated logged-out edit warning on mobile to all wikis
Open, HighPublic2 Estimated Story Points

Description

Following a successful experiment on mobile web, we will scale the improved logged-out edit warning message to all Wikimedia wikis. The updated experience more clearly and positively encourages account creation while maintaining access to temporary account editing.

After just over one month of experimentation (since March 17, 2026), results show a statistically significant increase in account creation (p = 0.038), with a 27% relative lift among users exposed to the updated warning. This shift is accompanied by a 16% relative decrease in temporary account creation (a decrease is expected). Downstream contributor metrics were also monitored in this experiment, but there was no significant impact on constructive edit rates or other metrics monitored.

User Story

As a logged-out user attempting to edit on mobile, I want to be guided toward account creation through a clear, supportive, and approachable message so that I understand the benefits and feel confident getting started.

User Problem

The current logged-out edit warning on mobile can feel abrupt and overly technical, emphasizing editing without an account rather than encouraging account creation. This framing may discourage participation or lead users toward temporary accounts without understanding the benefits of registering.

There is an opportunity to improve both tone and visual hierarchy to better support users at this critical entry point, making editing feel more accessible while clearly presenting account creation as the primary path.

Supporting Data

Experiment reached statistical significance (p = 0.038)
+27% relative increase in account creation (treatment vs. control)
−16% relative decrease in temporary account creation
No significant change in constructive edit rates

TreatmentControl
image.png (754×1,624 px, 202 KB)
image.png (750×1,624 px, 257 KB)
Acceptance Criteria:
  • Scaling the updated logged-out warning UI and messaging to all Wikimedia wikis on mobile web
  • All instances of "Sign up" should be changed to "Create account"
NOTE: Release Date: Rollout with release train in first week in June. (Available on most wikis on June 3rd or 4th)

Out of scope: Desktop warning experience (to be evaluated separately)

Event Timeline

KStoller-WMF triaged this task as High priority.
KStoller-WMF moved this task from Inbox to Needs Refinement on the Growth-Team board.

@Sgs - Can you take a look at this task and let me know if there are missing details needed before this can be estimated?

@Trizek-WMF - adding you as the "other assignee" on this task to help manage communications. I assume this should be added to Tech News. And I know we have a more general Diff post in the works. Is any other communication needed for this rollout?

@Sgs - Can you take a look at this task and let me know if there are missing details needed before this can be estimated?

I think the task is clear enough to be estimated. The only thing to be aware is that T421518: Investigate unexpectedly low CTR totals in Logged-Out Warning Message experiment is still in progress, the additional instrumentation is almost ready to be merged but we'd need it to run for some days/week in order to get some data to analyze. That does not mean that we can't start to work on this. Probably the development time of this task is enough for the new instrumentation to run.

KStoller-WMF set the point value for this task to 2.

Change #1288906 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/MobileFrontend@master] [DNM][WIP] Make new anon warning default experience

https://gerrit.wikimedia.org/r/1288906

@Trizek-WMF - let's discuss what communication is needed for this. I assume this should at least get added to tech news, but I know you also have a diff post planned.

Just for double-check, this is the interface that's still showing Sign up instead of Create account:

Screenshot 2026-05-20 at 11.57.03.png (802×1,826 px, 200 KB)

Per requirements in this task I'm going to change it to Create account. Some additional observation in terms of consistency is that the two CTAs Login and Sign up links have the notice mobile-frontend-watchlist-purpose and mobile-frontend-watchlist-signup-action appended as parameter so it will show a gray notice:

Screenshot 2026-05-20 at 12.00.11.png (1,018×1,524 px, 202 KB)

Change #1289906 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/MobileFrontend@master] editor: cleanup useless soft variant from message keys

https://gerrit.wikimedia.org/r/1289906

Change #1289905 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/MobileFrontend@master] CtaDrawer: change sign up translation

https://gerrit.wikimedia.org/r/1289905

@KStoller-WMF @Sgs I have put an entry in tech news. Please check it out, and edit it directly if you need to make any change.

@KStoller-WMF @Sgs I have put an entry in tech news. Please check it out, and edit it directly if you need to make any change.

Thanks! I made some minor updates to copy, and linked to the main project page: https://www.mediawiki.org/wiki/Contributors/Account_Creation_Experiments

@Trizek-WMF and @Sgs - will you double-check: https://meta.wikimedia.org/wiki/Tech/News/2026/22

forgot to report that I checked it

Change #1288906 merged by jenkins-bot:

[mediawiki/extensions/MobileFrontend@master] editor: make redesigned anon warning the default experience

https://gerrit.wikimedia.org/r/1288906

Change #1297129 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/MobileFrontend@wmf/1.47.0-wmf.4] editor: make redesigned anon warning the default experience

https://gerrit.wikimedia.org/r/1297129

Change #1297130 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/MobileFrontend@wmf/1.47.0-wmf.5] editor: make redesigned anon warning the default experience

https://gerrit.wikimedia.org/r/1297130

Change #1297151 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/WikimediaEvents@master] cleanup: remove logged out warning experiment code

https://gerrit.wikimedia.org/r/1297151

Change #1297130 merged by jenkins-bot:

[mediawiki/extensions/MobileFrontend@wmf/1.47.0-wmf.5] editor: make redesigned anon warning the default experience

https://gerrit.wikimedia.org/r/1297130

Mentioned in SAL (#wikimedia-operations) [2026-06-03T14:23:34Z] <sgimeno@deploy1003> Started scap sync-world: Backport for [[gerrit:1297130|editor: make redesigned anon warning the default experience (T424595)]]

Mentioned in SAL (#wikimedia-operations) [2026-06-03T14:25:32Z] <sgimeno@deploy1003> sgimeno: Backport for [[gerrit:1297130|editor: make redesigned anon warning the default experience (T424595)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Mentioned in SAL (#wikimedia-operations) [2026-06-03T14:34:20Z] <sgimeno@deploy1003> Finished scap sync-world: Backport for [[gerrit:1297130|editor: make redesigned anon warning the default experience (T424595)]] (duration: 10m 45s)

Change #1297151 merged by jenkins-bot:

[mediawiki/extensions/WikimediaEvents@master] cleanup: remove logged out warning experiment code

https://gerrit.wikimedia.org/r/1297151

The instrumentation cleanup in WikimediaEvents has already been merged and I have turned off the experiment in test-kitchen's dashboard. The only remaining bit of this task is the consolidation of the language for the call to actions, CtaDrawer: change sign up translation which is waiting to the 18th of June when the Account Creation Reading List CTA experiment finalizes, T420238.

There is probably some instrumentation in https://gitlab.wikimedia.org/repos/product-analytics/test-kitchen/experiment-analytics-configs/ that should probably also be removed in the context of this task, right? See https://wikitech.wikimedia.org/wiki/Test_Kitchen/Conduct_an_experiment#Clean_up for reference.

(We could also create a new (sub-)task for that, but it feels conceptually part of this task.)