See parent
Description
Details
- Other Assignee
- Zabe
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T343131 Commons database is growing way too fast | |||
| Open | Ladsgroup | T398709 FY2025-26 WE 6.4.1: Move links tables of commons to a dedicated cluster | |||
| Resolved | Ladsgroup | T421914 Test links virtual domain split on testcommonswiki |
Event Timeline
Mentioned in SAL (#wikimedia-operations) [2026-03-31T14:51:57Z] <Amir1> creating links tables on x1 for testcommonswiki (T421914)
I missed these tables:
CREATE TABLE /*_*/collation ( collation_id SMALLINT UNSIGNED AUTO_INCREMENT NOT NULL, collation_name VARBINARY(64) NOT NULL, UNIQUE INDEX collation_name (collation_name), PRIMARY KEY(collation_id) ) /*$wgDBTableOptions*/; CREATE TABLE /*_*/globalimagelinks ( gil_wiki VARCHAR(32) NOT NULL, gil_page INT UNSIGNED NOT NULL, gil_to VARCHAR(255) NOT NULL, gil_page_namespace_id INT NOT NULL, gil_page_namespace VARCHAR(255) DEFAULT NULL, gil_page_title VARCHAR(255) DEFAULT NULL, INDEX globalimagelinks_wiki (gil_wiki, gil_page), INDEX globalimagelinks_wiki_nsid_title ( gil_wiki, gil_page_namespace_id, gil_page_title ), PRIMARY KEY(gil_to, gil_wiki, gil_page) ) /*$wgDBTableOptions*/;
Done now
Change #1265451 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):
[operations/mediawiki-config@master] Enable links db split on testcommonswiki
Change #1265451 merged by jenkins-bot:
[operations/mediawiki-config@master] Enable links db split on testcommonswiki
Mentioned in SAL (#wikimedia-operations) [2026-03-31T15:12:47Z] <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1265451|Enable links db split on testcommonswiki (T421914)]]
Mentioned in SAL (#wikimedia-operations) [2026-03-31T15:14:46Z] <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1265451|Enable links db split on testcommonswiki (T421914)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
Mentioned in SAL (#wikimedia-operations) [2026-03-31T15:22:03Z] <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1265451|Enable links db split on testcommonswiki (T421914)]] (duration: 09m 15s)
ladsgroup@deploy1003:~$ sql testcommonswiki Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Welcome to the MariaDB monitor. Commands end with ; or \g. Your MariaDB connection id is 2053439422 Server version: 10.11.14-MariaDB-log MariaDB Server Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. wikiadmin2023@10.64.48.173(testcommonswiki)> select * from redirect; +---------+--------------+-----------------------------+--------------+-------------+ | rd_from | rd_namespace | rd_title | rd_interwiki | rd_fragment | +---------+--------------+-----------------------------+--------------+-------------+ | 420 | 3 | Catherine_Laurence | | | | 691 | 3 | Jeff_G. | | top | | 704 | 3 | ETadros_(WMF) | | | | 924 | 3 | -andreas | | | | 954 | 3 | DutchTina | | | | 989 | 3 | Minorax | | | | 990 | 3 | Telluride | | | | 991 | 3 | Ameisenigel | | | | 1005 | 3 | Catherine_Laurence | | | | 1029 | 3 | YahyA | | | | 1065 | 3 | SouravH5 | | | | 1095 | 3 | পরস | | | | 1104 | 3 | Shawn_à_Montréal | | | | 1115 | 3 | Zoodino | | | | 1126 | 3 | Uncitoyen | | | | 1143 | 3 | Ainz_Ooal_Gown | | | | 1195 | 3 | Kizule | | | | 1223 | 3 | -akko | | | | 1272 | 3 | 3ducat10n_Pr0gr4m | | | | 1333 | 3 | Zabe | | | | 1384 | 3 | MW_Song_Ngư | | | | 1415 | 3 | Computer_Fizz | | | | 1423 | 3 | Sojol_Rana | | | | 1450 | 3 | Flyplanevn27 | | | | 1454 | 3 | Cromium | | | | 1466 | 3 | Crowley666 | | | | 1467 | 3 | AGreatUsernameChoice | | | | 1474 | 3 | Howdy.carabao | | | | 1527 | 3 | Vanished_user_1231123 | | | | 1543 | 3 | AlPaD | | | | 1594 | 3 | Fish_bowl | | | | 1601 | 3 | -Alabama- | | | | 1638 | 3 | Desktop.INI | | | | 1648 | 3 | Meno25 | | | | 1791 | 3 | Ayuta_Tonomura | | | | 1935 | 3 | SunAfterRain | | | | 2043 | 3 | Geistory317 | | | | 2061 | 3 | Chrs | | | | 2077 | 3 | BiolysisBiologist | | | | 2082 | 3 | VulcanSphere | | | | 2087 | 3 | Riverside2997 | | | | 2089 | 3 | Althair | | | | 2112 | 3 | Diskdance | | | | 2125 | 3 | Fkszczot | | | | 2126 | 3 | FKszczot | | | | 2128 | 3 | Taavi | | | | 2143 | 3 | Tulsi | | | | 2231 | 3 | Angayubagia | | | | 2237 | 3 | QTE-Test21-WMF | | | | 2257 | 3 | Tryvix1509 | | | | 2262 | 3 | Tojdor | | | | 2284 | 2 | Valcio/vector.js | | | | 2285 | 3 | Valcio | | | | 2297 | 3 | FreeLoftus137 | | | | 2351 | 3 | Tbm | | | | 2386 | 3 | Antti_T._Leppänen | | | | 2387 | 3 | MarkRosenbaum | | | | 2388 | 3 | Frostly | | | | 2389 | 3 | JrandWP | | | | 2390 | 3 | GrishForce | | | | 2391 | 3 | Saroj | | | | 2392 | 3 | Shiro_D._Neko | | | | 2393 | 3 | Etonkovidova_(WMF) | | | | 2394 | 3 | Hide_on_Rosé | | | | 2395 | 3 | Queen_of_Hearts | | | | 2396 | 3 | Doraemonluonbentoi | | | | 2397 | 3 | Cysquatch | | | | 2398 | 3 | Hide_on_Rose_(test_account) | | | | 2399 | 3 | Song_Ngư | | | | 2400 | 3 | NewUniverse | | | | 2401 | 3 | KonstantinaG07 | | | | 2402 | 3 | Renamed_user_b9gv3t7jw0 | | | | 2403 | 3 | AstroWizard | | | | 2404 | 3 | JacktheBrown | | | | 2405 | 3 | Ludwig20 | | | | 2406 | 3 | Paloi_Sciurala | | | | 2407 | 3 | Mary_Joanna | | | | 2408 | 3 | Nvdtn19 | | | | 2409 | 3 | Effie_Mouzeli_(WMF) | | | | 2410 | 3 | Jinerea | | | | 2413 | 3 | Revi_C. | | | | 2424 | 3 | NovaeSys | | | | 2425 | 3 | Luigi_Nakano | | | | 2426 | 3 | A826 | | | | 2438 | 3 | Redireditor | | | | 2439 | 3 | Veritas_Sapientiae | | | +---------+--------------+-----------------------------+--------------+-------------+ 86 rows in set (0.001 sec) wikiadmin2023@10.64.48.173(testcommonswiki)> Bye ladsgroup@deploy1003:~$ sql testcommonswiki --cluster extension1 Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Welcome to the MariaDB monitor. Commands end with ; or \g. Your MariaDB connection id is 684814677 Server version: 10.11.13-MariaDB-log MariaDB Server Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. wikiadmin2023@10.64.32.36(testcommonswiki)> select * from redirect; +---------+--------------+-----------------------------+--------------+-------------+ | rd_from | rd_namespace | rd_title | rd_interwiki | rd_fragment | +---------+--------------+-----------------------------+--------------+-------------+ | 420 | 3 | Catherine_Laurence | | | | 691 | 3 | Jeff_G. | | top | | 704 | 3 | ETadros_(WMF) | | | | 924 | 3 | -andreas | | | | 954 | 3 | DutchTina | | | | 989 | 3 | Minorax | | | | 990 | 3 | Telluride | | | | 991 | 3 | Ameisenigel | | | | 1005 | 3 | Catherine_Laurence | | | | 1029 | 3 | YahyA | | | | 1065 | 3 | SouravH5 | | | | 1095 | 3 | পরস | | | | 1104 | 3 | Shawn_à_Montréal | | | | 1115 | 3 | Zoodino | | | | 1126 | 3 | Uncitoyen | | | | 1143 | 3 | Ainz_Ooal_Gown | | | | 1195 | 3 | Kizule | | | | 1223 | 3 | -akko | | | | 1272 | 3 | 3ducat10n_Pr0gr4m | | | | 1333 | 3 | Zabe | | | | 1384 | 3 | MW_Song_Ngư | | | | 1415 | 3 | Computer_Fizz | | | | 1423 | 3 | Sojol_Rana | | | | 1450 | 3 | Flyplanevn27 | | | | 1454 | 3 | Cromium | | | | 1466 | 3 | Crowley666 | | | | 1467 | 3 | AGreatUsernameChoice | | | | 1474 | 3 | Howdy.carabao | | | | 1527 | 3 | Vanished_user_1231123 | | | | 1543 | 3 | AlPaD | | | | 1594 | 3 | Fish_bowl | | | | 1601 | 3 | -Alabama- | | | | 1638 | 3 | Desktop.INI | | | | 1648 | 3 | Meno25 | | | | 1791 | 3 | Ayuta_Tonomura | | | | 1935 | 3 | SunAfterRain | | | | 2043 | 3 | Geistory317 | | | | 2061 | 3 | Chrs | | | | 2077 | 3 | BiolysisBiologist | | | | 2082 | 3 | VulcanSphere | | | | 2087 | 3 | Riverside2997 | | | | 2089 | 3 | Althair | | | | 2112 | 3 | Diskdance | | | | 2125 | 3 | Fkszczot | | | | 2126 | 3 | FKszczot | | | | 2128 | 3 | Taavi | | | | 2143 | 3 | Tulsi | | | | 2231 | 3 | Angayubagia | | | | 2237 | 3 | QTE-Test21-WMF | | | | 2257 | 3 | Tryvix1509 | | | | 2262 | 3 | Tojdor | | | | 2284 | 2 | Valcio/vector.js | | | | 2285 | 3 | Valcio | | | | 2297 | 3 | FreeLoftus137 | | | | 2351 | 3 | Tbm | | | | 2386 | 3 | Antti_T._Leppänen | | | | 2387 | 3 | MarkRosenbaum | | | | 2388 | 3 | Frostly | | | | 2389 | 3 | JrandWP | | | | 2390 | 3 | GrishForce | | | | 2391 | 3 | Saroj | | | | 2392 | 3 | Shiro_D._Neko | | | | 2393 | 3 | Etonkovidova_(WMF) | | | | 2394 | 3 | Hide_on_Rosé | | | | 2395 | 3 | Queen_of_Hearts | | | | 2396 | 3 | Doraemonluonbentoi | | | | 2397 | 3 | Cysquatch | | | | 2398 | 3 | Hide_on_Rose_(test_account) | | | | 2399 | 3 | Song_Ngư | | | | 2400 | 3 | NewUniverse | | | | 2401 | 3 | KonstantinaG07 | | | | 2402 | 3 | Renamed_user_b9gv3t7jw0 | | | | 2403 | 3 | AstroWizard | | | | 2404 | 3 | JacktheBrown | | | | 2405 | 3 | Ludwig20 | | | | 2406 | 3 | Paloi_Sciurala | | | | 2407 | 3 | Mary_Joanna | | | | 2408 | 3 | Nvdtn19 | | | | 2409 | 3 | Effie_Mouzeli_(WMF) | | | | 2410 | 3 | Jinerea | | | | 2413 | 3 | Revi_C. | | | | 2424 | 3 | NovaeSys | | | | 2425 | 3 | Luigi_Nakano | | | | 2426 | 3 | A826 | | | | 2438 | 3 | Redireditor | | | | 2439 | 3 | Veritas_Sapientiae | | | +---------+--------------+-----------------------------+--------------+-------------+ 86 rows in set (0.001 sec)
Nice
I intentionally deleted a row and corrupted another. Both got fixed with the run of the script.
page_touched on extension1 got updated which means the deferred update works as expected \o/:
wikiadmin2023@10.64.16.6(testcommonswiki)> select * from page where page_id = 342; +---------+----------------+------------+------------------+-------------+---------------+----------------+--------------------+-------------+----------+--------------------+-----------+ | page_id | page_namespace | page_title | page_is_redirect | page_is_new | page_random | page_touched | page_links_updated | page_latest | page_len | page_content_model | page_lang | +---------+----------------+------------+------------------+-------------+---------------+----------------+--------------------+-------------+----------+--------------------+-----------+ | 342 | 1 | Main_Page | 0 | 0 | 0.78694462389 | 20260331153831 | 20260331153831 | 5032 | 2083 | wikitext | NULL | +---------+----------------+------------+------------------+-------------+---------------+----------------+--------------------+-------------+----------+--------------------+-----------+ 1 row in set (0.001 sec)
extlinks works since it's not connected to linktarget store
wikiadmin2023@10.64.48.161(testcommonswiki)> select * from externallinks; +-------+---------+------------------------------+----------------------+ | el_id | el_from | el_to_domain_index | el_to_path | +-------+---------+------------------------------+----------------------+ | 1 | 974 | https://com.google.calendar. | /calendar/u/1/r/week | +-------+---------+------------------------------+----------------------+ 1 row in set (0.001 sec)
Change #1265503 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):
[mediawiki/core@master] LinksUpdate: Consolidate links virtual domains
Change #1265503 merged by jenkins-bot:
[mediawiki/core@master] LinksUpdate: Consolidate links virtual domains
Change #1265623 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):
[mediawiki/core@wmf/1.46.0-wmf.21] LinksUpdate: Consolidate links virtual domains
Change #1265624 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):
[mediawiki/core@wmf/1.46.0-wmf.22] LinksUpdate: Consolidate links virtual domains
Change #1265623 merged by jenkins-bot:
[mediawiki/core@wmf/1.46.0-wmf.21] LinksUpdate: Consolidate links virtual domains
Change #1265624 merged by jenkins-bot:
[mediawiki/core@wmf/1.46.0-wmf.22] LinksUpdate: Consolidate links virtual domains
Mentioned in SAL (#wikimedia-operations) [2026-04-01T00:00:57Z] <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1265623|LinksUpdate: Consolidate links virtual domains (T421914)]], [[gerrit:1265624|LinksUpdate: Consolidate links virtual domains (T421914)]]
Mentioned in SAL (#wikimedia-operations) [2026-04-01T00:03:02Z] <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1265623|LinksUpdate: Consolidate links virtual domains (T421914)]], [[gerrit:1265624|LinksUpdate: Consolidate links virtual domains (T421914)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
Mentioned in SAL (#wikimedia-operations) [2026-04-01T00:07:47Z] <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1265623|LinksUpdate: Consolidate links virtual domains (T421914)]], [[gerrit:1265624|LinksUpdate: Consolidate links virtual domains (T421914)]] (duration: 06m 50s)
It didn't fix this issue. I'm sure it helped but we probably have an issue somewhere else.
Checking verbose mode says that it's still looking up the rows in s4 (db1243 is in s4): https://logstash.wikimedia.org/app/discover#/doc/logstash-*/logstash-mediawiki-1-7.0.0-1-2026.04.01?id=4ig3Sp0BZNKAUxWEb-aa Computers were a mistake.
Change #1266343 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):
[mediawiki/core@master] Deferred: Fix function to get virtual domain
Change #1266343 merged by jenkins-bot:
[mediawiki/core@master] Deferred: Fix function to get virtual domain
Change #1266442 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):
[mediawiki/core@wmf/1.46.0-wmf.21] Deferred: Fix function to get virtual domain
Change #1266443 had a related patch set uploaded (by Ladsgroup; author: Ladsgroup):
[mediawiki/core@wmf/1.46.0-wmf.22] Deferred: Fix function to get virtual domain
Change #1266442 merged by jenkins-bot:
[mediawiki/core@wmf/1.46.0-wmf.21] Deferred: Fix function to get virtual domain
Change #1266443 merged by jenkins-bot:
[mediawiki/core@wmf/1.46.0-wmf.22] Deferred: Fix function to get virtual domain
Mentioned in SAL (#wikimedia-operations) [2026-04-01T22:27:32Z] <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1266443|Deferred: Fix function to get virtual domain (T421914 T398709)]], [[gerrit:1266442|Deferred: Fix function to get virtual domain (T421914 T398709)]]
Mentioned in SAL (#wikimedia-operations) [2026-04-01T22:29:29Z] <ladsgroup@deploy1003> ladsgroup: Backport for [[gerrit:1266443|Deferred: Fix function to get virtual domain (T421914 T398709)]], [[gerrit:1266442|Deferred: Fix function to get virtual domain (T421914 T398709)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
Mentioned in SAL (#wikimedia-operations) [2026-04-01T22:34:08Z] <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1266443|Deferred: Fix function to get virtual domain (T421914 T398709)]], [[gerrit:1266442|Deferred: Fix function to get virtual domain (T421914 T398709)]] (duration: 06m 37s)
Disabled QueryPage updates for Special:Unusedtemplates since it caused issues (T422062).
Thanks. Are you now ready for us to drop the links tables from core db of testcommonswiki? I think it'll break a couple more of these special pages :D
There are a few special pages which we need to move to hadoop for commons and should just disable for this test on testcommons, will do that.
There are a few other places that also still need treatment and would probably explode iirc. Let me do that this week.
Change #1269720 had a related patch set uploaded (by Zabe; author: Zabe):
[operations/mediawiki-config@master] Disable query pages on testcommonswiki not compatible with split
Change #1269720 merged by jenkins-bot:
[operations/mediawiki-config@master] Disable query pages on testcommonswiki not compatible with split
Mentioned in SAL (#wikimedia-operations) [2026-04-10T00:00:41Z] <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1269720|Disable query pages on testcommonswiki not compatible with split (T421914)]]
Mentioned in SAL (#wikimedia-operations) [2026-04-10T00:02:25Z] <zabe@deploy1003> zabe: Backport for [[gerrit:1269720|Disable query pages on testcommonswiki not compatible with split (T421914)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
Mentioned in SAL (#wikimedia-operations) [2026-04-10T00:07:58Z] <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1269720|Disable query pages on testcommonswiki not compatible with split (T421914)]] (duration: 07m 17s)
Change #1269744 had a related patch set uploaded (by Zabe; author: Zabe):
[operations/mediawiki-config@master] Stop setting specific virtual domain for link tables
Change #1269744 merged by jenkins-bot:
[operations/mediawiki-config@master] Stop setting specific virtual domain for link tables
Mentioned in SAL (#wikimedia-operations) [2026-04-10T00:48:33Z] <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1269744|Stop setting specific virtual domain for link tables (T421914)]]
Mentioned in SAL (#wikimedia-operations) [2026-04-10T00:50:20Z] <zabe@deploy1003> zabe: Backport for [[gerrit:1269744|Stop setting specific virtual domain for link tables (T421914)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
Mentioned in SAL (#wikimedia-operations) [2026-04-10T00:54:24Z] <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1269744|Stop setting specific virtual domain for link tables (T421914)]] (duration: 05m 51s)
Change #1269758 had a related patch set uploaded (by Zabe; author: Zabe):
[operations/mediawiki-config@master] Set $wgGlobalUsageSharedRepoWiki for testcommonswiki
Change #1269759 had a related patch set uploaded (by Zabe; author: Zabe):
[operations/mediawiki-config@master] Also disable updates for GloballyWantedFiles on testcommonswiki
Mentioned in SAL (#wikimedia-operations) [2026-04-13T17:33:12Z] <Amir1> dropping templatelinks and pagelinks on testcommonswiki core db (T421914)
Mentioned in SAL (#wikimedia-operations) [2026-04-14T13:23:28Z] <Amir1> on testcommonswiki drop table if exists categorylinks; drop table if exists externallinks; drop table if exists linktarget; drop table if exists collation; drop table if exists imagelinks; drop table if exists iwlinks; drop table if exists existencelinks; (T421914)
Change #1269758 merged by jenkins-bot:
[operations/mediawiki-config@master] Set $wgGlobalUsageSharedRepoWiki for testcommonswiki
Change #1269759 merged by jenkins-bot:
[operations/mediawiki-config@master] Also disable updates for GloballyWantedFiles on testcommonswiki
Mentioned in SAL (#wikimedia-operations) [2026-04-16T19:41:35Z] <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1269758|Set $wgGlobalUsageSharedRepoWiki for testcommonswiki (T421914)]], [[gerrit:1269759|Also disable updates for GloballyWantedFiles on testcommonswiki (T421914)]]
Mentioned in SAL (#wikimedia-operations) [2026-04-16T19:43:14Z] <zabe@deploy1003> zabe: Backport for [[gerrit:1269758|Set $wgGlobalUsageSharedRepoWiki for testcommonswiki (T421914)]], [[gerrit:1269759|Also disable updates for GloballyWantedFiles on testcommonswiki (T421914)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.
Mentioned in SAL (#wikimedia-operations) [2026-04-16T19:48:23Z] <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1269758|Set $wgGlobalUsageSharedRepoWiki for testcommonswiki (T421914)]], [[gerrit:1269759|Also disable updates for GloballyWantedFiles on testcommonswiki (T421914)]] (duration: 06m 48s)
Mentioned in SAL (#wikimedia-operations) [2026-04-20T18:11:30Z] <Amir1> drop of langlinks table on testcommonswiki (T421914)