[MediaWiki-commits] [Gerrit] operations/puppet[production]: sanitarium2.my.cnf: Disable parallel replication
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/323145 Change subject: sanitarium2.my.cnf: Disable parallel replication .. sanitarium2.my.cnf: Disable parallel replication By default do not use parallel replication on the new sanitarium host. Change-Id: I93898b9afda86a3e942c03712e0f682dfe367798 --- M templates/mariadb/sanitarium2.my.cnf.erb 1 file changed, 2 insertions(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/45/323145/1 diff --git a/templates/mariadb/sanitarium2.my.cnf.erb b/templates/mariadb/sanitarium2.my.cnf.erb index fafceeb..b2d56eb 100644 --- a/templates/mariadb/sanitarium2.my.cnf.erb +++ b/templates/mariadb/sanitarium2.my.cnf.erb @@ -42,7 +42,8 @@ transaction-isolation = REPEATABLE-READ log-bin slave_transaction_retries = 4294967295 -slave_parallel_threads = 2 +slave_parallel_mode= none +slave_parallel_threads = 0 slave_parallel_max_queued = 16M binlog-format = ROW expire_logs_days = 7 -- To view, visit https://gerrit.wikimedia.org/r/323145 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I93898b9afda86a3e942c03712e0f682dfe367798 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1081 for maintenance
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322833 Change subject: db-eqiad.php: Depool db1081 for maintenance .. db-eqiad.php: Depool db1081 for maintenance db1081 needs an ALTER table so it needs to be depooled Bug: T147305 Change-Id: I3608065c34068e024b41d6b20653c2a4f7e7a6be --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/33/322833/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 3662032..22d0107 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -134,7 +134,7 @@ 'db1059' => 1, # 2.8TB 96GB, api 'db1064' => 0, # 2.8TB 160GB, vslow, dump 'db1068' => 1, # 2.8TB 160GB, api - 'db1081' => 500, # 3.6TB 512GB +# 'db1081' => 500, # 3.6TB 512GB 'db1084' => 500, # 3.6TB 512GB 'db1091' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/322833 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I3608065c34068e024b41d6b20653c2a4f7e7a6be Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1081 for maintenance"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322835 Change subject: Revert "db-eqiad.php: Depool db1081 for maintenance" .. Revert "db-eqiad.php: Depool db1081 for maintenance" Repool db1081 - maintenance is finished This reverts commit 95a00dfef59f763289063f0a87aa74fb6791dcfc. Change-Id: If763fd9d01c6ecbcad743cba56d323df35ab50ae --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/35/322835/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index cdc1701..3662032 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -134,7 +134,7 @@ 'db1059' => 1, # 2.8TB 96GB, api 'db1064' => 0, # 2.8TB 160GB, vslow, dump 'db1068' => 1, # 2.8TB 160GB, api -# 'db1081' => 500, # 3.6TB 512GB, #Maintenance #T147305 + 'db1081' => 500, # 3.6TB 512GB 'db1084' => 500, # 3.6TB 512GB 'db1091' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/322835 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: If763fd9d01c6ecbcad743cba56d323df35ab50ae Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1084 for maintenance
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322837 Change subject: db-eqiad.php: Depool db1084 for maintenance .. db-eqiad.php: Depool db1084 for maintenance db1084 needs an ALTER table so it needs to be depooled Bug: T147305 Change-Id: I512de2c0e68e0b0c5594fc6b0da6ab382342acf2 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/37/322837/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 3662032..1270c55 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -135,7 +135,7 @@ 'db1064' => 0, # 2.8TB 160GB, vslow, dump 'db1068' => 1, # 2.8TB 160GB, api 'db1081' => 500, # 3.6TB 512GB - 'db1084' => 500, # 3.6TB 512GB +# 'db1084' => 500, # 3.6TB 512GB #Maintenance #T147305 'db1091' => 500, # 3.6TB 512GB ], 's5' => [ -- To view, visit https://gerrit.wikimedia.org/r/322837 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I512de2c0e68e0b0c5594fc6b0da6ab382342acf2 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1052 for maintenance
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322906 Change subject: db-eqiad.php: Depool db1052 for maintenance .. db-eqiad.php: Depool db1052 for maintenance We are planning to use db1052 as a temporary master for the new sanitarium host, and we need to depool it to import its tablespace to db1095. Bug: T150960 Change-Id: I67702ee216afe25ac75f1cd1f9fd5012c0b58d6a --- M wmf-config/db-eqiad.php 1 file changed, 2 insertions(+), 2 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/06/322906/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index ddc2472..0fdbe12 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -94,7 +94,7 @@ 'sectionLoads' => [ 's1' => [ 'db1057' => 0, # 2.8TB 96GB, master - 'db1052' => 1 , # 2.8TB 96GB, api, old master +# 'db1052' => 1 , # 2.8TB 96GB, api, old master #Temporary master for db1095 - new sanitarium #T150960 'db1051' => 50, # 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1055' => 50, # 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1065' => 50, # 2.8TB 160GB, api @@ -266,7 +266,7 @@ 'api' => [ 'db1065' => 1, 'db1066' => 1, - 'db1052' => 1, +# 'db1052' => 1, ], ], 's2' => [ -- To view, visit https://gerrit.wikimedia.org/r/322906 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I67702ee216afe25ac75f1cd1f9fd5012c0b58d6a Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: site.pp: db1052's binlog changed to ROW
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322903 Change subject: site.pp: db1052's binlog changed to ROW .. site.pp: db1052's binlog changed to ROW In order to set up the new sanitarium db1052 will need to get its binary logs changed to ROW based replication Bug: T150960 Change-Id: Ie356db914aafdd4b1ccab4df60c07a7707e3ff8c --- M manifests/site.pp 1 file changed, 8 insertions(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/03/322903/1 diff --git a/manifests/site.pp b/manifests/site.pp index 09784ee..8864db7 100644 --- a/manifests/site.pp +++ b/manifests/site.pp @@ -429,12 +429,19 @@ } } -node /^db10(51|52|55|65|66|72|73|80|83|89)\.eqiad\.wmnet/ { +node /^db10(51|55|65|66|72|73|80|83|89)\.eqiad\.wmnet/ { class { 'role::mariadb::core': shard => 's1', } } +node 'db1052.eqiad.wmnet' { +class { 'role::mariadb::core': +shard => 's1', +binlog_format => 'ROW', +} +} + # s1 (enwiki) core production dbs on codfw # codfw master node 'db2016.codfw.wmnet' { -- To view, visit https://gerrit.wikimedia.org/r/322903 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ie356db914aafdd4b1ccab4df60c07a7707e3ff8c Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: site.pp: db1044's binlog changed to ROW
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/323504 Change subject: site.pp: db1044's binlog changed to ROW .. site.pp: db1044's binlog changed to ROW In order to set up the new sanitarium, db1044 will need to get its binary logs changed to ROW based replication Bug: T150802 Change-Id: I0d93592efebe3adb884e99b857cad849dc68c595 --- M manifests/site.pp 1 file changed, 9 insertions(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/04/323504/1 diff --git a/manifests/site.pp b/manifests/site.pp index 435cd10..ac01922 100644 --- a/manifests/site.pp +++ b/manifests/site.pp @@ -504,12 +504,20 @@ } } -node /^db10(15|35|38|44|77|78)\.eqiad\.wmnet/ { +node /^db10(15|35|38|77|78)\.eqiad\.wmnet/ { class { 'role::mariadb::core': shard => 's3', } } +# Testing row-based replication to sanitarium2 (T150802) +node 'db1044.eqiad.wmnet' { +class { 'role::mariadb::core': +shard => 's3', +binlog_format => 'ROW', +} +} + # s3 (default) core production dbs on codfw # codfw master node 'db2018.codfw.wmnet' { -- To view, visit https://gerrit.wikimedia.org/r/323504 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I0d93592efebe3adb884e99b857cad849dc68c595 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Added comment for db1044
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/323505 Change subject: db-eqiad.php: Added comment for db1044 .. db-eqiad.php: Added comment for db1044 We are planning to use db1044 as a temporary master for the new sanitarium host. Bug: T150802 Change-Id: Iefefd8e55b606504070d735cb09f3c7f7bed0174 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/05/323505/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 0fdbe12..7098ac7 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -123,7 +123,7 @@ 'db1038' => 0, # 1.4TB 64GB, vslow, dump, old master 'db1015' => 1 , # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager # 'db1035' => 0, # 1.4TB 64GB -# 'db1044' => 0, # 1.4TB 64GB +# 'db1044' => 0, # 1.4TB 64GB, #Temporary master for db1095 - new sanitarium #T150802 'db1077' => 500, # 3.6TB 512GB 'db1078' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/323505 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Iefefd8e55b606504070d735cb09f3c7f7bed0174 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Repool db2049
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/323823 Change subject: db-codfw.php: Repool db2049 .. db-codfw.php: Repool db2049 db2049 had HW issues 10 days ago, but it has been fine for the last week so it is time to pool it back. Bug: T150876 Change-Id: Iff0882e0dd8dc2853c68f932b906492bf939 --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/23/323823/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index c809a30..7612bc7 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -106,7 +106,7 @@ 'db2017' => 0, # 2.9TB 96GB, master 'db2035' => 50, # 2.9TB 160GB, rc, log 'db2041' => 100, # 2.9TB 160GB, api -# 'db2049' => 400, # 2.9TB 160GB, # HW issues #T150876 + 'db2049' => 400, # 2.9TB 160GB, 'db2056' => 50, # 3.3TB 160GB, dump (inactive), vslow 'db2063' => 100, # 3.3TB 160GB, api 'db2064' => 400, # 3.3TB 160GB -- To view, visit https://gerrit.wikimedia.org/r/323823 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Iff0882e0dd8dc2853c68f932b906492bf939 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2048
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/323854 Change subject: db-codfw.php: Depool db2048 .. db-codfw.php: Depool db2048 db2048 is going to be used to swap the PSU with db2034 temporarily just to check if the PSUs are what causes db2034 crashes Bug: T149553 Change-Id: If238b8178fd4fc0a419b79300703d06c99382624 --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/54/323854/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 7612bc7..2739757 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -96,7 +96,7 @@ 'db2016' => 0, # 2.9TB 96GB, master # 'db2034' => 50, # 2.9TB 160GB, rc, log #Maintenance - T149553 'db2042' => 50, # 2.9TB 160GB, rc, log - 'db2048' => 400, # 2.9TB 160GB +# 'db2048' => 400, # 2.9TB 160GB #Temporary depool - T149553 'db2055' => 50, # 3.3TB 160GB, dump (inactive), vslow 'db2062' => 100, # 3.3TB 160GB, api 'db2069' => 100, # 3.3TB 160GB, api -- To view, visit https://gerrit.wikimedia.org/r/323854 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: If238b8178fd4fc0a419b79300703d06c99382624 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: site.pp: db1052's binlog changed to ROW
Marostegui has submitted this change and it was merged. Change subject: site.pp: db1052's binlog changed to ROW .. site.pp: db1052's binlog changed to ROW In order to set up the new sanitarium db1052 will need to get its binary logs changed to ROW based replication Bug: T150960 Change-Id: Ie356db914aafdd4b1ccab4df60c07a7707e3ff8c --- M manifests/site.pp 1 file changed, 9 insertions(+), 1 deletion(-) Approvals: Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/manifests/site.pp b/manifests/site.pp index 09784ee..a8ceef7 100644 --- a/manifests/site.pp +++ b/manifests/site.pp @@ -429,12 +429,20 @@ } } -node /^db10(51|52|55|65|66|72|73|80|83|89)\.eqiad\.wmnet/ { +node /^db10(51|55|65|66|72|73|80|83|89)\.eqiad\.wmnet/ { class { 'role::mariadb::core': shard => 's1', } } +# Testing row-based replication to sanitarium2 (T150960) +node 'db1052.eqiad.wmnet' { +class { 'role::mariadb::core': +shard => 's1', +binlog_format => 'ROW', +} +} + # s1 (enwiki) core production dbs on codfw # codfw master node 'db2016.codfw.wmnet' { -- To view, visit https://gerrit.wikimedia.org/r/322903 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ie356db914aafdd4b1ccab4df60c07a7707e3ff8c Gerrit-PatchSet: 4 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: Volans Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: site.pp: Change db1044 binlog to ROW
Marostegui has submitted this change and it was merged. Change subject: site.pp: Change db1044 binlog to ROW .. site.pp: Change db1044 binlog to ROW In order to set up the new sanitarium, db1044 will need to get its binary logs changed to ROW based replication Bug: T150802 Change-Id: I0d93592efebe3adb884e99b857cad849dc68c595 --- M manifests/site.pp 1 file changed, 9 insertions(+), 1 deletion(-) Approvals: Jcrespo: Looks good to me, but someone else must approve Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/manifests/site.pp b/manifests/site.pp index 435cd10..ac01922 100644 --- a/manifests/site.pp +++ b/manifests/site.pp @@ -504,12 +504,20 @@ } } -node /^db10(15|35|38|44|77|78)\.eqiad\.wmnet/ { +node /^db10(15|35|38|77|78)\.eqiad\.wmnet/ { class { 'role::mariadb::core': shard => 's3', } } +# Testing row-based replication to sanitarium2 (T150802) +node 'db1044.eqiad.wmnet' { +class { 'role::mariadb::core': +shard => 's3', +binlog_format => 'ROW', +} +} + # s3 (default) core production dbs on codfw # codfw master node 'db2018.codfw.wmnet' { -- To view, visit https://gerrit.wikimedia.org/r/323504 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I0d93592efebe3adb884e99b857cad849dc68c595 Gerrit-PatchSet: 3 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Repool db1092
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/323791 Change subject: db-eqiad.php: Repool db1092 .. db-eqiad.php: Repool db1092 db1092 crashed a week ago and it has been working fine for the last week, so it is time to pool it again Bug: T151272 Change-Id: Ic1f4bad59ded076274df1f135eecee18e28fd6f7 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/91/323791/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 7098ac7..35c6566 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -146,7 +146,7 @@ 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB -# 'db1092' => 500, # 3.6TB 512GB T151272 + 'db1092' => 500, # 3.6TB 512GB ], 's6' => [ 'db1050' => 0, # 2.8TB 64GB, master -- To view, visit https://gerrit.wikimedia.org/r/323791 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ic1f4bad59ded076274df1f135eecee18e28fd6f7 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: sanitarium2.my.cnf: Disable parallel replication
Marostegui has submitted this change and it was merged. Change subject: sanitarium2.my.cnf: Disable parallel replication .. sanitarium2.my.cnf: Disable parallel replication By default do not use parallel replication on the new sanitarium host. Change-Id: I93898b9afda86a3e942c03712e0f682dfe367798 --- M templates/mariadb/sanitarium2.my.cnf.erb 1 file changed, 2 insertions(+), 1 deletion(-) Approvals: Jcrespo: Looks good to me, but someone else must approve Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/templates/mariadb/sanitarium2.my.cnf.erb b/templates/mariadb/sanitarium2.my.cnf.erb index fafceeb..b2d56eb 100644 --- a/templates/mariadb/sanitarium2.my.cnf.erb +++ b/templates/mariadb/sanitarium2.my.cnf.erb @@ -42,7 +42,8 @@ transaction-isolation = REPEATABLE-READ log-bin slave_transaction_retries = 4294967295 -slave_parallel_threads = 2 +slave_parallel_mode= none +slave_parallel_threads = 0 slave_parallel_max_queued = 16M binlog-format = ROW expire_logs_days = 7 -- To view, visit https://gerrit.wikimedia.org/r/323145 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I93898b9afda86a3e942c03712e0f682dfe367798 Gerrit-PatchSet: 2 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1084 for maintenance"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322843 Change subject: Revert "db-eqiad.php: Depool db1084 for maintenance" .. Revert "db-eqiad.php: Depool db1084 for maintenance" db1084 finished its maintenance - ready to be pooled back. This reverts commit 49875883a95cdb2b7be68f42630659317bf1f570. Change-Id: Ib4c22374cc5f8efd1bf928149f7663482ab5c87d --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/43/322843/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 1270c55..3662032 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -135,7 +135,7 @@ 'db1064' => 0, # 2.8TB 160GB, vslow, dump 'db1068' => 1, # 2.8TB 160GB, api 'db1081' => 500, # 3.6TB 512GB -# 'db1084' => 500, # 3.6TB 512GB #Maintenance #T147305 + 'db1084' => 500, # 3.6TB 512GB 'db1091' => 500, # 3.6TB 512GB ], 's5' => [ -- To view, visit https://gerrit.wikimedia.org/r/322843 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ib4c22374cc5f8efd1bf928149f7663482ab5c87d Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Repool db2066
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/321889 Change subject: db-codfw.php: Repool db2066 .. db-codfw.php: Repool db2066 db2066 was out as it was serving as a clone source for another hosts and needed to have its replication thread stopped. Now it is ready to go back Bug: T150518 Change-Id: Iff1f2d3b531bbf38f90946af42f0346b7ed26c15 --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/89/321889/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 7c362cd..7612bc7 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -132,7 +132,7 @@ 'db2045' => 400, # 2.9TB 160GB 'db2052' => 50, # 2.9TB 160GB, dump (inactive), vslow 'db2059' => 100, # 3.3TB 160GB, api -# 'db2066' => 400, # 3.3TB 160GB #Temporary maintenance T150518 + 'db2066' => 400, # 3.3TB 160GB ], 's6' => [ 'db2028' => 0, # 2.9TB 96GB, master -- To view, visit https://gerrit.wikimedia.org/r/321889 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Iff1f2d3b531bbf38f90946af42f0346b7ed26c15 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2049 for the weekend
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322238 Change subject: db-codfw.php: Depool db2049 for the weekend .. db-codfw.php: Depool db2049 for the weekend db2049 has had HW issues. I have been testing its CPUs for more than 12 hours without any problem, so I want to start MYSQL and leave it replicating. However, as we are not completely sure, I want to leave it depooled for the weekend and silenced to avoid paging if this dies again. Bug: T150876 Change-Id: I94d9eea56a120f1bd218e17d5717e66800c7a713 --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/38/322238/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 7612bc7..c809a30 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -106,7 +106,7 @@ 'db2017' => 0, # 2.9TB 96GB, master 'db2035' => 50, # 2.9TB 160GB, rc, log 'db2041' => 100, # 2.9TB 160GB, api - 'db2049' => 400, # 2.9TB 160GB, +# 'db2049' => 400, # 2.9TB 160GB, # HW issues #T150876 'db2056' => 50, # 3.3TB 160GB, dump (inactive), vslow 'db2063' => 100, # 3.3TB 160GB, api 'db2064' => 400, # 3.3TB 160GB -- To view, visit https://gerrit.wikimedia.org/r/322238 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I94d9eea56a120f1bd218e17d5717e66800c7a713 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2070 for maintenance
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322240 Change subject: db-codfw.php: Depool db2070 for maintenance .. db-codfw.php: Depool db2070 for maintenance I am going to use db2070 to clone db2034. db2034 is an rc server but the other rc server has a predictive failure disk and has had some issues, so I do not want to push it. I will use db2070 and if it works fine I will repartition db2034. This whole transfer might make db2034 break down as stated in: T149553 Bug: T149553 Change-Id: Ifc0144bb635bf7bfe6fab5cd2a31016016e66c5a --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/40/322240/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index c809a30..248e2c2 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -100,7 +100,7 @@ 'db2055' => 50, # 3.3TB 160GB, dump (inactive), vslow 'db2062' => 100, # 3.3TB 160GB, api 'db2069' => 100, # 3.3TB 160GB, api - 'db2070' => 400, # 3.3TB 160GB +# 'db2070' => 400, # 3.3TB 160GB #Maintenance T149553 ], 's2' => [ 'db2017' => 0, # 2.9TB 96GB, master -- To view, visit https://gerrit.wikimedia.org/r/322240 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ifc0144bb635bf7bfe6fab5cd2a31016016e66c5a Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1068"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322629 Change subject: Revert "db-eqiad.php: Depool db1068" .. Revert "db-eqiad.php: Depool db1068" db1068 finished its maintenance and it is ready to go back to the pool This reverts commit 34712f0d6bcfccf4afea00fb300d00a3417707c0. Change-Id: I0cb10704007fdddc3ade77281c4652dc0d89554c --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 5 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/29/322629/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 50a2165..a675ba3 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -133,8 +133,8 @@ 'db1056' => 1, # 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1059' => 1, # 2.8TB 96GB, api 'db1064' => 0, # 2.8TB 160GB, vslow, dump -# 'db1068' => 1, # 2.8TB 160GB, api, #Maintenance T147305 - 'db1081' => 300, # 3.6TB 512GB, api, #Temporary serving api T147305 + 'db1068' => 1, # 2.8TB 160GB, api + 'db1081' => 500, # 3.6TB 512GB 'db1084' => 500, # 3.6TB 512GB 'db1091' => 500, # 3.6TB 512GB ], @@ -327,9 +327,8 @@ 'db1064' => 1, ], 'api' => [ - 'db1059' => 3, -# 'db1068' => 3, - 'db1081' => 1, + 'db1059' => 1, + 'db1068' => 3, ], 'watchlist' => [ 'db1053' => 1, -- To view, visit https://gerrit.wikimedia.org/r/322629 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I0cb10704007fdddc3ade77281c4652dc0d89554c Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Repool db2070
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322613 Change subject: db-codfw.php: Repool db2070 .. db-codfw.php: Repool db2070 db2070 was out for maintenance and it is now ready to be back Bug: T149553 Change-Id: I5db65b9d3409d09182be2fb43d89f33f521a405e --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/13/322613/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 248e2c2..c809a30 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -100,7 +100,7 @@ 'db2055' => 50, # 3.3TB 160GB, dump (inactive), vslow 'db2062' => 100, # 3.3TB 160GB, api 'db2069' => 100, # 3.3TB 160GB, api -# 'db2070' => 400, # 3.3TB 160GB #Maintenance T149553 + 'db2070' => 400, # 3.3TB 160GB ], 's2' => [ 'db2017' => 0, # 2.9TB 96GB, master -- To view, visit https://gerrit.wikimedia.org/r/322613 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I5db65b9d3409d09182be2fb43d89f33f521a405e Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1068
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/322615 Change subject: db-eqiad.php: Depool db1068 .. db-eqiad.php: Depool db1068 db1068 needs an ALTER TABLE so temporary depool it. In order to help with API traffic I have reduced db1081's general traffic weight to pool it for some API traffic and help db1059 Bug: T147305 Change-Id: Id4d3943ab22c74d493d6ae01f6b4f9095531ead2 --- M wmf-config/db-eqiad.php 1 file changed, 5 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/15/322615/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index a675ba3..50a2165 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -133,8 +133,8 @@ 'db1056' => 1, # 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1059' => 1, # 2.8TB 96GB, api 'db1064' => 0, # 2.8TB 160GB, vslow, dump - 'db1068' => 1, # 2.8TB 160GB, api - 'db1081' => 500, # 3.6TB 512GB +# 'db1068' => 1, # 2.8TB 160GB, api, #Maintenance T147305 + 'db1081' => 300, # 3.6TB 512GB, api, #Temporary serving api T147305 'db1084' => 500, # 3.6TB 512GB 'db1091' => 500, # 3.6TB 512GB ], @@ -327,8 +327,9 @@ 'db1064' => 1, ], 'api' => [ - 'db1059' => 1, - 'db1068' => 3, + 'db1059' => 3, +# 'db1068' => 3, + 'db1081' => 1, ], 'watchlist' => [ 'db1053' => 1, -- To view, visit https://gerrit.wikimedia.org/r/322615 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Id4d3943ab22c74d493d6ae01f6b4f9095531ead2 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2034
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/318892 Change subject: db-codfw.php: Depool db2034 .. db-codfw.php: Depool db2034 db2034 needs reimage. It also crashed and the logs showed some powerfault failure - so I will talk to Papaul to see if he can check something from his side This host will be clone from eqiad Bug: T149553 Change-Id: I71199d0a66acbc85787182307f69064bf24fb923 --- M wmf-config/db-codfw.php 1 file changed, 6 insertions(+), 6 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/92/318892/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 9a36bad..f13bf26 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -94,7 +94,7 @@ 'sectionLoads' => [ 's1' => [ 'db2016' => 0, # 2.9TB 96GB, master - 'db2034' => 50, # 2.9TB 160GB, rc, log +# 'db2034' => 50, # 2.9TB 160GB, rc, log #Maintenance - T149553 'db2042' => 50, # 2.9TB 160GB, rc, log 'db2048' => 400, # 2.9TB 160GB 'db2055' => 50, # 3.3TB 160GB, dump (inactive), vslow @@ -218,23 +218,23 @@ 'groupLoadsBySection' => [ 's1' => [ 'watchlist' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'recentchanges' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'recentchangeslinked' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'contributions' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'logpager' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'dump' => [ -- To view, visit https://gerrit.wikimedia.org/r/318892 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I71199d0a66acbc85787182307f69064bf24fb923 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2034
Marostegui has submitted this change and it was merged. Change subject: db-codfw.php: Depool db2034 .. db-codfw.php: Depool db2034 db2034 needs reimage. It also crashed and the logs showed some powerfault failure - so I will talk to Papaul to see if he can check something from his side This host will be clone from eqiad Bug: T149553 Change-Id: I71199d0a66acbc85787182307f69064bf24fb923 --- M wmf-config/db-codfw.php 1 file changed, 6 insertions(+), 6 deletions(-) Approvals: Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 9a36bad..f13bf26 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -94,7 +94,7 @@ 'sectionLoads' => [ 's1' => [ 'db2016' => 0, # 2.9TB 96GB, master - 'db2034' => 50, # 2.9TB 160GB, rc, log +# 'db2034' => 50, # 2.9TB 160GB, rc, log #Maintenance - T149553 'db2042' => 50, # 2.9TB 160GB, rc, log 'db2048' => 400, # 2.9TB 160GB 'db2055' => 50, # 3.3TB 160GB, dump (inactive), vslow @@ -218,23 +218,23 @@ 'groupLoadsBySection' => [ 's1' => [ 'watchlist' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'recentchanges' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'recentchangeslinked' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'contributions' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'logpager' => [ - 'db2034' => 1, +# 'db2034' => 1, 'db2042' => 1, ], 'dump' => [ -- To view, visit https://gerrit.wikimedia.org/r/318892 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I71199d0a66acbc85787182307f69064bf24fb923 Gerrit-PatchSet: 2 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Florianschmidtwelzow Gerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Added gtid_domain_id option
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/319799 Change subject: mariadb: Added gtid_domain_id option .. mariadb: Added gtid_domain_id option Added this commented first so it doesn't get applied on restarts This option is needed to be able to use GTID + multisource replication. It is only needed in servers that will be masters or can be masters at somepoint, but for consistency it is better to have it enabled in all the hosts. This regex will set the variable (which will only take effect on restart if uncommented) to the numeric digits on the hostname. Discarding any letter or non numeric value. Bug: T149418 Change-Id: I2c19c4e5d8e8a0f801bd31b85f57a25e4a8e573d --- M templates/mariadb/default.my.cnf.erb 1 file changed, 9 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/99/319799/1 diff --git a/templates/mariadb/default.my.cnf.erb b/templates/mariadb/default.my.cnf.erb index 612ffb0..d72b9c9 100644 --- a/templates/mariadb/default.my.cnf.erb +++ b/templates/mariadb/default.my.cnf.erb @@ -32,6 +32,15 @@ innodb_log_file_size= 50M innodb_flush_method = O_DIRECT +# gtid_domain_id flag is needed for multisource replication and GTID. +# Strictly it is only needed on masters or servers that can potentially be +# masters but for consistency it should be set in all of them. +# https://mariadb.com/kb/en/mariadb/gtid/ +# The following regex removes all the non numeric characters and sets it to +# the numbers that are part of the hostname + +#gtid_domain_id = <%= @my_hostname.gsub(/[a-zA-Z]+(\d+)\..*$/, '\1') %> + [mysqldump] quick -- To view, visit https://gerrit.wikimedia.org/r/319799 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I2c19c4e5d8e8a0f801bd31b85f57a25e4a8e573d Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Added gtid_domain_id option for m1
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/319809 Change subject: mariadb: Added gtid_domain_id option for m1 .. mariadb: Added gtid_domain_id option for m1 This option is needed to be able to use GTID + multisource replication. It is only needed in servers that will be masters or can be masters at somepoint, but for consistency it is better to have it enabled in all the hosts. This regex will set the variable (which will only take effect on restart) to the numeric digits on the hostname. Discarding any letter or non numeric value. Bug: T149418 Change-Id: I2103e5f22aa4e57d70d57a674834cea3cd0ee857 --- M templates/mariadb/misc.my.cnf.erb 1 file changed, 11 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/09/319809/1 diff --git a/templates/mariadb/misc.my.cnf.erb b/templates/mariadb/misc.my.cnf.erb index e4fdf65..c6bd6bd 100644 --- a/templates/mariadb/misc.my.cnf.erb +++ b/templates/mariadb/misc.my.cnf.erb @@ -74,6 +74,17 @@ <% end -%> aria_pagecache_buffer_size = 512M +<% if @shard == 'm2' -%> +# gtid_domain_id flag is needed for multisource replication and GTID. +# Strictly it is only needed on masters or servers that can potentially be +# masters but for consistency it should be set in all of them. +# https://mariadb.com/kb/en/mariadb/gtid/ +# The following regex removes all the non numeric characters and sets it to +# the numbers that are part of the hostname + +gtid_domain_id = <%= @server_id %> + +<% end -%> [mysqldump] quick -- To view, visit https://gerrit.wikimedia.org/r/319809 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I2103e5f22aa4e57d70d57a674834cea3cd0ee857 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Added gtid_domain_id option for m2
Marostegui has submitted this change and it was merged. Change subject: mariadb: Added gtid_domain_id option for m2 .. mariadb: Added gtid_domain_id option for m2 This option is needed to be able to use GTID + multisource replication. It is only needed in servers that will be masters or can be masters at somepoint, but for consistency it is better to have it enabled in all the hosts. This regex will set the variable (which will only take effect on restart) to the numeric digits on the hostname. Discarding any letter or non numeric value. Bug: T149418 Change-Id: I2103e5f22aa4e57d70d57a674834cea3cd0ee857 --- M templates/mariadb/misc.my.cnf.erb 1 file changed, 11 insertions(+), 0 deletions(-) Approvals: Jcrespo: Looks good to me, but someone else must approve Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/templates/mariadb/misc.my.cnf.erb b/templates/mariadb/misc.my.cnf.erb index e4fdf65..c6bd6bd 100644 --- a/templates/mariadb/misc.my.cnf.erb +++ b/templates/mariadb/misc.my.cnf.erb @@ -74,6 +74,17 @@ <% end -%> aria_pagecache_buffer_size = 512M +<% if @shard == 'm2' -%> +# gtid_domain_id flag is needed for multisource replication and GTID. +# Strictly it is only needed on masters or servers that can potentially be +# masters but for consistency it should be set in all of them. +# https://mariadb.com/kb/en/mariadb/gtid/ +# The following regex removes all the non numeric characters and sets it to +# the numbers that are part of the hostname + +gtid_domain_id = <%= @server_id %> + +<% end -%> [mysqldump] quick -- To view, visit https://gerrit.wikimedia.org/r/319809 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I2103e5f22aa4e57d70d57a674834cea3cd0ee857 Gerrit-PatchSet: 3 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Install jessie on dbstore2002
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/319859 Change subject: mariadb: Install jessie on dbstore2002 .. mariadb: Install jessie on dbstore2002 Bug: T150017 Change-Id: I0bd47e5e38501e1aa3d857e951395238dfdbcba4 --- M modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 1 file changed, 0 insertions(+), 2 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/59/319859/1 diff --git a/modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 b/modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 index 9e1fa90..8506545 100644 --- a/modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 +++ b/modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 @@ -1861,8 +1861,6 @@ host dbstore2002 { hardware ethernet 40:a8:f0:26:8a:14; fixed-address dbstore2002.codfw.wmnet; -option pxelinux.pathprefix "trusty-installer/"; -filename "trusty-installer/ubuntu-installer/amd64/pxelinux.0"; } host cp1099 { -- To view, visit https://gerrit.wikimedia.org/r/319859 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I0bd47e5e38501e1aa3d857e951395238dfdbcba4 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Install jessie on dbstore2002
Marostegui has submitted this change and it was merged. Change subject: mariadb: Install jessie on dbstore2002 .. mariadb: Install jessie on dbstore2002 Bug: T150017 Change-Id: I0bd47e5e38501e1aa3d857e951395238dfdbcba4 --- M modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 1 file changed, 0 insertions(+), 2 deletions(-) Approvals: Jcrespo: Looks good to me, but someone else must approve Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 b/modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 index 9e1fa90..8506545 100644 --- a/modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 +++ b/modules/install_server/files/dhcpd/linux-host-entries.ttyS1-115200 @@ -1861,8 +1861,6 @@ host dbstore2002 { hardware ethernet 40:a8:f0:26:8a:14; fixed-address dbstore2002.codfw.wmnet; -option pxelinux.pathprefix "trusty-installer/"; -filename "trusty-installer/ubuntu-installer/amd64/pxelinux.0"; } host cp1099 { -- To view, visit https://gerrit.wikimedia.org/r/319859 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I0bd47e5e38501e1aa3d857e951395238dfdbcba4 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Repool db1068
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/315683 Change subject: db-eqiad.php: Repool db1068 .. db-eqiad.php: Repool db1068 db1068 was out for maintenance (ALTER table) now pool it back but leave db1081 there to make sure db1068 gets back slowly. Once it is been there for some time I will remove db1081 from the API service and restore its normal weight for general traffic Bug: T147305 Change-Id: I16e0f0bea1e3afb092bbcd10e33c3fb138bf214b --- M wmf-config/db-eqiad.php 1 file changed, 2 insertions(+), 2 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/83/315683/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 17221aa..591d592 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -133,7 +133,7 @@ 'db1056' => 1, # 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1059' => 1, # 2.8TB 96GB, api 'db1064' => 0, # 2.8TB 160GB, vslow, dump -# 'db1068' => 1, # 2.8TB 160GB, api + 'db1068' => 1, # 2.8TB 160GB, api 'db1081' => 250, # 3.6TB 512GB, api 'db1084' => 500, # 3.6TB 512GB 'db1091' => 500, # 3.6TB 512GB @@ -327,7 +327,7 @@ ], 'api' => [ 'db1059' => 1, -# 'db1068' => 3, + 'db1068' => 3, 'db1081' => 3, ], 'watchlist' => [ -- To view, visit https://gerrit.wikimedia.org/r/315683 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I16e0f0bea1e3afb092bbcd10e33c3fb138bf214b Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db1053 update IP
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/315691 Change subject: db1053 update IP .. db1053 update IP db1053 has been moved to a different rack and thus it got a different IP so I am upgrading the files with the new IP it got Bug: T147774 Change-Id: If7eccbb7839c6183ccad95c4e3bf152c6f25dac0 --- M wmf-config/db-codfw.php M wmf-config/db-eqiad.php 2 files changed, 2 insertions(+), 2 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/91/315691/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 6da0ff4..9a36bad 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -450,7 +450,7 @@ 'db1050' => '10.64.16.145', #do not remove or comment out 'db1051' => '10.64.32.21', #do not remove or comment out 'db1052' => '10.64.32.22', #do not remove or comment out - 'db1053' => '10.64.32.23', #do not remove or comment out + 'db1053' => '10.64.0.87', #do not remove or comment out 'db1054' => '10.64.32.24', #do not remove or comment out 'db1055' => '10.64.32.25', #do not remove or comment out 'db1056' => '10.64.32.26', #do not remove or comment out diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 17221aa..f98d21e 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -472,7 +472,7 @@ 'db1050' => '10.64.16.145', #do not remove or comment out 'db1051' => '10.64.32.21', #do not remove or comment out 'db1052' => '10.64.32.22', #do not remove or comment out - 'db1053' => '10.64.32.23', #do not remove or comment out + 'db1053' => '10.64.0.87', #do not remove or comment out 'db1054' => '10.64.32.24', #do not remove or comment out 'db1055' => '10.64.32.25', #do not remove or comment out 'db1056' => '10.64.32.26', #do not remove or comment out -- To view, visit https://gerrit.wikimedia.org/r/315691 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: If7eccbb7839c6183ccad95c4e3bf152c6f25dac0 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1068 for maintenance"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/315685 Change subject: Revert "db-eqiad.php: Depool db1068 for maintenance" .. Revert "db-eqiad.php: Depool db1068 for maintenance" This reverts commit 2c851bddf1e48ab911e69b04b0f8229fb61fb4a6. db1068 has finished its maintenance and it is ready to get repooled. Change-Id: I2dd41748f29be2338c716f69fb83d2ee56b981f8 --- M wmf-config/db-eqiad.php 1 file changed, 3 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/85/315685/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 17221aa..93456cd 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -133,8 +133,8 @@ 'db1056' => 1, # 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1059' => 1, # 2.8TB 96GB, api 'db1064' => 0, # 2.8TB 160GB, vslow, dump -# 'db1068' => 1, # 2.8TB 160GB, api - 'db1081' => 250, # 3.6TB 512GB, api + 'db1068' => 1, # 2.8TB 160GB, api + 'db1081' => 500, # 3.6TB 512GB 'db1084' => 500, # 3.6TB 512GB 'db1091' => 500, # 3.6TB 512GB ], @@ -327,8 +327,7 @@ ], 'api' => [ 'db1059' => 1, -# 'db1068' => 3, - 'db1081' => 3, + 'db1068' => 3, ], 'watchlist' => [ 'db1056' => 1, -- To view, visit https://gerrit.wikimedia.org/r/315685 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I2dd41748f29be2338c716f69fb83d2ee56b981f8 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/software[master]: Remove db1019
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/315656 Change subject: Remove db1019 .. Remove db1019 db1019 has been decommissioned and needs to be removed from s4.hosts file Bug: T146265 Change-Id: I51942968634f30141004b73cce72ad5d1294bc12 --- M dbtools/s4.hosts 1 file changed, 0 insertions(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/software refs/changes/56/315656/1 diff --git a/dbtools/s4.hosts b/dbtools/s4.hosts index db41c05..f11b9f1 100644 --- a/dbtools/s4.hosts +++ b/dbtools/s4.hosts @@ -11,7 +11,6 @@ labsdb1001.eqiad.wmnet 3306 labsdb1003.eqiad.wmnet 3306 db1069.eqiad.wmnet 3314 -db1019.eqiad.wmnet 3306 db1056.eqiad.wmnet 3306 db1059.eqiad.wmnet 3306 db1064.eqiad.wmnet 3306 -- To view, visit https://gerrit.wikimedia.org/r/315656 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I51942968634f30141004b73cce72ad5d1294bc12 Gerrit-PatchSet: 1 Gerrit-Project: operations/software Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1082
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/315045 Change subject: db-eqiad.php: Depool db1082 .. db-eqiad.php: Depool db1082 I am going to upgrade the RAID controller firmware of this server Bug: T145533 Change-Id: If6b43d154e64493f086b0340386c5193b8d1c948 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/45/315045/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 93456cd..bb88200 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB + 'db1082' => 0, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/315045 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: If6b43d154e64493f086b0340386c5193b8d1c948 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad: Repool db1082
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/315065 Change subject: db-eqiad: Repool db1082 .. db-eqiad: Repool db1082 After getting its RAID controller firmware upgrade - repool db1082 with less weight than usual so it slowly gets in the mix Bug: T145533 Change-Id: I4b1725f8b8f79d70738f40df5f956a90b0402794 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/65/315065/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index bb88200..87cf799 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 0, # 3.6TB 512GB + 'db1082' => 100, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/315065 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I4b1725f8b8f79d70738f40df5f956a90b0402794 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1068 for maintenance
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/315625 Change subject: db-eqiad.php: Depool db1068 for maintenance .. db-eqiad.php: Depool db1068 for maintenance db1068 needs an alter table to fix its PK, and so needs to be depooled Bug: T147305 Change-Id: I19119965a6d2cfc59e139cc7d3e6e33bdb906b85 --- M wmf-config/db-eqiad.php 1 file changed, 2 insertions(+), 2 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/25/315625/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 93456cd..2f3b4d4 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -133,7 +133,7 @@ 'db1056' => 1, # 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1059' => 1, # 2.8TB 96GB, api 'db1064' => 0, # 2.8TB 160GB, vslow, dump - 'db1068' => 1, # 2.8TB 160GB, api +# 'db1068' => 1, # 2.8TB 160GB, api 'db1081' => 500, # 3.6TB 512GB 'db1084' => 500, # 3.6TB 512GB 'db1091' => 500, # 3.6TB 512GB @@ -327,7 +327,7 @@ ], 'api' => [ 'db1059' => 1, - 'db1068' => 3, +# 'db1068' => 3, ], 'watchlist' => [ 'db1056' => 1, -- To view, visit https://gerrit.wikimedia.org/r/315625 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I19119965a6d2cfc59e139cc7d3e6e33bdb906b85 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations...mariadb[master]: mariadb: Added calculation for gtid_domain_id
Marostegui has submitted this change and it was merged. ( https://gerrit.wikimedia.org/r/326080 ) Change subject: mariadb: Added calculation for gtid_domain_id .. mariadb: Added calculation for gtid_domain_id The gtid_domain_id variable needs to be unique and for now it should be calculated the same way $server_id is, to make them independent from each other At the moment we are going to calculate the gtid_domain_id the same way we calculate server_id. But having them independent from each other will allow us to change one of them without affecting each other in the future if for any reason we need to change the way they are calculated. They both need to be unique across all the servers. Bug: T149418 Change-Id: If60eba4597ccb7ce2fbd4bdafa4ad647bc3ab8e7 --- M manifests/config.pp 1 file changed, 5 insertions(+), 0 deletions(-) Approvals: Marostegui: Looks good to me, approved jenkins-bot: Verified Volans: Looks good to me, but someone else must approve diff --git a/manifests/config.pp b/manifests/config.pp index afa88d8..058d6a3 100644 --- a/manifests/config.pp +++ b/manifests/config.pp @@ -28,6 +28,11 @@ {|total,value| (total << 8 ) + value.to_i} %>" ) +$gtid_domain_id = inline_template( +"<%= @ipaddress.split('.').inject(0)\ +{|total,value| (total << 8 ) + value.to_i} %>" +) + file { '/etc/my.cnf': owner => 'root', group => 'root', -- To view, visit https://gerrit.wikimedia.org/r/326080 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: If60eba4597ccb7ce2fbd4bdafa4ad647bc3ab8e7 Gerrit-PatchSet: 3 Gerrit-Project: operations/puppet/mariadb Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: Volans Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1082
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326077 ) Change subject: db-eqiad.php: Depool db1082 .. db-eqiad.php: Depool db1082 db1082 needs an ALTER table Bug: T150644 Change-Id: Ieedc9fc3257dbe38c0dbe2fc5ed45f74dc46b7aa --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/77/326077/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index c9d6a52..97ed44d 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB +# 'db1082' => 500, # 3.6TB 512GB #T150644 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/326077 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ieedc9fc3257dbe38c0dbe2fc5ed45f74dc46b7aa Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1082"
Hello jenkins-bot, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/326090 to review the following change. Change subject: Revert "db-eqiad.php: Depool db1082" .. Revert "db-eqiad.php: Depool db1082" db1082 has finished the ALTER table and it is ready to go back to the pool This reverts commit e6e187786736121dd7b464e03d01aafb322ce316. Change-Id: I3c3a0f8e5fa5c9e922b0de814033c528d5c35133 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/90/326090/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 97ed44d..c9d6a52 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api -# 'db1082' => 500, # 3.6TB 512GB #T150644 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/326090 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I3c3a0f8e5fa5c9e922b0de814033c528d5c35133 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Added gtid_domain_id to its own variable
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326086 ) Change subject: mariadb: Added gtid_domain_id to its own variable .. mariadb: Added gtid_domain_id to its own variable We were using server_id variable for gtid_domain_id, but it is better to make them independent, so we can change any of them in the future without affecting the other one. Once that is done, changing the variable in the misc shard hosts to use the new variable. More info: https://gerrit.wikimedia.org/r/#/c/326080/ Bug: T149418 Change-Id: I055849e3944743118e89950a57584b22837573ec --- M modules/mariadb M templates/mariadb/misc.my.cnf.erb 2 files changed, 2 insertions(+), 2 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/86/326086/1 diff --git a/modules/mariadb b/modules/mariadb index c50a383..729063a 16 --- a/modules/mariadb +++ b/modules/mariadb @@ -1 +1 @@ -Subproject commit c50a3838bf31526c0e2392908b16ec009682cd34 +Subproject commit 729063a0eed1b6c056b06266551fc5440d3524d7 diff --git a/templates/mariadb/misc.my.cnf.erb b/templates/mariadb/misc.my.cnf.erb index d58bd51..e1728c3 100644 --- a/templates/mariadb/misc.my.cnf.erb +++ b/templates/mariadb/misc.my.cnf.erb @@ -97,7 +97,7 @@ # masters but for consistency it should be set in all of them. # https://mariadb.com/kb/en/mariadb/gtid/ -gtid_domain_id = <%= @server_id %> +gtid_domain_id = <%= @gtid_domain_id %> <% if @ssl == 'on' %> # ssl -- To view, visit https://gerrit.wikimedia.org/r/326086 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I055849e3944743118e89950a57584b22837573ec Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1087
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326101 ) Change subject: db-eqiad.php: Depool db1087 .. db-eqiad.php: Depool db1087 db1087 needs an ALTER table Bug: T150644 Change-Id: I50f361bfb3b678b6eb13cab58b48729d5258da0e --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/01/326101/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index c9d6a52..96b9f13 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -145,7 +145,7 @@ 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB - 'db1087' => 500, # 3.6TB 512GB +# 'db1087' => 500, # 3.6TB 512GB #T150644 'db1092' => 500, # 3.6TB 512GB ], 's6' => [ -- To view, visit https://gerrit.wikimedia.org/r/326101 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I50f361bfb3b678b6eb13cab58b48729d5258da0e Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1087"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/326109 to review the following change. Change subject: Revert "db-eqiad.php: Depool db1087" .. Revert "db-eqiad.php: Depool db1087" db1087 finished the ALTER table and it is ready to go back to the pool This reverts commit a4437b630b8ef76aa517bb44329913153a9952d9. Change-Id: I2a1650b63e79a9c88182dafded04cb3f62c7696c --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/09/326109/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 96b9f13..c9d6a52 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -145,7 +145,7 @@ 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB -# 'db1087' => 500, # 3.6TB 512GB #T150644 + 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], 's6' => [ -- To view, visit https://gerrit.wikimedia.org/r/326109 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I2a1650b63e79a9c88182dafded04cb3f62c7696c Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations...mariadb[master]: mariadb: Added calculation for gtid_domain_id
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326080 ) Change subject: mariadb: Added calculation for gtid_domain_id .. mariadb: Added calculation for gtid_domain_id The gtid_domain_id variable needs to be unique and for now it should be calculated the same way $server_id is, to make them idependent from each other Bug: T149418 Change-Id: If60eba4597ccb7ce2fbd4bdafa4ad647bc3ab8e7 --- M manifests/config.pp 1 file changed, 6 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet/mariadb refs/changes/80/326080/1 diff --git a/manifests/config.pp b/manifests/config.pp index afa88d8..5212d59 100644 --- a/manifests/config.pp +++ b/manifests/config.pp @@ -28,6 +28,12 @@ {|total,value| (total << 8 ) + value.to_i} %>" ) +$gtid_domain_id = inline_template( +"<%= @ipaddress.split('.').inject(0)\ +{|total,value| (total << 8 ) + value.to_i} %>" +) + + file { '/etc/my.cnf': owner => 'root', group => 'root', -- To view, visit https://gerrit.wikimedia.org/r/326080 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: If60eba4597ccb7ce2fbd4bdafa4ad647bc3ab8e7 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet/mariadb Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: check_mariadb.pl: Fixed small display issue
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326124 ) Change subject: check_mariadb.pl: Fixed small display issue .. check_mariadb.pl: Fixed small display issue The current regular expression was showing the following on Icinga: CRITICAL slave_sql_state Slave_SQL_Running: No, Errno: 1062, Errmsg: Error 'Duplicate entry 'MANUALLY REMOVED' for key 'PRIMARY'' on query. Default database: 'commonswiki'. Query: [snipped]2 The value "2" wasn't being filtered. This commit has been tested on dbstore1001 (which is having that issue) and it displays the following instead: CRITICAL slave_sql_state Slave_SQL_Running: No, Errno: 1062, Errmsg: Error 'Duplicate entry 'MANUALLY REMOVED' for key 'PRIMARY'' on query. Default database: 'commonswiki'. [Query snipped] Bug: T152766 Change-Id: Ie14d1f963bae7d70b642cc6e9278836c2c330cd5 --- M modules/icinga/files/check_mariadb.pl 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/24/326124/1 diff --git a/modules/icinga/files/check_mariadb.pl b/modules/icinga/files/check_mariadb.pl index 489347a..79398f3 100755 --- a/modules/icinga/files/check_mariadb.pl +++ b/modules/icinga/files/check_mariadb.pl @@ -153,7 +153,7 @@ exit($EOK); } # sanitize the query for icinga: - $status->{Last_SQL_Error} =~ s/Query:\s+'(.*)'/Query: [snipped]/; +$status->{Last_SQL_Error} =~ s/Query.*/[Query snipped]/; # Both SQL and IO threads running? OK if ($status->{Slave_SQL_Running} eq "Yes") { -- To view, visit https://gerrit.wikimedia.org/r/326124 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ie14d1f963bae7d70b642cc6e9278836c2c330cd5 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2064
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326388 ) Change subject: db-codfw.php: Depool db2064 .. db-codfw.php: Depool db2064 db2064 is going to be used as a clone source to import s2 into dbstore2001. Bug: T151552 Change-Id: Ia9800755a8100c3f7b048a1e8eba9df0dce8a2f2 --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/88/326388/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 2739757..d16a844 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -109,7 +109,7 @@ 'db2049' => 400, # 2.9TB 160GB, 'db2056' => 50, # 3.3TB 160GB, dump (inactive), vslow 'db2063' => 100, # 3.3TB 160GB, api - 'db2064' => 400, # 3.3TB 160GB +# 'db2064' => 400, # 3.3TB 160GB #T151552 ], /* s3 */ 'DEFAULT' => [ 'db2018' => 0, # 2.9TB 96GB, master -- To view, visit https://gerrit.wikimedia.org/r/326388 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ia9800755a8100c3f7b048a1e8eba9df0dce8a2f2 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2067
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326898 ) Change subject: db-codfw.php: Depool db2067 .. db-codfw.php: Depool db2067 db2067 is going to be used as a clone source for dbstore2001 and needs its replication stopped. Bug: T151552 Change-Id: I607361c5450edf66dbbac67d7dca0df5f92da98c --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/98/326898/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index d16a844..468d2eb 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -140,7 +140,7 @@ 'db2046' => 400, # 2.9TB 160GB 'db2053' => 100, # 2.9TB 160GB, dump (inactive), vslow 'db2060' => 100, # 3.3TB 160GB, api - 'db2067' => 400, # 3.3TB 160GB +# 'db2067' => 400, # 3.3TB 160GB #T151552 ], 's7' => [ 'db2029' => 0, # 2.9TB 96GB, master -- To view, visit https://gerrit.wikimedia.org/r/326898 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I607361c5450edf66dbbac67d7dca0df5f92da98c Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2068
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/327145 ) Change subject: db-codfw.php: Depool db2068 .. db-codfw.php: Depool db2068 db2068 is going to be used as a clone source for dbstore2001 and needs to be depooled Bug: T151552 Change-Id: Ie6c57191e4efb5a825e6363b5c1fd7cc4c200d6b --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/45/327145/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 2739757..538f955 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -148,7 +148,7 @@ 'db2047' => 400, # 2.9TB 160GB 'db2054' => 200, # 2.9TB 160GB, dump (inactive), vslow 'db2061' => 200, # 3.3TB 160GB, api - 'db2068' => 300, # 3.3TB 160GB +# 'db2068' => 300, # 3.3TB 160GB #T151552 ], 'silver' => [ 'silver' => 100, # I have no idea if this is right -- To view, visit https://gerrit.wikimedia.org/r/327145 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ie6c57191e4efb5a825e6363b5c1fd7cc4c200d6b Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1092"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/327526 to review the following change. Change subject: Revert "db-eqiad.php: Depool db1092" .. Revert "db-eqiad.php: Depool db1092" ALTER table done This reverts commit 4b8064d9974a2f33da7d2ca69a3010f1c648112d. Change-Id: I191ce48e8d2cc8c363d83bce7ff9c898a485cbb2 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/26/327526/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 7f6d12a..4bec7dd 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -146,7 +146,7 @@ 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB -# 'db1092' => 500, # 3.6TB 512GB #T150644 + 'db1092' => 500, # 3.6TB 512GB ], 's6' => [ 'db1050' => 0, # 2.8TB 64GB, master -- To view, visit https://gerrit.wikimedia.org/r/327526 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I191ce48e8d2cc8c363d83bce7ff9c898a485cbb2 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1045
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/327701 ) Change subject: db-eqiad.php: Depool db1045 .. db-eqiad.php: Depool db1045 db1045 needs an alter table. Pool db1082 for the vslow and dump traffic while db1045 is out Bug: T150644 Change-Id: Ic083c1b78fda78ec8a0d24c06f2d3374df44f898 --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/01/327701/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 4bec7dd..e166482 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -141,10 +141,10 @@ 's5' => [ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager - 'db1045' => 0, # 1.4TB 64GB, vslow, dump +# 'db1045' => 0, # 1.4TB 64GB, vslow, dump #T150644 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB + 'db1082' => 1, # 3.6TB 512GBi #temporarily serving vslow,dump #T150644 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -352,10 +352,10 @@ ], 's5' => [ 'vslow' => [ - 'db1045' => 1, + 'db1082' => 1, ], 'dump' => [ - 'db1045' => 1, + 'db1082' => 1, ], 'api' => [ 'db1070' => 1, -- To view, visit https://gerrit.wikimedia.org/r/327701 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ic083c1b78fda78ec8a0d24c06f2d3374df44f898 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/software[master]: osc_host.sh: Added skip-ssl for the connection
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/327703 ) Change subject: osc_host.sh: Added skip-ssl for the connection .. osc_host.sh: Added skip-ssl for the connection After enabling TLS on neodymium this connection needs the --skip-ssl option to be able to login and to do the ALTER tables Bug: T111654 Change-Id: I95fdc8591c978d4f1f65a11ff2f99a58bc14f5ec --- M dbtools/osc_host.sh 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/software refs/changes/03/327703/1 diff --git a/dbtools/osc_host.sh b/dbtools/osc_host.sh index 9cd6b2a..67f90bd 100755 --- a/dbtools/osc_host.sh +++ b/dbtools/osc_host.sh @@ -120,7 +120,7 @@ exit 1 fi -mysql="mysql -h $host -u $user -P $port" +mysql="mysql --skip-ssl -h $host -u $user -P $port" if ! $mysql -e "status"; then echo "Connect failed: $user@$host:$port" -- To view, visit https://gerrit.wikimedia.org/r/327703 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I95fdc8591c978d4f1f65a11ff2f99a58bc14f5ec Gerrit-PatchSet: 1 Gerrit-Project: operations/software Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1045"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/327708 to review the following change. Change subject: Revert "db-eqiad.php: Depool db1045" .. Revert "db-eqiad.php: Depool db1045" db1045 finished its ALTER and it is ready to go back to the pool This reverts commit 41802f71ffb67ab80796397eaf8990d4bbb4a104. Change-Id: I637b338d82a82137709aedc2f9e9e08c1c9ee9e9 --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/08/327708/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index e166482..4bec7dd 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -141,10 +141,10 @@ 's5' => [ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager -# 'db1045' => 0, # 1.4TB 64GB, vslow, dump #T150644 + 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 1, # 3.6TB 512GBi #temporarily serving vslow,dump #T150644 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -352,10 +352,10 @@ ], 's5' => [ 'vslow' => [ - 'db1082' => 1, + 'db1045' => 1, ], 'dump' => [ - 'db1082' => 1, + 'db1045' => 1, ], 'api' => [ 'db1070' => 1, -- To view, visit https://gerrit.wikimedia.org/r/327708 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I637b338d82a82137709aedc2f9e9e08c1c9ee9e9 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad: Depool db1087"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/326929 to review the following change. Change subject: Revert "db-eqiad: Depool db1087" .. Revert "db-eqiad: Depool db1087" Maintenance is finished This reverts commit 5ff6a6b4457402a6c168b572e97a8dd7e350cbe7. Change-Id: I6f678f0770462e5a01c9a83a415c3bf916fbea44 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/29/326929/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 2567b5b..e05a15c 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -145,7 +145,7 @@ 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB -# 'db1087' => 500, # 3.6TB 512GB #T148967 + 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], 's6' => [ -- To view, visit https://gerrit.wikimedia.org/r/326929 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I6f678f0770462e5a01c9a83a415c3bf916fbea44 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad: Depool db1087
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326926 ) Change subject: db-eqiad: Depool db1087 .. db-eqiad: Depool db1087 db1087 needs an index done Bug: T148967 Change-Id: Ia515f23132572f28feb7155312d0bd36a8483bfb --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/26/326926/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index c87a276..61e9d15 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -145,7 +145,7 @@ 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB - 'db1087' => 500, # 3.6TB 512GB +# 'db1087' => 500, # 3.6TB 512GB #T148967 'db1092' => 500, # 3.6TB 512GB ], 's6' => [ -- To view, visit https://gerrit.wikimedia.org/r/326926 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ia515f23132572f28feb7155312d0bd36a8483bfb Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Repool db2064
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326927 ) Change subject: db-codfw.php: Repool db2064 .. db-codfw.php: Repool db2064 db2064 is ready to go back to the pool after finishing its maintenance Bug: T151552 Change-Id: I543c8a85b94e863bbf2bb45c6748e02ff40d0337 --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/27/326927/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 468d2eb..1d48096 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -109,7 +109,7 @@ 'db2049' => 400, # 2.9TB 160GB, 'db2056' => 50, # 3.3TB 160GB, dump (inactive), vslow 'db2063' => 100, # 3.3TB 160GB, api -# 'db2064' => 400, # 3.3TB 160GB #T151552 + 'db2064' => 400, # 3.3TB 160GB ], /* s3 */ 'DEFAULT' => [ 'db2018' => 0, # 2.9TB 96GB, master -- To view, visit https://gerrit.wikimedia.org/r/326927 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I543c8a85b94e863bbf2bb45c6748e02ff40d0337 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: check_mariadb.pl: Fix small display issue
Marostegui has submitted this change and it was merged. ( https://gerrit.wikimedia.org/r/326124 ) Change subject: check_mariadb.pl: Fix small display issue .. check_mariadb.pl: Fix small display issue The current regular expression was showing the following on Icinga: CRITICAL slave_sql_state Slave_SQL_Running: No, Errno: 1062, Errmsg: Error 'Duplicate entry 'MANUALLY REMOVED' for key 'PRIMARY'' on query. Default database: 'commonswiki'. Query: [snipped]2 The value "2" wasn't being filtered. This commit has been tested on dbstore1001 (which is having that issue) and it displays the following instead: CRITICAL slave_sql_state Slave_SQL_Running: No, Errno: 1062, Errmsg: Error 'Duplicate entry 'MANUALLY REMOVED' for key 'PRIMARY'' on query. Default database: 'commonswiki'. [Query snipped] The new script can be tested at dbstore1001:/home/marostegui Bug: T152766 Change-Id: Ie14d1f963bae7d70b642cc6e9278836c2c330cd5 --- M modules/icinga/files/check_mariadb.pl 1 file changed, 1 insertion(+), 1 deletion(-) Approvals: Marostegui: Looks good to me, approved jenkins-bot: Verified Jcrespo: Looks good to me, but someone else must approve diff --git a/modules/icinga/files/check_mariadb.pl b/modules/icinga/files/check_mariadb.pl index 489347a..2f5766d 100755 --- a/modules/icinga/files/check_mariadb.pl +++ b/modules/icinga/files/check_mariadb.pl @@ -153,7 +153,7 @@ exit($EOK); } # sanitize the query for icinga: - $status->{Last_SQL_Error} =~ s/Query:\s+'(.*)'/Query: [snipped]/; +$status->{Last_SQL_Error} =~ s/Query.*$/[Query snipped]/; # Both SQL and IO threads running? OK if ($status->{Slave_SQL_Running} eq "Yes") { -- To view, visit https://gerrit.wikimedia.org/r/326124 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ie14d1f963bae7d70b642cc6e9278836c2c330cd5 Gerrit-PatchSet: 6 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1082"
Marostegui has submitted this change and it was merged. ( https://gerrit.wikimedia.org/r/326934 ) Change subject: Revert "db-eqiad.php: Depool db1082" .. Revert "db-eqiad.php: Depool db1082" Maintenance is finished This reverts commit b3e6b625edc3a910178e0ea780bb632d2b9ddf8a. Change-Id: I48fef6774ebcaaf3c099caf2ae6a1e34178d2b74 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) Approvals: Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 3738f5f..b8ab783 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api -# 'db1082' => 500, # 3.6TB 512GB #T148967 #T69223 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/326934 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I48fef6774ebcaaf3c099caf2ae6a1e34178d2b74 Gerrit-PatchSet: 2 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1045"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/326941 to review the following change. Change subject: Revert "db-eqiad.php: Depool db1045" .. Revert "db-eqiad.php: Depool db1045" db1045's maintenance finished This reverts commit f44514bbc9e43cb7462ee8b17bb4442e3851ba51. Change-Id: I8742807086c1e591a942f759a2dd76d9a2ef2083 --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/41/326941/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 31bd8bd..b8ab783 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -141,10 +141,10 @@ 's5' => [ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager -# 'db1045' => 0, # 1.4TB 64GB, vslow, dump + 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 1, # 3.6TB 512GB #temporarily serving vslow,dump #T148967 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -352,10 +352,10 @@ ], 's5' => [ 'vslow' => [ - 'db1082' => 1, + 'db1045' => 1, ], 'dump' => [ - 'db1082' => 1, + 'db1045' => 1, ], 'api' => [ 'db1070' => 1, -- To view, visit https://gerrit.wikimedia.org/r/326941 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I8742807086c1e591a942f759a2dd76d9a2ef2083 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1045
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326935 ) Change subject: db-eqiad.php: Depool db1045 .. db-eqiad.php: Depool db1045 db1045 needs an alter table. Pool db1082 for the vslow and dump traffic while db1045 is out Bug: T148967 Change-Id: I7c6c5339be54538e708381f6db4619e90633f4a9 --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/35/326935/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index b8ab783..31bd8bd 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -141,10 +141,10 @@ 's5' => [ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager - 'db1045' => 0, # 1.4TB 64GB, vslow, dump +# 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB + 'db1082' => 1, # 3.6TB 512GB #temporarily serving vslow,dump #T148967 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -352,10 +352,10 @@ ], 's5' => [ 'vslow' => [ - 'db1045' => 1, + 'db1082' => 1, ], 'dump' => [ - 'db1045' => 1, + 'db1082' => 1, ], 'api' => [ 'db1070' => 1, -- To view, visit https://gerrit.wikimedia.org/r/326935 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I7c6c5339be54538e708381f6db4619e90633f4a9 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1082
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326931 ) Change subject: db-eqiad.php: Depool db1082 .. db-eqiad.php: Depool db1082 db1082 needs a new index and a new column Bug: T148967 Bug: T69223 Change-Id: Iae2e4203a858804fce24be0d14fd28a1cccda49f --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/31/326931/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index e05a15c..9acc4f3 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB +# 'db1082' => 500, # 3.6TB 512GB #T148967 #T69223 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/326931 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Iae2e4203a858804fce24be0d14fd28a1cccda49f Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1082"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/326934 to review the following change. Change subject: Revert "db-eqiad.php: Depool db1082" .. Revert "db-eqiad.php: Depool db1082" Maintenance is finished This reverts commit b3e6b625edc3a910178e0ea780bb632d2b9ddf8a. Change-Id: I48fef6774ebcaaf3c099caf2ae6a1e34178d2b74 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/34/326934/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 9acc4f3..e05a15c 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api -# 'db1082' => 500, # 3.6TB 512GB #T148967 #T69223 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/326934 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I48fef6774ebcaaf3c099caf2ae6a1e34178d2b74 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Added gtid_domain_id to its own variable
Marostegui has submitted this change and it was merged. ( https://gerrit.wikimedia.org/r/326086 ) Change subject: mariadb: Added gtid_domain_id to its own variable .. mariadb: Added gtid_domain_id to its own variable We were using server_id variable for gtid_domain_id, but it is better to make them independent, so we can change any of them in the future without affecting the other one. Once that is done, changing the variable in the misc shard hosts to use the new variable. More info: https://gerrit.wikimedia.org/r/#/c/326080/ Bug: T149418 Change-Id: I055849e3944743118e89950a57584b22837573ec --- M modules/mariadb M templates/mariadb/misc.my.cnf.erb 2 files changed, 2 insertions(+), 2 deletions(-) Approvals: Marostegui: Looks good to me, approved jenkins-bot: Verified Jcrespo: Looks good to me, but someone else must approve diff --git a/modules/mariadb b/modules/mariadb index c50a383..729063a 16 --- a/modules/mariadb +++ b/modules/mariadb @@ -1 +1 @@ -Subproject commit c50a3838bf31526c0e2392908b16ec009682cd34 +Subproject commit 729063a0eed1b6c056b06266551fc5440d3524d7 diff --git a/templates/mariadb/misc.my.cnf.erb b/templates/mariadb/misc.my.cnf.erb index d58bd51..e1728c3 100644 --- a/templates/mariadb/misc.my.cnf.erb +++ b/templates/mariadb/misc.my.cnf.erb @@ -97,7 +97,7 @@ # masters but for consistency it should be set in all of them. # https://mariadb.com/kb/en/mariadb/gtid/ -gtid_domain_id = <%= @server_id %> +gtid_domain_id = <%= @gtid_domain_id %> <% if @ssl == 'on' %> # ssl -- To view, visit https://gerrit.wikimedia.org/r/326086 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I055849e3944743118e89950a57584b22837573ec Gerrit-PatchSet: 2 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: Volans Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-codfw.php: Depool db2067"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/326997 to review the following change. Change subject: Revert "db-codfw.php: Depool db2067" .. Revert "db-codfw.php: Depool db2067" db2067 has finished its maintenance This reverts commit f613ea5c63fcb2a646bf5840fe390650108e8b28. Change-Id: Icd9ac1a27cd082b341fdbcac35e0a7a67bcc888e --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/97/326997/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 468d2eb..d16a844 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -140,7 +140,7 @@ 'db2046' => 400, # 2.9TB 160GB 'db2053' => 100, # 2.9TB 160GB, dump (inactive), vslow 'db2060' => 100, # 3.3TB 160GB, api -# 'db2067' => 400, # 3.3TB 160GB #T151552 + 'db2067' => 400, # 3.3TB 160GB ], 's7' => [ 'db2029' => 0, # 2.9TB 96GB, master -- To view, visit https://gerrit.wikimedia.org/r/326997 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Icd9ac1a27cd082b341fdbcac35e0a7a67bcc888e Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1045
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325745 Change subject: db-eqiad.php: Depool db1045 .. db-eqiad.php: Depool db1045 db1045 needs an ALTER table. Using db1082 to temporarily server vslow and dump service. Bug: T148967 Change-Id: Ie6441ab5f2ef561cf3e1bc8bef17d26ea40745dc --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/45/325745/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index c9d6a52..536f09d 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -141,10 +141,10 @@ 's5' => [ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager - 'db1045' => 0, # 1.4TB 64GB, vslow, dump +# 'db1045' => 0, # 1.4TB 64GB, vslow, dump #T148967 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB + 'db1082' => 1, # 3.6TB 512GB #Serving vslow,dump temporarily #T148967 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -353,10 +353,10 @@ ], 's5' => [ 'vslow' => [ - 'db1045' => 1, + 'db1082' => 1, ], 'dump' => [ - 'db1045' => 1, + 'db1082' => 1, ], 'api' => [ 'db1070' => 1, -- To view, visit https://gerrit.wikimedia.org/r/325745 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ie6441ab5f2ef561cf3e1bc8bef17d26ea40745dc Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Added gtid_domain_id variable
Marostegui has submitted this change and it was merged. Change subject: mariadb: Added gtid_domain_id variable .. mariadb: Added gtid_domain_id variable Adding the gtid_domain_id variable to labs hosts. This variable is not used not, but it is harmless to have it enable in this role. It will be used in the future once we switch to GTID and multisource Bug: T149418 Bug: T152194 Change-Id: Ia3a47e96d391f0e7742a271fcd800802ff10fd3e --- M templates/mariadb/labsdb-replica.my.cnf.erb 1 file changed, 2 insertions(+), 0 deletions(-) Approvals: Jcrespo: Looks good to me, but someone else must approve Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/templates/mariadb/labsdb-replica.my.cnf.erb b/templates/mariadb/labsdb-replica.my.cnf.erb index dfe8f39..21a44b3 100644 --- a/templates/mariadb/labsdb-replica.my.cnf.erb +++ b/templates/mariadb/labsdb-replica.my.cnf.erb @@ -25,6 +25,8 @@ port = 3306 datadir= <%= @datadir %> tmpdir = <%= @tmpdir %> +# needed for multisource replication + GTID. +gtid_domain_id = <%= @server_id %> server_id = <%= @server_id %> read_only = 0 -- To view, visit https://gerrit.wikimedia.org/r/325303 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ia3a47e96d391f0e7742a271fcd800802ff10fd3e Gerrit-PatchSet: 2 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1045"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325768 Change subject: Revert "db-eqiad.php: Depool db1045" .. Revert "db-eqiad.php: Depool db1045" db1045 finished its ALTER table and it is ready to be back in the pool This reverts commit e62d3724c94ea3edd48345d0a77fef5c03c12786. Change-Id: I585e9df1c6ae75ba8bb8d5343bb135d7497a1a9a --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/68/325768/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 536f09d..c9d6a52 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -141,10 +141,10 @@ 's5' => [ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager -# 'db1045' => 0, # 1.4TB 64GB, vslow, dump #T148967 + 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 1, # 3.6TB 512GB #Serving vslow,dump temporarily #T148967 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -353,10 +353,10 @@ ], 's5' => [ 'vslow' => [ - 'db1082' => 1, + 'db1045' => 1, ], 'dump' => [ - 'db1082' => 1, + 'db1045' => 1, ], 'api' => [ 'db1070' => 1, -- To view, visit https://gerrit.wikimedia.org/r/325768 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I585e9df1c6ae75ba8bb8d5343bb135d7497a1a9a Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Move eventlogging class to a single file
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325764 Change subject: mariadb: Move eventlogging class to a single file .. mariadb: Move eventlogging class to a single file We thought that we could slowly start moving things out from mariadb.pp into single files which will make things clearer and easier to manage So moving eventlogging class into its own file under the mariadb directory Bug: T152081 Change-Id: I4b59573462882823cb0d1993d7149024cd59cf2e --- M modules/role/manifests/mariadb.pp A modules/role/manifests/mariadb/eventlogging.pp 2 files changed, 58 insertions(+), 59 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/64/325764/1 diff --git a/modules/role/manifests/mariadb.pp b/modules/role/manifests/mariadb.pp index 4c53131..3b26176 100644 --- a/modules/role/manifests/mariadb.pp +++ b/modules/role/manifests/mariadb.pp @@ -351,65 +351,6 @@ } } -# Eventlogging needs to be sandboxed by itself. It can consume resources -# unpredictably, especially during backfilling. It also benefits greatly -# from a setup tuned for TokuDB. -class role::mariadb::misc::eventlogging( -$shard = 'm4', -$master = false, -) { - -system::role { 'role::mariadb::misc': -description => 'Eventlogging Database', -} - -$mysql_role = $master ? { -true => 'master', -false => 'slave', -} - -include standard -include role::mariadb::monitor::dba -include passwords::misc::scripts -include role::mariadb::ferm - -class {'role::mariadb::groups': -mysql_group => 'misc', -mysql_shard => $shard, -mysql_role => $mysql_role, -} - -include mariadb::packages_wmf -include mariadb::service - -$read_only = $master ? { -true => 0, -false => 1, -} - -class { 'mariadb::config': -config=> 'mariadb/eventlogging.my.cnf.erb', -datadir => '/srv/sqldata', -tmpdir=> '/srv/tmp', -read_only => $read_only, -ssl => 'puppet-cert', -p_s => 'off', -binlog_format => 'MIXED', -} - -class { 'role::mariadb::grants::production': -shard=> $shard, -prompt => "EVENTLOGGING ${shard}", -password => $passwords::misc::scripts::mysql_root_pass, -} - -class { 'mariadb::heartbeat': -shard => $shard, -datacenter => $::site, -enabled=> $master, -} -} - # Beta Cluster Master # Should add separate role for slaves class role::mariadb::beta { diff --git a/modules/role/manifests/mariadb/eventlogging.pp b/modules/role/manifests/mariadb/eventlogging.pp new file mode 100644 index 000..248c34e --- /dev/null +++ b/modules/role/manifests/mariadb/eventlogging.pp @@ -0,0 +1,58 @@ +# Eventlogging needs to be sandboxed by itself. It can consume resources +# unpredictably, especially during backfilling. It also benefits greatly +# from a setup tuned for TokuDB. +class role::mariadb::misc::eventlogging( +$shard = 'm4', +$master = false, +) { + +system::role { 'role::mariadb::misc': +description => 'Eventlogging Database', +} + +$mysql_role = $master ? { +true => 'master', +false => 'slave', +} + +include standard +include role::mariadb::monitor::dba +include passwords::misc::scripts +include role::mariadb::ferm + +class {'role::mariadb::groups': +mysql_group => 'misc', +mysql_shard => $shard, +mysql_role => $mysql_role, +} + +include mariadb::packages_wmf +include mariadb::service + +$read_only = $master ? { +true => 0, +false => 1, +} + +class { 'mariadb::config': +config=> 'mariadb/eventlogging.my.cnf.erb', +datadir => '/srv/sqldata', +tmpdir=> '/srv/tmp', +read_only => $read_only, +ssl => 'puppet-cert', +p_s => 'off', +binlog_format => 'MIXED', +} + +class { 'role::mariadb::grants::production': +shard=> $shard, +prompt => "EVENTLOGGING ${shard}", +password => $passwords::misc::scripts::mysql_root_pass, +} + +class { 'mariadb::heartbeat': +shard => $shard, +datacenter => $::site, +enabled=> $master, +} +} -- To view, visit https://gerrit.wikimedia.org/r/325764 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I4b59573462882823cb0d1993d7149024cd59cf2e Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1070 for maintenance"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/327472 to review the following change. Change subject: Revert "db-eqiad.php: Depool db1070 for maintenance" .. Revert "db-eqiad.php: Depool db1070 for maintenance" db1070 has finished its maintenance This reverts commit af91d2fe10caa71369a8b281b78b8d84a57782f4. Change-Id: Ife54c6979019af4eba4834344d58790c1f694033 --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 5 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/72/327472/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 376adf0..4bec7dd 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -142,9 +142,9 @@ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager 'db1045' => 0, # 1.4TB 64GB, vslow, dump -# 'db1070' => 50, # 2.8TB 160GB, api, old master #T150644 + 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 300, # 3.6TB 512GB #temporarily serving API #T150644 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -358,9 +358,8 @@ 'db1045' => 1, ], 'api' => [ -# 'db1070' => 1, - 'db1071' => 3, - 'db1082' => 1, + 'db1070' => 1, + 'db1071' => 1, ], 'watchlist' => [ 'db1026' => 1, -- To view, visit https://gerrit.wikimedia.org/r/327472 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ife54c6979019af4eba4834344d58790c1f694033 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1071 for maintenance
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/327459 ) Change subject: db-eqiad.php: Depool db1071 for maintenance .. db-eqiad.php: Depool db1071 for maintenance db1071 needs an ALTER table. It is serving API, so in order to help with the API load I have pooled db1082 in temporarily Bug: T150644 Change-Id: I952c11d5e6fbdf69a2531ea5959379a8b800ea84 --- M wmf-config/db-eqiad.php 1 file changed, 5 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/59/327459/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 4bec7dd..03568f6 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -143,8 +143,8 @@ 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master - 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB +# 'db1071' => 50, # 2.8TB 160GB, api #T150644 + 'db1082' => 300, # 3.6TB 512GB #temporarily serving api #T150644 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -358,8 +358,9 @@ 'db1045' => 1, ], 'api' => [ - 'db1070' => 1, - 'db1071' => 1, + 'db1070' => 3, +# 'db1071' => 1, + 'db1082' => 1, ], 'watchlist' => [ 'db1026' => 1, -- To view, visit https://gerrit.wikimedia.org/r/327459 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I952c11d5e6fbdf69a2531ea5959379a8b800ea84 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1071 for maintenance"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/327463 to review the following change. Change subject: Revert "db-eqiad.php: Depool db1071 for maintenance" .. Revert "db-eqiad.php: Depool db1071 for maintenance" db1071 alter finished, ready to go back to the pool This reverts commit 5cbea5794204722edde873529871fb8318f2b5b9. Change-Id: I31becf035bc3acc690bd12d46f7b6604a3e987fd --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 5 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/63/327463/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 03568f6..4bec7dd 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -143,8 +143,8 @@ 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master -# 'db1071' => 50, # 2.8TB 160GB, api #T150644 - 'db1082' => 300, # 3.6TB 512GB #temporarily serving api #T150644 + 'db1071' => 50, # 2.8TB 160GB, api + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -358,9 +358,8 @@ 'db1045' => 1, ], 'api' => [ - 'db1070' => 3, -# 'db1071' => 1, - 'db1082' => 1, + 'db1070' => 1, + 'db1071' => 1, ], 'watchlist' => [ 'db1026' => 1, -- To view, visit https://gerrit.wikimedia.org/r/327463 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I31becf035bc3acc690bd12d46f7b6604a3e987fd Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1070 for maintenance
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/327464 ) Change subject: db-eqiad.php: Depool db1070 for maintenance .. db-eqiad.php: Depool db1070 for maintenance db1070 needs an ALTER table. It is serving API, so in order to help with the API load I have pooled db1082 in temporarily Bug: T150644 Change-Id: I761b0e8b4d6ae8233ecbbb192f469956e1ecbf9c --- M wmf-config/db-eqiad.php 1 file changed, 5 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/64/327464/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 4bec7dd..376adf0 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -142,9 +142,9 @@ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager 'db1045' => 0, # 1.4TB 64GB, vslow, dump - 'db1070' => 50, # 2.8TB 160GB, api, old master +# 'db1070' => 50, # 2.8TB 160GB, api, old master #T150644 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB + 'db1082' => 300, # 3.6TB 512GB #temporarily serving API #T150644 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -358,8 +358,9 @@ 'db1045' => 1, ], 'api' => [ - 'db1070' => 1, - 'db1071' => 1, +# 'db1070' => 1, + 'db1071' => 3, + 'db1082' => 1, ], 'watchlist' => [ 'db1026' => 1, -- To view, visit https://gerrit.wikimedia.org/r/327464 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I761b0e8b4d6ae8233ecbbb192f469956e1ecbf9c Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-codfw.php: Depool db2068"
Hello jenkins-bot, Jcrespo, I'd like you to do a code review. Please visit https://gerrit.wikimedia.org/r/327505 to review the following change. Change subject: Revert "db-codfw.php: Depool db2068" .. Revert "db-codfw.php: Depool db2068" db2068 maintenance finished This reverts commit 264195879e7ee03c7f09872343f4778fc9f6ff7e. Change-Id: I0afbd729d783b69f48d3df77aebfee6faf432ad7 --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/05/327505/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 538f955..2739757 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -148,7 +148,7 @@ 'db2047' => 400, # 2.9TB 160GB 'db2054' => 200, # 2.9TB 160GB, dump (inactive), vslow 'db2061' => 200, # 3.3TB 160GB, api -# 'db2068' => 300, # 3.3TB 160GB #T151552 + 'db2068' => 300, # 3.3TB 160GB ], 'silver' => [ 'silver' => 100, # I have no idea if this is right -- To view, visit https://gerrit.wikimedia.org/r/327505 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I0afbd729d783b69f48d3df77aebfee6faf432ad7 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1092
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/327506 ) Change subject: db-eqiad.php: Depool db1092 .. db-eqiad.php: Depool db1092 db1092 needs an alter table and needs to be depooled Bug: T150644 Change-Id: I2cd82a6ac56d1038b48ce8c4219570bd3e97c228 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/06/327506/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 4bec7dd..7f6d12a 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -146,7 +146,7 @@ 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB - 'db1092' => 500, # 3.6TB 512GB +# 'db1092' => 500, # 3.6TB 512GB #T150644 ], 's6' => [ 'db1050' => 0, # 2.8TB 64GB, master -- To view, visit https://gerrit.wikimedia.org/r/327506 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I2cd82a6ac56d1038b48ce8c4219570bd3e97c228 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Enable gtid_domain_id - phabricator hosts
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/326446 ) Change subject: mariadb: Enable gtid_domain_id - phabricator hosts .. mariadb: Enable gtid_domain_id - phabricator hosts The only hosts pending in the misc shards to get the flag enabled are the ones that belong to phabricator cluster. The flag has been enabled for weeks on all the other hosts of all the misc shards. Bug: T149418 Change-Id: I1f16f893a62926905150a31baac0f788fb509d8f --- M templates/mariadb/phabricator.my.cnf.erb 1 file changed, 8 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/46/326446/1 diff --git a/templates/mariadb/phabricator.my.cnf.erb b/templates/mariadb/phabricator.my.cnf.erb index 6d4d655..28983f6 100644 --- a/templates/mariadb/phabricator.my.cnf.erb +++ b/templates/mariadb/phabricator.my.cnf.erb @@ -28,6 +28,14 @@ datadir= <%= @datadir %> tmpdir = <%= @tmpdir %> server_id = <%= @server_id %> + +# gtid_domain_id flag is needed for multisource replication and GTID. +# Strictly it is only needed on masters or servers that can potentially be +# masters but for consistency it should be set in all of them. +# https://mariadb.com/kb/en/mariadb/gtid/ + +gtid_domain_id = <%= @gtid_domain_id %> + <% if @sql_mode != '' -%> sql-mode = <%= @sql_mode %> <% end -%> -- To view, visit https://gerrit.wikimedia.org/r/326446 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I1f16f893a62926905150a31baac0f788fb509d8f Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/dns[master]: wmnet: Change es2 and es3 master
Marostegui has submitted this change and it was merged. Change subject: wmnet: Change es2 and es3 master .. wmnet: Change es2 and es3 master es2 master has been swapped, es1011 is now the new master. es3 master has been swapped, es1014 is now the master So updating the alias now Bug: T151995 Change-Id: Ief77832e0bc9ec54c4ab4ab54a29d2d9523ad9fd --- M templates/wmnet 1 file changed, 2 insertions(+), 2 deletions(-) Approvals: Jcrespo: Looks good to me, but someone else must approve Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/templates/wmnet b/templates/wmnet index 718a0c9..58b8b1f 100644 --- a/templates/wmnet +++ b/templates/wmnet @@ -52,8 +52,8 @@ m5-slave5M IN CNAMEdb2030.codfw.wmnet. x1-master 5M IN CNAMEdb1031.eqiad.wmnet. x1-slave5M IN CNAMEdb1029.eqiad.wmnet. -es2-master 5M IN CNAMEes1015.eqiad.wmnet. -es3-master 5M IN CNAMEes1019.eqiad.wmnet. +es2-master 5M IN CNAMEes1011.eqiad.wmnet. +es3-master 5M IN CNAMEes1014.eqiad.wmnet. pc1-master 5M IN CNAMEpc1004.eqiad.wmnet. pc2-master 5M IN CNAMEpc1005.eqiad.wmnet. pc3-master 5M IN CNAMEpc1006.eqiad.wmnet. -- To view, visit https://gerrit.wikimedia.org/r/324695 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ief77832e0bc9ec54c4ab4ab54a29d2d9523ad9fd Gerrit-PatchSet: 2 Gerrit-Project: operations/dns Gerrit-Branch: master Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1070 for maintenance"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/324717 Change subject: Revert "db-eqiad.php: Depool db1070 for maintenance" .. Revert "db-eqiad.php: Depool db1070 for maintenance" db1070 finished the ALTER table so it is ready to go back in This reverts commit c7f13e80dfec811130bca4121f2ce58ef86f1377. Change-Id: I49ee76fff3831b334c1e62d3be58dec0af6c6378 --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 5 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/17/324717/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index dda1442..35c6566 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -142,9 +142,9 @@ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager 'db1045' => 0, # 1.4TB 64GB, vslow, dump -# 'db1070' => 50, # 2.8TB 160GB, api, old master #T148967 + 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 300, # 3.6TB 512GB, api #Temporarily serving api #T148967 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -359,9 +359,8 @@ 'db1045' => 1, ], 'api' => [ - 'db1082' => 1, -# 'db1070' => 1, - 'db1071' => 3, + 'db1070' => 1, + 'db1071' => 1, ], 'watchlist' => [ 'db1026' => 1, -- To view, visit https://gerrit.wikimedia.org/r/324717 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I49ee76fff3831b334c1e62d3be58dec0af6c6378 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2045
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/324864 Change subject: db-codfw.php: Depool db2045 .. db-codfw.php: Depool db2045 db2045 needs an ALTER table. Bug: T150644 Change-Id: I7d658474927f73370ee48adf99bf2e94166641fa --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/64/324864/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 2739757..e079afa 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -129,7 +129,7 @@ 's5' => [ 'db2023' => 0, # 2.9TB 96GB, master 'db2038' => 50, # 2.9TB 160GB, rc, log - 'db2045' => 400, # 2.9TB 160GB +# 'db2045' => 400, # 2.9TB 160GB #T150644 'db2052' => 50, # 2.9TB 160GB, dump (inactive), vslow 'db2059' => 100, # 3.3TB 160GB, api 'db2066' => 400, # 3.3TB 160GB -- To view, visit https://gerrit.wikimedia.org/r/324864 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I7d658474927f73370ee48adf99bf2e94166641fa Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-codfw.php: Depool db2045"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/324873 Change subject: Revert "db-codfw.php: Depool db2045" .. Revert "db-codfw.php: Depool db2045" db2045 has finished the ALTER table, pool it back This reverts commit 9dd1b1de389a5c62dd474f2c2ec7a11da30232d0. Change-Id: If8bffb5fedcf3c3bc98665cfd156e0675493edb4 --- M wmf-config/db-codfw.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/73/324873/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index e079afa..2739757 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -129,7 +129,7 @@ 's5' => [ 'db2023' => 0, # 2.9TB 96GB, master 'db2038' => 50, # 2.9TB 160GB, rc, log -# 'db2045' => 400, # 2.9TB 160GB #T150644 + 'db2045' => 400, # 2.9TB 160GB 'db2052' => 50, # 2.9TB 160GB, dump (inactive), vslow 'db2059' => 100, # 3.3TB 160GB, api 'db2066' => 400, # 3.3TB 160GB -- To view, visit https://gerrit.wikimedia.org/r/324873 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: If8bffb5fedcf3c3bc98665cfd156e0675493edb4 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1071 for maintenance
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/324861 Change subject: db-eqiad.php: Depool db1071 for maintenance .. db-eqiad.php: Depool db1071 for maintenance db1071 needs an ALTER table. It is serving API, so in order to help with the API load I have pooled db1082 in temporarily Bug: T148967 Change-Id: Ie0174d05d7553ab6e580524659bdbbb031a84847 --- M wmf-config/db-eqiad.php 1 file changed, 5 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/61/324861/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index c9d6a52..2a389c0 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -143,8 +143,8 @@ 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master - 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB +# 'db1071' => 50, # 2.8TB 160GB, api #T148967 + 'db1082' => 300, # 3.6TB 512GB, api #Temporarily serving api #T148967 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -359,8 +359,9 @@ 'db1045' => 1, ], 'api' => [ - 'db1070' => 1, - 'db1071' => 1, + 'db1082' => 1, + 'db1070' => 3, +# 'db1071' => 1, ], 'watchlist' => [ 'db1026' => 1, -- To view, visit https://gerrit.wikimedia.org/r/324861 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ie0174d05d7553ab6e580524659bdbbb031a84847 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1087"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325313 Change subject: Revert "db-eqiad.php: Depool db1087" .. Revert "db-eqiad.php: Depool db1087" db1087 has finished its ALTER table and it is ready to be pooled back This reverts commit 0161ae80fea17854c8702694f07d489ae28b2011. Change-Id: Ib1ecc4446177c1afdbe38868698cf6876211967a --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/13/325313/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 5905050..c9d6a52 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -145,7 +145,7 @@ 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB -# 'db1087' => 500, # 3.6TB 512GB #T148967 + 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], 's6' => [ -- To view, visit https://gerrit.wikimedia.org/r/325313 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ib1ecc4446177c1afdbe38868698cf6876211967a Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: labsdb-replica: Disable parallel replication
Marostegui has submitted this change and it was merged. Change subject: labsdb-replica: Disable parallel replication .. labsdb-replica: Disable parallel replication As we have done in sanitarium, we should disable parallel replication in the labs servers. Bug: T152194 Change-Id: I8c98ae4eb91bd2c93036a2469b7262ae047f5ead --- M templates/mariadb/labsdb-replica.my.cnf.erb 1 file changed, 4 insertions(+), 0 deletions(-) Approvals: Jcrespo: Looks good to me, but someone else must approve Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/templates/mariadb/labsdb-replica.my.cnf.erb b/templates/mariadb/labsdb-replica.my.cnf.erb index a6fa163..dfe8f39 100644 --- a/templates/mariadb/labsdb-replica.my.cnf.erb +++ b/templates/mariadb/labsdb-replica.my.cnf.erb @@ -34,6 +34,10 @@ log_bin log_slave_updates +slave_parallel_mode= none +slave_parallel_threads = 0 +slave_parallel_max_queued = 16M + skip-external-locking skip-name-resolve temp-pool -- To view, visit https://gerrit.wikimedia.org/r/325255 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: I8c98ae4eb91bd2c93036a2469b7262ae047f5ead Gerrit-PatchSet: 2 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: Revert "db-eqiad.php: Depool db1082"
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325277 Change subject: Revert "db-eqiad.php: Depool db1082" .. Revert "db-eqiad.php: Depool db1082" db1082 finished the ALTER table and it is ready to go back in the pool This reverts commit 0881436365874ead7134427e149d09e7409147e8. Change-Id: Ifcdff4b21002357f9b43aa16ad674a78450c6313 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/77/325277/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index d29353e..c9d6a52 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api -# 'db1082' => 500, # 3.6TB 512GB #T148967 + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/325277 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ifcdff4b21002357f9b43aa16ad674a78450c6313 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1087
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325294 Change subject: db-eqiad.php: Depool db1087 .. db-eqiad.php: Depool db1087 db1087 needs an ALTER table, so needs to be depooled Bug: T148967 Change-Id: Ib4c96d38bb2bd7d7ffbbc2ef7ce85fd9e289831a --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/94/325294/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index c9d6a52..2b4f30d 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -145,7 +145,7 @@ 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api 'db1082' => 500, # 3.6TB 512GB - 'db1087' => 500, # 3.6TB 512GB +# 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], 's6' => [ -- To view, visit https://gerrit.wikimedia.org/r/325294 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ib4c96d38bb2bd7d7ffbbc2ef7ce85fd9e289831a Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: labsdb-replica: Disable parallel replication
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325255 Change subject: labsdb-replica: Disable parallel replication .. labsdb-replica: Disable parallel replication As we have done in sanitarium, we should disable parallel replication in the labs servers. Bug: T152194 Change-Id: I8c98ae4eb91bd2c93036a2469b7262ae047f5ead --- M templates/mariadb/labsdb-replica.my.cnf.erb 1 file changed, 4 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/55/325255/1 diff --git a/templates/mariadb/labsdb-replica.my.cnf.erb b/templates/mariadb/labsdb-replica.my.cnf.erb index a6fa163..dfe8f39 100644 --- a/templates/mariadb/labsdb-replica.my.cnf.erb +++ b/templates/mariadb/labsdb-replica.my.cnf.erb @@ -34,6 +34,10 @@ log_bin log_slave_updates +slave_parallel_mode= none +slave_parallel_threads = 0 +slave_parallel_max_queued = 16M + skip-external-locking skip-name-resolve temp-pool -- To view, visit https://gerrit.wikimedia.org/r/325255 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I8c98ae4eb91bd2c93036a2469b7262ae047f5ead Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: eventlogging_sync: By pass ssl check on localhost
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325257 Change subject: eventlogging_sync: By pass ssl check on localhost .. eventlogging_sync: By pass ssl check on localhost The error logs are getting flooded with errors from the SSL certificate. When running this in localhost there is no need to check for the SSL cert, so skipping it. Bug: T152364 Change-Id: Ibb92a3d4c18e8f18887ef1089ab634a449f7b1f2 --- M files/mariadb/eventlogging_sync.sh 1 file changed, 3 insertions(+), 3 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/57/325257/1 diff --git a/files/mariadb/eventlogging_sync.sh b/files/mariadb/eventlogging_sync.sh index 8dc433f..339e026 100755 --- a/files/mariadb/eventlogging_sync.sh +++ b/files/mariadb/eventlogging_sync.sh @@ -19,9 +19,9 @@ mhost='m4-master.eqiad.wmnet' shost="localhost" -slave="mysql -h $shost --compress --skip-column-names" -master="mysql -h $mhost --compress --skip-column-names" -dump="mysqldump -h $mhost --skip-opt --single-transaction --quick --skip-triggers" +slave="mysql -h $shost --compress --skip-column-names --skip-ssl" +master="mysql -h $mhost --compress --skip-column-names --skip-ssl" +dump="mysqldump --skip-ssl -h $mhost --skip-opt --single-transaction --quick --skip-triggers" dumpdata="$dump --no-create-info --insert-ignore --extended-insert --compress --hex-blob" querytables="select table_name from information_schema.tables where table_schema = '$db' and table_name" # select this many rows per table at a time -- To view, visit https://gerrit.wikimedia.org/r/325257 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ibb92a3d4c18e8f18887ef1089ab634a449f7b1f2 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1082
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325260 Change subject: db-eqiad.php: Depool db1082 .. db-eqiad.php: Depool db1082 db1082 needs an ALTER table so needs to be depooled Bug: T148967 Change-Id: I8303fbb1332aaef0c5bd95f571f0ec98a00ec908 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/60/325260/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index c9d6a52..d29353e 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,7 +144,7 @@ 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB +# 'db1082' => 500, # 3.6TB 512GB #T148967 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], -- To view, visit https://gerrit.wikimedia.org/r/325260 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I8303fbb1332aaef0c5bd95f571f0ec98a00ec908 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Added gtid_domain_id variable
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325303 Change subject: mariadb: Added gtid_domain_id variable .. mariadb: Added gtid_domain_id variable Adding the gtid_domain_id variable to labs hosts. This variable is not used not, but it is harmless to have it enable in this role. It will be used in the future once we switch to GTID and multisource Bug: T149418 Bug: T152194 Change-Id: Ia3a47e96d391f0e7742a271fcd800802ff10fd3e --- M templates/mariadb/labsdb-replica.my.cnf.erb 1 file changed, 2 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/03/325303/1 diff --git a/templates/mariadb/labsdb-replica.my.cnf.erb b/templates/mariadb/labsdb-replica.my.cnf.erb index dfe8f39..21a44b3 100644 --- a/templates/mariadb/labsdb-replica.my.cnf.erb +++ b/templates/mariadb/labsdb-replica.my.cnf.erb @@ -25,6 +25,8 @@ port = 3306 datadir= <%= @datadir %> tmpdir = <%= @tmpdir %> +# needed for multisource replication + GTID. +gtid_domain_id = <%= @server_id %> server_id = <%= @server_id %> read_only = 0 -- To view, visit https://gerrit.wikimedia.org/r/325303 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ia3a47e96d391f0e7742a271fcd800802ff10fd3e Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1070 for maintenance
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/324658 Change subject: db-eqiad.php: Depool db1070 for maintenance .. db-eqiad.php: Depool db1070 for maintenance db1070 needs an ALTER table. It is serving API, so in order to help with the API load I have pooled db1082 in temporarily Bug: T148967 Change-Id: If547dbc9676ffb634e84398937d14ae1e3ac949a --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 3 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/58/324658/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 35c6566..7fdad96 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -142,9 +142,9 @@ 'db1049' => 0, # 2.8TB 64GB, master 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager 'db1045' => 0, # 1.4TB 64GB, vslow, dump - 'db1070' => 50, # 2.8TB 160GB, api, old master +# 'db1070' => 50, # 2.8TB 160GB, api, old master #T148967 'db1071' => 50, # 2.8TB 160GB, api - 'db1082' => 500, # 3.6TB 512GB + 'db1082' => 300, # 3.6TB 512GB, api #Temporarily serving api #T148967 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -359,7 +359,8 @@ 'db1045' => 1, ], 'api' => [ - 'db1070' => 1, + 'db1082' => 3, +# 'db1070' => 1, 'db1071' => 1, ], 'watchlist' => [ -- To view, visit https://gerrit.wikimedia.org/r/324658 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: If547dbc9676ffb634e84398937d14ae1e3ac949a Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Split backup and otrsbackups classes into a differe...
Marostegui has submitted this change and it was merged. Change subject: mariadb: Split backup and otrsbackups classes into a different file .. mariadb: Split backup and otrsbackups classes into a different file After some discussions with Jaime we thought that we could slowly start moving things out from mariadb.pp file into single files which will make things clearer and easy to manage. For this first approach I took backup and otrsbackups classes into a different files in a new directory "mariadb" Bug: T150851 Change-Id: I804b6df9f9d4c584dc78f5053b18a0a11e335b4a --- M modules/role/manifests/mariadb.pp A modules/role/manifests/mariadb/backup.pp A modules/role/manifests/mariadb/otrsbackups.pp 3 files changed, 66 insertions(+), 68 deletions(-) Approvals: Jcrespo: Looks good to me, but someone else must approve Marostegui: Looks good to me, approved jenkins-bot: Verified diff --git a/modules/role/manifests/mariadb.pp b/modules/role/manifests/mariadb.pp index 8760f9d..f7cbaf4 100644 --- a/modules/role/manifests/mariadb.pp +++ b/modules/role/manifests/mariadb.pp @@ -577,40 +577,6 @@ } } -class role::mariadb::backup { -include role::backup::host -include passwords::mysql::dump - -file { '/srv/backups': -ensure => directory, -owner => 'root', -group => 'root', -mode => '0600', # implicitly 0700 for dirs -} - -file { '/etc/mysql/conf.d/dumps.cnf': -ensure => present, -owner => 'root', -group => 'root', -mode=> '0400', -content => "[client]\nuser=${passwords::mysql::dump::user}\npassword=${passwords::mysql::dump::pass}\n", -} - -backup::mysqlset {'dbstore': -xtrabackup => false, -per_db => true, -innodb_only => true, -binlog => false, -slave=> true, -local_dump_dir => '/srv/backups', -password_file=> '/etc/mysql/conf.d/dumps.cnf', -method => 'predump', -mysql_binary => '/usr/local/bin/mysql', -mysqldump_binary => '/usr/local/bin/mysqldump', -jobdefaults => "Weekly-${role::backup::host::day}-${role::backup::host::pool}", -} -} - class role::mariadb::core( $shard, $ssl = 'puppet-cert', @@ -1064,40 +1030,6 @@ tendril_user => 'watchdog', tendril_password => $passwords::tendril::db_pass, } -} - -class role::mariadb::otrsbackups { -include role::backup::host - -file { '/srv/backups': -ensure => directory, -owner => 'root', -group => 'root', -mode => '0600', # implicitly 0700 for dirs -} - -file { '/usr/local/bin/dumps-otrs.sh': -owner => 'root', -group => 'root', -mode=> '0755', -content => template('mariadb/dumps-otrs.sh.erb'), -} - -cron { 'otrsbackups': -minute => '0', -hour => '0', -monthday => '*', -month=> '*', -weekday => '3', -command => '/usr/local/bin/dumps-otrs.sh > /srv/backups/dump.log 2>&1', -user => 'root', -require => [ -File['/usr/local/bin/dumps-otrs.sh'], -File['/srv/backups'], -], -} - -backup::set {'otrsdb': } } # hosts with client utilities to conect to remote servers diff --git a/modules/role/manifests/mariadb/backup.pp b/modules/role/manifests/mariadb/backup.pp new file mode 100644 index 000..135b5cf --- /dev/null +++ b/modules/role/manifests/mariadb/backup.pp @@ -0,0 +1,33 @@ +class role::mariadb::backup { +include role::backup::host +include passwords::mysql::dump + +file { '/srv/backups': +ensure => directory, +owner => 'root', +group => 'root', +mode => '0600', # implicitly 0700 for dirs +} + +file { '/etc/mysql/conf.d/dumps.cnf': +ensure => present, +owner => 'root', +group => 'root', +mode=> '0400', +content => "[client]\nuser=${passwords::mysql::dump::user}\npassword=${passwords::mysql::dump::pass}\n", +} + +backup::mysqlset {'dbstore': +xtrabackup => false, +per_db => true, +innodb_only => true, +binlog => false, +slave=> true, +local_dump_dir => '/srv/backups', +password_file=> '/etc/mysql/conf.d/dumps.cnf', +method => 'predump', +mysql_binary => '/usr/local/bin/mysql', +mysqldump_binary => '/usr/local/bin/mysqldump', +jobdefaults => "Weekly-${role::backup::host::day}-${role::backup::host::pool}", +} +} diff --git a/modules/role/manifests/mariadb/otrsbackups.pp b/modules/role/manifests/mariadb/otrsbackups.pp new file mode 100644 index 000..ac98c75 --- /dev/null +++
[MediaWiki-commits] [Gerrit] operations/dns[master]: wmnet: Change es2 master
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/324695 Change subject: wmnet: Change es2 master .. wmnet: Change es2 master es2 master has been swapped, es1011 is now the new master. So updating the alias now Bug: T151995 Change-Id: Ief77832e0bc9ec54c4ab4ab54a29d2d9523ad9fd --- M templates/wmnet 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/dns refs/changes/95/324695/1 diff --git a/templates/wmnet b/templates/wmnet index 718a0c9..fe93158 100644 --- a/templates/wmnet +++ b/templates/wmnet @@ -52,7 +52,7 @@ m5-slave5M IN CNAMEdb2030.codfw.wmnet. x1-master 5M IN CNAMEdb1031.eqiad.wmnet. x1-slave5M IN CNAMEdb1029.eqiad.wmnet. -es2-master 5M IN CNAMEes1015.eqiad.wmnet. +es2-master 5M IN CNAMEes1011.eqiad.wmnet. es3-master 5M IN CNAMEes1019.eqiad.wmnet. pc1-master 5M IN CNAMEpc1004.eqiad.wmnet. pc2-master 5M IN CNAMEpc1005.eqiad.wmnet. -- To view, visit https://gerrit.wikimedia.org/r/324695 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ief77832e0bc9ec54c4ab4ab54a29d2d9523ad9fd Gerrit-PatchSet: 1 Gerrit-Project: operations/dns Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Repool db1071
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/324881 Change subject: db-eqiad.php: Repool db1071 .. db-eqiad.php: Repool db1071 ALTER table is done, so db1071 can be pooled back Bug: T148967 Change-Id: I4246d23a721dcab87229c06ea521d21ebeaf4572 --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 5 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/81/324881/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 5db1a8f..b6ccca6 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -143,8 +143,8 @@ 'db1026' => 1, # 1.4TB 64GB, watchlist, recentchanges, contributions, logpager 'db1045' => 0, # 1.4TB 64GB, vslow, dump 'db1070' => 50, # 2.8TB 160GB, api, old master -# 'db1071' => 50, # 2.8TB 160GB, api #T148967 - 'db1082' => 300, # 3.6TB 512GB, api #Temporarily serving api #T148967 + 'db1071' => 50, # 2.8TB 160GB, api + 'db1082' => 500, # 3.6TB 512GB 'db1087' => 500, # 3.6TB 512GB 'db1092' => 500, # 3.6TB 512GB ], @@ -359,9 +359,8 @@ 'db1045' => 1, ], 'api' => [ - 'db1070' => 3, -# 'db1071' => 1, - 'db1082' => 1, + 'db1070' => 1, + 'db1071' => 1, ], 'watchlist' => [ 'db1026' => 1, -- To view, visit https://gerrit.wikimedia.org/r/324881 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I4246d23a721dcab87229c06ea521d21ebeaf4572 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-codfw.php: Depool db2060
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/330376 ) Change subject: db-codfw.php: Depool db2060 .. db-codfw.php: Depool db2060 db2060 crashed and needs a restart. Depooling it temporarily. Using db2046 to server API while db2060 is out Bug: T154031 Change-Id: I493116f45c87e019957627b61719f8738557919c --- M wmf-config/db-codfw.php 1 file changed, 3 insertions(+), 3 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/76/330376/1 diff --git a/wmf-config/db-codfw.php b/wmf-config/db-codfw.php index 2739757..9fe4bbf 100644 --- a/wmf-config/db-codfw.php +++ b/wmf-config/db-codfw.php @@ -137,9 +137,9 @@ 's6' => [ 'db2028' => 0, # 2.9TB 96GB, master 'db2039' => 50, # 2.9TB 160GB, rc, log - 'db2046' => 400, # 2.9TB 160GB + 'db2046' => 100, # 2.9TB 160GB #temporarily serving API #T154031 'db2053' => 100, # 2.9TB 160GB, dump (inactive), vslow - 'db2060' => 100, # 3.3TB 160GB, api +# 'db2060' => 100, # 3.3TB 160GB, api #maintenance T154031 'db2067' => 400, # 3.3TB 160GB ], 's7' => [ @@ -381,7 +381,7 @@ 'db2053' => 1, ], 'api' => [ - 'db2060' => 1, + 'db2046' => 1, ], ], 's7' => [ -- To view, visit https://gerrit.wikimedia.org/r/330376 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I493116f45c87e019957627b61719f8738557919c Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: [WIP] Reporting tests with the private data script
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/328352 ) Change subject: [WIP] Reporting tests with the private data script .. [WIP] Reporting tests with the private data script * For now just run the private data script and email me once something is found so it can be polished. * Needs to be scheduled for run in a cronjob, maybe every other day or once per day. Ideally it should be an icinga check eventually. Bug: T153680 Change-Id: I7796d6860f70c34b1758655f18a4ed8196724e97 --- A modules/role/files/mariadb/check_private_data_report.sh M modules/role/manifests/labs/db/check_private_data.pp 2 files changed, 28 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/52/328352/1 diff --git a/modules/role/files/mariadb/check_private_data_report.sh b/modules/role/files/mariadb/check_private_data_report.sh new file mode 100755 index 000..8f7c59c --- /dev/null +++ b/modules/role/files/mariadb/check_private_data_report.sh @@ -0,0 +1,19 @@ +#!/bin/bash + +REPORTS_DIR='/var/log' +REPORT_NAME=`echo private_data_report_$(hostname)_$(date +"%Y%m%d").txt` + +# remove older than 7 days files + +find $REPORTS_DIR/$REPORT_NAME -type f -mtime 7 -exec rm -f {} \; + +# run the script + +/usr/local/sbin/check_private_data.py 2>&1 > $REPORTS_DIR/$REPORT_NAME + +DATA=`cat $REPORTS_DIR/$REPORT_NAME | grep -v "-" | wc -l` + +if [ $DATA -gt 0 ] +then +echo "Private data detected at `hostname` check: /var/log/private_data_report_$(hostname)_$(date +"%Y%m%d").txt" | mail -s "Private data found at `hostname`" maroste...@wikimedia.org +fi diff --git a/modules/role/manifests/labs/db/check_private_data.pp b/modules/role/manifests/labs/db/check_private_data.pp index 0859bbc..aef55cc 100644 --- a/modules/role/manifests/labs/db/check_private_data.pp +++ b/modules/role/manifests/labs/db/check_private_data.pp @@ -30,4 +30,13 @@ File['/etc/mysql/private_tables.txt'], ], } + +file { '/usr/local/sbin/check_private_data_report.sh': +ensure => file, +source => 'puppet:///modules/role/mariadb/check_private_data_report.sh', +owner => 'root', +group => 'root', +mode => '0744', +} + } -- To view, visit https://gerrit.wikimedia.org/r/328352 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I7796d6860f70c34b1758655f18a4ed8196724e97 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: .profile: Add .profile file
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/329133 ) Change subject: .profile: Add .profile file .. .profile: Add .profile file Just adding .profile so my .bashrc is read Change-Id: Ie69edcfe252539c67718d537b53a049ff32d4901 --- A modules/admin/files/home/marostegui/.profile 1 file changed, 6 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/33/329133/1 diff --git a/modules/admin/files/home/marostegui/.profile b/modules/admin/files/home/marostegui/.profile new file mode 100644 index 000..35e8d01 --- /dev/null +++ b/modules/admin/files/home/marostegui/.profile @@ -0,0 +1,6 @@ +if [ -n "$BASH_VERSION" ]; then +# include .bashrc if it exists +if [ -f "$HOME/.bashrc" ]; then +. "$HOME/.bashrc" +fi +fi -- To view, visit https://gerrit.wikimedia.org/r/329133 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ie69edcfe252539c67718d537b53a049ff32d4901 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: mariadb: Enable gtid_domain_id - phabricator hosts
Marostegui has uploaded a new change for review. https://gerrit.wikimedia.org/r/325781 Change subject: mariadb: Enable gtid_domain_id - phabricator hosts .. mariadb: Enable gtid_domain_id - phabricator hosts The only hosts pending in the misc shards to get the flag enabled are the ones that belong to phabricator cluster. The flag has been enabled for weeks on all the other hosts of all the misc shards. Bug: T149418 Change-Id: I1d0740d7248f35fd99f7691c13a92db11e32f358 --- M templates/mariadb/phabricator.my.cnf.erb 1 file changed, 8 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/81/325781/1 diff --git a/templates/mariadb/phabricator.my.cnf.erb b/templates/mariadb/phabricator.my.cnf.erb index 6d4d655..24deecf2 100644 --- a/templates/mariadb/phabricator.my.cnf.erb +++ b/templates/mariadb/phabricator.my.cnf.erb @@ -111,6 +111,14 @@ ssl-key=/etc/mysql/ssl/server.key ssl-cipher=TLSv1.2 <% end %> + +# gtid_domain_id flag is needed for multisource replication and GTID. +# Strictly it is only needed on masters or servers that can potentially be +# masters but for consistency it should be set in all of them. +# https://mariadb.com/kb/en/mariadb/gtid/ + +gtid_domain_id = <%= @server_id %> + <% if @p_s == 'on' %> # Enabling performance_schema (disabled by default in MariaDB10) performance_schema = 1 -- To view, visit https://gerrit.wikimedia.org/r/325781 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I1d0740d7248f35fd99f7691c13a92db11e32f358 Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Restore db1087 original weight
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/344150 ) Change subject: db-eqiad.php: Restore db1087 original weight .. db-eqiad.php: Restore db1087 original weight After the reimage and warm up, restore its original weight Bug: T137191 Change-Id: I6a64aa7f4532ca5a9e0436c7e0cb2109fd7c46b8 --- M wmf-config/db-eqiad.php 1 file changed, 2 insertions(+), 2 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/50/344150/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index ae7b8e7..9b5fe91 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -144,8 +144,8 @@ 'db1045' => 1, # B2 1.4TB 64GB, watchlist, recentchanges, contributions, logpager # 'db1070' => 50, # D1 2.8TB 160GB, vslow, dump #ROW based replication - master for db1095 #T137191 'db1071' => 50, # D1 2.8TB 160GB, #temporary vslow #T153743 - 'db1082' => 200, # A2 3.6TB 512GB, api - 'db1087' => 150, # C2 3.6TB 512GB #low weight temporary api #T153743 #T137191 + 'db1082' => 300, # A2 3.6TB 512GB, api + 'db1087' => 300, # C2 3.6TB 512GB #temporary api #T153743 'db1092' => 500, # D2 3.6TB 512GB ], 's6' => [ -- To view, visit https://gerrit.wikimedia.org/r/344150 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I6a64aa7f4532ca5a9e0436c7e0cb2109fd7c46b8 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Increase weight db1087
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/344143 ) Change subject: db-eqiad.php: Increase weight db1087 .. db-eqiad.php: Increase weight db1087 Bug: T137191 Change-Id: I5a070f2cc0cf7a8c28efffd5a801ba88b0d6abaa --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/43/344143/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 7c621d0..2d9ea21 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -145,7 +145,7 @@ # 'db1070' => 50, # D1 2.8TB 160GB, vslow, dump #ROW based replication - master for db1095 #T137191 'db1071' => 50, # D1 2.8TB 160GB, #temporary vslow #T153743 'db1082' => 200, # A2 3.6TB 512GB, api - 'db1087' => 50, # C2 3.6TB 512GB #low weight temporary api #T153743 #T137191 + 'db1087' => 150, # C2 3.6TB 512GB #low weight temporary api #T153743 #T137191 'db1092' => 500, # D2 3.6TB 512GB ], 's6' => [ -- To view, visit https://gerrit.wikimedia.org/r/344143 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I5a070f2cc0cf7a8c28efffd5a801ba88b0d6abaa Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Repool db1081, depool db1068
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/344147 ) Change subject: db-eqiad.php: Repool db1081, depool db1068 .. db-eqiad.php: Repool db1081, depool db1068 db1081 finished alter db1068 needs the alter db1081 will help serving api Bug: T73563 Bug: T160415 Change-Id: I8d4ef23491a70b04c233681375d89d9041c3ff1c --- M wmf-config/db-eqiad.php 1 file changed, 3 insertions(+), 3 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/47/344147/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 2d9ea21..ae7b8e7 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -133,8 +133,8 @@ 'db1056' => 1, # C2 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1059' => 1, # C2 2.8TB 96GB, api 'db1064' => 0, # D1 2.8TB 160GB, vslow, dump #Master for db1095 - new sanitarium #T153743 - 'db1068' => 1, # D1 2.8TB 160GB, api -# 'db1081' => 500, # A2 3.6TB 512GB #T73563 T160415 +# 'db1068' => 1, # D1 2.8TB 160GB, api #T73563 T160415 + 'db1081' => 200, # A2 3.6TB 512GB temporary api #T73563 T160415 'db1084' => 500, # B1 3.6TB 512GB 'db1091' => 500, # D2 3.6TB 512GB ], @@ -328,7 +328,7 @@ ], 'api' => [ 'db1059' => 1, - 'db1068' => 3, + 'db1081' => 3, ], 'watchlist' => [ 'db1053' => 1, -- To view, visit https://gerrit.wikimedia.org/r/344147 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I8d4ef23491a70b04c233681375d89d9041c3ff1c Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: netboot.cfg: Format db1082
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/344337 ) Change subject: netboot.cfg: Format db1082 .. netboot.cfg: Format db1082 db1082 needs to be fully reimaged Bug: T137191 Change-Id: Ib0fd8c3425423001415520dd8c339a4d20467e4d --- M modules/install_server/files/autoinstall/netboot.cfg 1 file changed, 1 insertion(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/puppet refs/changes/37/344337/1 diff --git a/modules/install_server/files/autoinstall/netboot.cfg b/modules/install_server/files/autoinstall/netboot.cfg index 09660de..f8a57a9 100755 --- a/modules/install_server/files/autoinstall/netboot.cfg +++ b/modules/install_server/files/autoinstall/netboot.cfg @@ -64,6 +64,7 @@ conf200[123]) echo partman/raid1-lvm-ext4-srv.cfg ;; \ cp1008|cp104[34]|cp300[3-9]|cp301[0-8]) echo partman/varnish-oldssd.cfg ;; \ cp[1234][0-9][0-9][0-9]) echo partman/varnish.cfg ;; \ +db1082) echo partman/db.cfg ;; \ db[0-8][0-9]|db10[0-8][0-9]|db109[0-5]|db20[0-2][0-9]|db2030|db203[3-9]|db20[4-7][0-9]|dbstore[1-2]00[1-9]|es[1-2]01[1-9]) echo partman/db-no-srv-format.cfg ;; \ d-i-test) echo partman/flat.cfg virtual.cfg ;; \ druid100[123]) echo partman/druid-4ssd-raid10.cfg ;; \ -- To view, visit https://gerrit.wikimedia.org/r/344337 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ib0fd8c3425423001415520dd8c339a4d20467e4d Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/puppet[production]: netboot.cfg: Format db1082
Marostegui has submitted this change and it was merged. ( https://gerrit.wikimedia.org/r/344337 ) Change subject: netboot.cfg: Format db1082 .. netboot.cfg: Format db1082 db1082 needs to be fully reimaged Bug: T137191 Change-Id: Ib0fd8c3425423001415520dd8c339a4d20467e4d --- M modules/install_server/files/autoinstall/netboot.cfg 1 file changed, 1 insertion(+), 0 deletions(-) Approvals: Marostegui: Looks good to me, approved jenkins-bot: Verified Jcrespo: Looks good to me, but someone else must approve diff --git a/modules/install_server/files/autoinstall/netboot.cfg b/modules/install_server/files/autoinstall/netboot.cfg index 09660de..f8a57a9 100755 --- a/modules/install_server/files/autoinstall/netboot.cfg +++ b/modules/install_server/files/autoinstall/netboot.cfg @@ -64,6 +64,7 @@ conf200[123]) echo partman/raid1-lvm-ext4-srv.cfg ;; \ cp1008|cp104[34]|cp300[3-9]|cp301[0-8]) echo partman/varnish-oldssd.cfg ;; \ cp[1234][0-9][0-9][0-9]) echo partman/varnish.cfg ;; \ +db1082) echo partman/db.cfg ;; \ db[0-8][0-9]|db10[0-8][0-9]|db109[0-5]|db20[0-2][0-9]|db2030|db203[3-9]|db20[4-7][0-9]|dbstore[1-2]00[1-9]|es[1-2]01[1-9]) echo partman/db-no-srv-format.cfg ;; \ d-i-test) echo partman/flat.cfg virtual.cfg ;; \ druid100[123]) echo partman/druid-4ssd-raid10.cfg ;; \ -- To view, visit https://gerrit.wikimedia.org/r/344337 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ib0fd8c3425423001415520dd8c339a4d20467e4d Gerrit-PatchSet: 1 Gerrit-Project: operations/puppet Gerrit-Branch: production Gerrit-Owner: MarosteguiGerrit-Reviewer: Giuseppe Lavagetto Gerrit-Reviewer: Jcrespo Gerrit-Reviewer: Marostegui Gerrit-Reviewer: jenkins-bot <> ___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Depool db1059, repool db1068
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/344308 ) Change subject: db-eqiad.php: Depool db1059, repool db1068 .. db-eqiad.php: Depool db1059, repool db1068 db1068 finished its alter table db1059 needs an alter table Bug: T73563 Bug: T160415 Change-Id: I11823833ddf2f80f1dbe223f57592f764a5fe445 --- M wmf-config/db-eqiad.php 1 file changed, 4 insertions(+), 4 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/08/344308/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index 8738a49..c6e5442 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -131,9 +131,9 @@ 'db1040' => 0, # B2 1.4TB 64GB, master 'db1053' => 1, # A2 2.8TB 96GB, watchlist, recentchanges, contributions, logpager 'db1056' => 1, # C2 2.8TB 96GB, watchlist, recentchanges, contributions, logpager - 'db1059' => 1, # C2 2.8TB 96GB, api +# 'db1059' => 1, # C2 2.8TB 96GB, api #T73563 T160415 'db1064' => 0, # D1 2.8TB 160GB, vslow, dump #Master for db1095 - new sanitarium #T153743 -# 'db1068' => 1, # D1 2.8TB 160GB, api #T73563 T160415 + 'db1068' => 1, # D1 2.8TB 160GB, api 'db1081' => 200, # A2 3.6TB 512GB temporary api #T73563 T160415 'db1084' => 500, # B1 3.6TB 512GB 'db1091' => 500, # D2 3.6TB 512GB @@ -327,8 +327,8 @@ 'db1064' => 1, ], 'api' => [ - 'db1059' => 1, - 'db1081' => 3, + 'db1081' => 1, + 'db1068' => 3, ], 'watchlist' => [ 'db1053' => 1, -- To view, visit https://gerrit.wikimedia.org/r/344308 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I11823833ddf2f80f1dbe223f57592f764a5fe445 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
[MediaWiki-commits] [Gerrit] operations/mediawiki-config[master]: db-eqiad.php: Increase weight db1092
Marostegui has uploaded a new change for review. ( https://gerrit.wikimedia.org/r/343927 ) Change subject: db-eqiad.php: Increase weight db1092 .. db-eqiad.php: Increase weight db1092 Give it more weight after its reimage Bug: T137191 Change-Id: I97b178f69940cc2d43eaecb7990a72a6b493b327 --- M wmf-config/db-eqiad.php 1 file changed, 1 insertion(+), 1 deletion(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/27/343927/1 diff --git a/wmf-config/db-eqiad.php b/wmf-config/db-eqiad.php index e7f21dc..b5be2ad 100644 --- a/wmf-config/db-eqiad.php +++ b/wmf-config/db-eqiad.php @@ -146,7 +146,7 @@ 'db1071' => 50, # D1 2.8TB 160GB, #temporary vslow #T153743 'db1082' => 300, # A2 3.6TB 512GB, api 'db1087' => 300, # C2 3.6TB 512GB #temporary api #T153743 - 'db1092' => 50, # D2 3.6TB 512GB #T137191 less weight after reimage + 'db1092' => 150, # D2 3.6TB 512GB #T137191 less weight after reimage ], 's6' => [ 'db1050' => 0, # B2 2.8TB 64GB, master -- To view, visit https://gerrit.wikimedia.org/r/343927 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I97b178f69940cc2d43eaecb7990a72a6b493b327 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Marostegui___ MediaWiki-commits mailing list MediaWiki-commits@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits