[Wikidata-bugs] [Maniphest] [Commented On] T111535: Wikibase\Repo\Store\SQL\EntityPerPageTable::{closure} creating high number of deadlocks
jcrespo added a comment. See merged ticket, this happened again when 300-400 new pages per minute were being created, with 35 parallel threads.TASK DETAILhttps://phabricator.wikimedia.org/T111535EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespoCc: Zppix, ArielGlenn, hoo, aude, JanZerebecki, Addshore, Aklapper, jcrespo, D3r1ck01, Izno, Wikidata-bugs, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T111535: Wikibase\Repo\Store\SQL\EntityPerPageTable::{closure} creating high number of deadlocks
jcrespo added a comment. I set the priority to low "nice to fix it, but it is not breaking anything now". Feel free to disagree with me. TASK DETAIL https://phabricator.wikimedia.org/T111535 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jcrespo Cc: aude, JanZerebecki, Addshore, Aklapper, jcrespo, Wikidata-bugs ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T111535: Wikibase\Repo\Store\SQL\EntityPerPageTable::{closure} creating high number of deadlocks
Addshore added a comment. I can confirm this slightly odd traffic is me. See epp_entity_id in the query which is 16507538 referring to Q16507538 https://www.wikidata.org/w/index.php?title=Q16507538=history The traffic is legitimate, but abnormal.. Generally the rate of redirect creation would be nowhere near what is has been for the past 5 hours thus I don't think we need to worry about these deadlocks! TASK DETAIL https://phabricator.wikimedia.org/T111535 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Addshore, Aklapper, jcrespo, Wikidata-bugs, aude ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T111535: Wikibase\Repo\Store\SQL\EntityPerPageTable::{closure} creating high number of deadlocks
aude added a subscriber: aude. aude added a comment. I am sure there is some underlying issue and think we should look into it, to make the code more robust and capable of handling stuff such as what addshore is doing :) TASK DETAIL https://phabricator.wikimedia.org/T111535 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jcrespo, aude Cc: aude, JanZerebecki, Addshore, Aklapper, jcrespo, Wikidata-bugs ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T111535: Wikibase\Repo\Store\SQL\EntityPerPageTable::{closure} creating high number of deadlocks
Addshore added a comment. Note: this can be seen in logstash at https://logstash.wikimedia.org/#dashboard/temp/AU-ZV6Ufk7jM4RPmSmAJ TASK DETAIL https://phabricator.wikimedia.org/T111535 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: JanZerebecki, Addshore, Aklapper, jcrespo, Wikidata-bugs, aude ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T111535: Wikibase\Repo\Store\SQL\EntityPerPageTable::{closure} creating high number of deadlocks
aude added a comment. we should investigate if there is something we can do to improve the code to make it more robust. although we have discussed discontinuing (dropping?) this table, I'm not sure we will do that anytime soon or at all. TASK DETAIL https://phabricator.wikimedia.org/T111535 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: aude Cc: aude, JanZerebecki, Addshore, Aklapper, jcrespo, Wikidata-bugs ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T111535: Wikibase\Repo\Store\SQL\EntityPerPageTable::{closure} creating high number of deadlocks
Addshore added a comment. If we want to see the exact rate we are dealing with I can probably go and pull out a number! Also as said on IRC I asume the transactions retry when they fail due to a deadlock? Otherwise something is very odd as I only encountered 2 errors through the api in the 6 hours. TASK DETAIL https://phabricator.wikimedia.org/T111535 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: aude, JanZerebecki, Addshore, Aklapper, jcrespo, Wikidata-bugs ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
