[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[Addshore]

Addshore removed a project: Wikidata-Campsite (Wikidata-Campsite-Iteration-∞).
Addshore added a comment.


  Removing from the campsite, and we will close this ticket when the old term 
store is gone!

TASK DETAIL
  https://phabricator.wikimedia.org/T151789

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Ladsgroup, alaa_wmde, Michael, mmodell, Addshore, Krinkle, Aklapper, hoo, 
darthmon_wmde, Dinadineke, DannyS712, Nandana, tabish.shaikh91, Lahi, Gq86, 
GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
TheDJ, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Krenair, Iflorez, Jonas, 
Lydia_Pintscher
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[Addshore]

Addshore added a comment.


  This will likely end up being helped greatly by T244115: Investigate & Fix 
holes for aliases in new term tables (take 3) 
, the bulk of which will be going 
out with .21
  
  In T244115#5900251 , 
@Addshore wrote:
  
  > When the transaction splitting and job gets deployed we will likely and 
should see a drop in deadlock issues.
  > We should be able to observe this @ 
https://logstash.wikimedia.org/goto/956ac31f9e47b1a4a579e4f39c300b2f

TASK DETAIL
  https://phabricator.wikimedia.org/T151789

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Ladsgroup, alaa_wmde, Michael, mmodell, Addshore, Krinkle, Aklapper, hoo, 
Iflorez, darthmon_wmde, Dinadineke, DannyS712, Nandana, tabish.shaikh91, Lahi, 
Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, 
QZanden, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, 
Wikidata-bugs, aude, Lydia_Pintscher, TheDJ, Jdforrester-WMF, Mbch331, Rxy, 
Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[Ladsgroup]

Ladsgroup added a comment.


  In T151789#5748765 , 
@Krinkle wrote:
  
  > Seen 3,500 times (evenly spread out throughout the month).
  
  Yup, we are still writing to the old store (and we will for probably long 
time still...)
  
  > Logstash: 
https://logstash.wikimedia.org/goto/f12480d76fe5fa011e52110a94927d3e.
  > @Ladsgroup I don't know if is the same issue or not. It does have the same 
stack trace from DataUpdateAdapter::doUpdate line 62, same as in this task's 
description with a similar error message afaik.
  >
  > name=message
  >   PHP Warning: [data-update-failed]: A data update callback triggered an 
exception (Fail-safe exception. Number of ids to be restored is not equal to 
the number of records that are about to be inserted into master. This should 
never happen, except for an edge-case that was not detected during development 
or due to a race-condition that is not covered by this implementation.)
  >   [Called from Wikibase\Repo\Content\DataUpdateAdapter::doUpdate in 
/srv/mediawiki/php-1.35.0-wmf.10/extensions/Wikibase/repo/includes/Content/DataUpdateAdapter.php
 at line 62]
  >
  > name=exception.trace
  >   #0 [internal function]: MWExceptionHandler::handleError(integer, string, 
string, integer, array)
  >   #1 /srv/mediawiki/php-1.35.0-wmf.10/includes/debug/MWDebug.php(333): 
trigger_error(string, integer)
  >   #2 /srv/mediawiki/php-1.35.0-wmf.10/includes/debug/MWDebug.php(188): 
MWDebug::sendMessage(string, array, string, integer)
  >   #3 /srv/mediawiki/php-1.35.0-wmf.10/includes/GlobalFunctions.php(1079): 
MWDebug::warning(string, integer, integer, string)
  >   #4 
/srv/mediawiki/php-1.35.0-wmf.10/extensions/Wikibase/lib/includes/Reporting/LogWarningExceptionHandler.php(28):
 wfLogWarning(string, integer)
  >   #5 
/srv/mediawiki/php-1.35.0-wmf.10/extensions/Wikibase/repo/includes/Content/DataUpdateAdapter.php(62):
 Wikibase\Lib\Reporting\LogWarningExceptionHandler->handleException(Exception, 
string, string)
  >   #6 
/srv/mediawiki/php-1.35.0-wmf.10/includes/deferred/DeferredUpdates.php(416): 
Wikibase\Repo\Content\DataUpdateAdapter->doUpdate()
  >   #7 
/srv/mediawiki/php-1.35.0-wmf.10/includes/Storage/DerivedPageDataUpdater.php(1634):
 DeferredUpdates::attemptUpdate(Wikibase\Repo\Content\DataUpdateAdapter, 
Wikimedia\Rdbms\LBFactoryMulti)
  >   #8 
/srv/mediawiki/php-1.35.0-wmf.10/includes/Storage/DerivedPageDataUpdater.php(1446):
 MediaWiki\Storage\DerivedPageDataUpdater->doSecondaryDataUpdates(array)
  >   #9 
/srv/mediawiki/php-1.35.0-wmf.10/includes/deferred/MWCallableUpdate.php(38): 
MediaWiki\Storage\DerivedPageDataUpdater->MediaWiki\Storage\{closure}()
  >   #10 
/srv/mediawiki/php-1.35.0-wmf.10/includes/deferred/DeferredUpdates.php(416): 
MWCallableUpdate->doUpdate()
  >   #11 
/srv/mediawiki/php-1.35.0-wmf.10/includes/deferred/DeferredUpdates.php(296): 
DeferredUpdates::attemptUpdate(MWCallableUpdate, Wikimedia\Rdbms\LBFactoryMulti)
  >   #12 
/srv/mediawiki/php-1.35.0-wmf.10/includes/deferred/DeferredUpdates.php(233): 
DeferredUpdates::run(MWCallableUpdate, Wikimedia\Rdbms\LBFactoryMulti, 
Monolog\Logger, BufferingStatsdDataFactory, string)
  >   #13 
/srv/mediawiki/php-1.35.0-wmf.10/includes/deferred/DeferredUpdates.php(150): 
DeferredUpdates::handleUpdateQueue(array, string, integer)
  >   #14 /srv/mediawiki/php-1.35.0-wmf.10/includes/MediaWiki.php(1053): 
DeferredUpdates::doUpdates(string)
  >   #15 /srv/mediawiki/php-1.35.0-wmf.10/includes/MediaWiki.php(833): 
MediaWiki->restInPeace()
  >   #16 /srv/mediawiki/php-1.35.0-wmf.10/includes/MediaWiki.php(842): 
MediaWiki->{closure}()
  >   #17 /srv/mediawiki/php-1.35.0-wmf.10/api.php(113): 
MediaWiki->doPostOutputShutdown()
  >   #18 /srv/mediawiki/w/api.php
  >
  > If this is separate, feel free to create a new task :)
  
  This is T233414: Merge triggered warning about unequal numbers of ids to be 
restored and records to be inserted into master 
. We are on it:
  
  catbowtie 


TASK DETAIL
  https://phabricator.wikimedia.org/T151789

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Ladsgroup, alaa_wmde, Michael, mmodell, Addshore, Krinkle, Aklapper, hoo, 
darthmon_wmde, Dinadineke, DannyS712, Nandana, tabish.shaikh91, Lahi, Gq86, 
GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, 
merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, 
aude, Lydia_Pintscher, TheDJ, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[Krinkle]

Krinkle set Request URL to /w/api.php.
Krinkle set Request ID to XaFW6QpAEMYAALXzYP0AAACN.
Krinkle updated the task description.
Krinkle edited Stack Trace.

TASK DETAIL
  https://phabricator.wikimedia.org/T151789

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Krinkle
Cc: alaa_wmde, Michael, mmodell, Addshore, Krinkle, Aklapper, hoo, 
darthmon_wmde, Dinadineke, DannyS712, Nandana, tabish.shaikh91, Lahi, Gq86, 
GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, 
merbst, LawExplorer, _jensen, rosalieper, Wikidata-bugs, aude, TheDJ, 
Jdforrester-WMF, Mbch331, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[Krinkle]

Krinkle merged a task: T233847: PHP Warning: [data-update-failed]: A data 
update callback triggered an exception.
Krinkle added subscribers: mmodell, Michael, alaa_wmde.

TASK DETAIL
  https://phabricator.wikimedia.org/T151789

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Krinkle
Cc: alaa_wmde, Michael, mmodell, Addshore, Krinkle, Aklapper, hoo, 
darthmon_wmde, Dinadineke, DannyS712, Nandana, tabish.shaikh91, Lahi, Gq86, 
GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, 
merbst, LawExplorer, _jensen, rosalieper, Wikidata-bugs, aude, TheDJ, 
Jdforrester-WMF, Mbch331, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[Addshore]

Addshore removed a project: Wikidata-Campsite.
TASK DETAILhttps://phabricator.wikimedia.org/T151789EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Krinkle, Aklapper, hoo, Dinadineke, Nandana, tabish.shaikh91, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, merbst, LawExplorer, _jensen, D3r1ck01, Wikidata-bugs, aude, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair, Jonas, Lydia_Pintscher___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[Addshore]

Addshore added a project: Wikidata-Campsite.
TASK DETAILhttps://phabricator.wikimedia.org/T151789EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Krinkle, Aklapper, hoo, Dinadineke, Nandana, tabish.shaikh91, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, merbst, LawExplorer, _jensen, D3r1ck01, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[Krinkle]

Krinkle added a parent task: T30599: Deadlock tracking bug (tracking).
TASK DETAILhttps://phabricator.wikimedia.org/T151789EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: Krinkle, Aklapper, hoo, tabish.shaikh91, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, merbst, LawExplorer, D3r1ck01, Wikidata-bugs, aude, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T151789: Wikibase\\TermSqlIndex::deleteTerms: Deadlock found when trying to get lock; try restarting transaction

[hoo]

hoo added a parent task: T86530: Replace wb_terms table with more specialized mechanisms for terms (tracking).
TASK DETAILhttps://phabricator.wikimedia.org/T151789EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs