[Wikidata-bugs] [Maniphest] [Commented On] T131026: Keep getting internal_api_error_DBQueryError on a query
Base added a comment. Ah and here's the causation for that it seems, it's the Q502560238080 element which got into the query. When it's just 5 items the behaviour is normal, just missting="" attribute is added: https://www.wikidata.org/w/api.php?format=xml&maxlag=5&action=query&action=wbgetentities&redirects=yes&props=&ids=Q15712437|Q4477434|Q502560238080|Q1963971|Q1963253 So for this one thing you guys have to investigate why on longer queries it spits a DB error instead of adequately proceeding it. But on larger scale as I said DB errors on API queries are not uncommon these days and I do not deem it to be normal. TASK DETAIL https://phabricator.wikimedia.org/T131026 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Base Cc: Ata, Base, Aklapper, dg711, D3r1ck01, Izno, Wikidata-bugs, aude, jayvdb, fbstj, Anomie, Mbch331, Legoktm ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T131026: Keep getting internal_api_error_DBQueryError on a query
Addshore added a comment. Here is the result from the logs from my re run of the query 2016-04-03 11:59:21 [ff431090bca14412c08f0a06] mw1203 wikidatawiki 1.27.0-wmf.19 exception ERROR: [ff431090bca14412c08f0a06] /w/api.php?format=xml&rawcontinue=1&maxlag=5&action=query&action=wbgetentities&redirects=yes&props=&ids=Q229755|Q603574|Q245160|Q282182|Q290801|Q16375275|Q909076|Q3648053|Q16379668|Q319486|Q328975|Q542017|Q768409|Q174885|Q778213|Q802523|Q1860439|Q179290|Q3736210|Q3214846|Q80227|Q2075554|Q467266|Q941948|Q1991462|Q1371376|Q18973|Q651895|Q273667|Q583294|Q447367|Q2468398|Q1444561|Q2474562|Q625616|Q467436|Q3214977|Q1152972|Q2372847|Q549560|Q211600|Q1802388|Q695002|Q7764970|Q36760|Q3645592|Q1989811|Q2657626|Q1269808|Q163384|Q156322|Q2053267|Q3651831|Q2622599|Q204208|Q2078458|Q310896|Q3649024|Q270535|Q3647687|Q1425119|Q667251|Q12867034|Q1262226|Q14916596|Q1156904|Q732613|Q1048890|Q7849797|Q4141130|Q10600995|Q1225942|Q1178663|Q2379008|Q946194|Q307065|Q3648928|Q7262061|Q4608|Q3651106|Q1351318|Q1899389|Q236673|Q1396707|Q16843187|Q310184|Q474669|Q12871562|Q1396841|Q279575|Q956932|Q1285832|Q1341835|Q983226|Q2029336|Q12871591|Q130338|Q3650740|Q2388278|Q3648919|Q1076875|Q1545224|Q2667495|Q732235| Q4159924|Q16378653|Q12864387|Q15277881|Q132984|Q502560238080|Q2671405|Q3218302|Q2639417|Q320519|Q1963253|Q340562|Q229493|Q340566|Q971820|Q4447083|Q1972264|Q16377807|Q1253264|Q500888|Q1011003|Q2360342|Q572699|Q3329320|Q12861532|Q18274252|Q227156|Q1132665|Q560238|Q956954|Q12862968|Q737874|Q562268|Q1789505|Q2359156|Q4228784|Q22570196|Q321365|Q12868260|Q4459019|Q242593|Q679979|Q20706409|Q714829|Q2032053|Q2372910|Q1975312|Q240954|Q562260|Q217443|Q339546|Q1649341|Q42194|Q232720|Q144086|Q12867981|Q13107337|Q238246|Q1749204|Q2742643|Q3057493|Q12869500|Q15712437|Q321372|Q2028186|Q379627|Q2663466|Q12867596|Q1178627|Q946143|Q140314|Q207680|Q187525|Q2604016|Q348652|Q2347363|Q4279545|Q2024875|Q16371179|Q445572|Q2600596|Q2905597|Q15633865|Q714844|Q2080642|Q3650271|Q768463|Q1973746|Q1800487|Q1249860|Q956922|Q4477434|Q1859167|Q1963971|Q3495441|Q120352|Q1200570|Q1391609|Q116309|Q44811|Q1194400|Q2503011|Q272443|Q12866715|Q1485988|Q562272|Q4084875|Q3652283|Q1764908|Q236041|Q261243|Q12871602|Q1777686|Q 1783374|Q770336|Q231630|Q2426436|Q691813|Q549600|Q192173|Q932901|Q2474500|Q1011047|Q7359877|Q609885|Q35717|Q521295|Q1963069|Q2875860|Q2324420|Q271564|Q579080|Q1367287|Q1069959|Q219470|Q317040|Q2900570|Q1477592|Q3652021|Q709218|Q240871|Q446914|Q218435|Q1975365|Q2089129|Q2155213|Q37006|Q37008|Q161428|Q3651259|Q2210273|Q1199026|Q115880|Q2590014|Q3486560|Q941980|Q12869325|Q1417210|Q969541|Q12863156|Q1987828|Q724900|Q734315|Q2040044|Q244007|Q2596393|Q1971402|Q1142561|Q20562702|Q3649330|Q2639866|Q2917500|Q622816|Q186268|Q157372|Q20561864|Q2474490|Q1010960|Q843405|Q467659|Q372698|Q2026822|Q4453141|Q1178707|Q513727|Q217457|Q141829|Q2478899 DBQueryError from line 934 of /srv/mediawiki/php-1.27.0-wmf.19/includes/db/Database.php: A connection error occured. Query: SELECT rev_id,rev_content_format,rev_timestamp,page_latest,page_is_redirect,old_id,old_text,old_flags,epp_entity_id,epp_entity_type FROM `wb_entity_per_page` INNER JOIN `page` ON ((epp_page_id=page_id)) INNER JOIN `revision` ON ((page_latest=rev_id)) INNER JOIN `text` ON ((old_id=rev_text_id)) WHERE (epp_entity_id = '229755' AND epp_entity_type = 'item') OR (epp_entity_id = '603574' AND epp_entity_type = 'item') OR (epp_entity_id = '245160' AND epp_entity_type = 'item') OR (epp_entity_id = '282182' AND epp_entity_type = 'item') OR (epp_entity_id = '290801' AND epp_entity_type = 'item') OR (epp_entity_id = '16375275' AND epp_entity_type = 'item') OR (epp_entity_id = '909076' AND epp_entity_type = 'item') OR (epp_entity_id = '3648053' AND epp_entity_type = 'item') OR (epp_entity_id = '16379668' AND epp_entity_type = 'item') OR (epp_entity_id = '319486' AND epp_entity_type = 'item') OR (epp_entity_id = '328975' AND epp_entity_type = 'item') OR (epp_entity_id = '542017' AND epp_entity_type = 'item') OR (epp_entity_id = '768409' AND epp_entity_type = 'item') OR (epp_entity_id = '174885' AND epp_entity_type = 'item') OR (epp_entity_id = '778213' AND epp_entity_type = 'item') OR (epp_entity_id = '802523' AND epp_entity_type = 'item') OR (epp_entity_id = '1860439' AND epp_entity_type = 'item') OR (epp_entity_id = '179290' AND epp_entity_type = 'item') OR (epp_entity_id = '3736210' AND epp_entity_type = 'item') OR (epp_entity_id = '3214846' AND epp_entity_type = 'item') OR (epp_entity_id = '80227' AND epp_entity_type = 'item') OR (epp_entity_id = '2075554' AND epp_entity_type = 'item') OR (epp_entity_id = '467266' AND epp_entity_type = 'item') OR (epp_entity_id = '941948' AND epp_entity_type = 'item') OR (epp_entity_id = '1991462' AND epp_entity_type = 'item') OR (epp_entity_id = '1371376' AND epp_entity_type = 'item') OR (epp_entity_id = '18973' AND epp_entity_type = 'item') OR (epp_entity_id = '651895' AND epp_entity_type = 'item') OR (epp_entity_id
[Wikidata-bugs] [Maniphest] [Commented On] T131026: Keep getting internal_api_error_DBQueryError on a query
Addshore added a comment. The explain of the query: +--+-+++---+-+-+-+--+--+ | id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra | +--+-+++---+-+-+-+--+--+ |1 | SIMPLE | wb_entity_per_page | index | wb_epp_entity,wb_epp_page | wb_epp_page | 4 | NULL | 23158153 | Using where; Using index | |1 | SIMPLE | page | eq_ref | PRIMARY | PRIMARY | 4 | wikidatawiki.wb_entity_per_page.epp_page_id | 1 | | |1 | SIMPLE | revision | eq_ref | PRIMARY | PRIMARY | 4 | wikidatawiki.page.page_latest | 1 | | |1 | SIMPLE | text | eq_ref | PRIMARY | PRIMARY | 4 | wikidatawiki.revision.rev_text_id | 1 | | +--+-+++---+-+-+-+--+--+ 4 rows in set (0.04 sec) TASK DETAIL https://phabricator.wikimedia.org/T131026 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: hoo, Addshore, intracer, Ata, Base, Aklapper, Sethakill, dg711, D3r1ck01, Izno, Wikidata-bugs, aude, jayvdb, fbstj, Anomie, Mbch331, Legoktm ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T131026: Keep getting internal_api_error_DBQueryError on a query
Anomie added a comment. |1 | SIMPLE | wb_entity_per_page | index | wb_epp_entity,wb_epp_page | wb_epp_page | 4 | NULL | 23158153 | Using where; Using index | It's deciding to do a scan on the whole `wb_epp_page` index (estimated to be 23 million rows!) instead of using the `wb_epp_entity` index to fetch the up-to-292 matching rows, which is obviously going to take a very long time. Possibly it does this because the one bogus `(epp_entity_id = '502560238080' AND epp_entity_type = 'item')` has a value that exceeds the range of `int(10) unsigned` for the `epp_entity_id` field so it thinks it can't manage to use the index instead of realizing that one is just impossible. Interestingly, if the number isn't quoted (i.e. `epp_entity_id = 502560238080`), it does go ahead with the proper index. If you want to dig deeper into that sort of database-y goodness, you'd probably want to ask jcrespo. TASK DETAIL https://phabricator.wikimedia.org/T131026 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Anomie Cc: Anomie, hoo, Addshore, intracer, Ata, Base, Aklapper, Sethakill, dg711, D3r1ck01, Izno, Wikidata-bugs, aude, jayvdb, fbstj, Mbch331, Legoktm ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T131026: Keep getting internal_api_error_DBQueryError on a query
gerritbot added a comment. Change 282208 had a related patch set uploaded (by Addshore): WikiPageEntityMetaDataLookup force use wb_epp_entity index https://gerrit.wikimedia.org/r/282208 TASK DETAIL https://phabricator.wikimedia.org/T131026 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: gerritbot, Anomie, hoo, Addshore, intracer, Ata, Base, Aklapper, Sethakill, dg711, D3r1ck01, Izno, Wikidata-bugs, aude, jayvdb, fbstj, Mbch331, Legoktm ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T131026: Keep getting internal_api_error_DBQueryError on a query
gerritbot added a comment. Change 282208 merged by jenkins-bot: WikiPageEntityMetaDataLookup force non quoted entityId in select https://gerrit.wikimedia.org/r/282208 TASK DETAIL https://phabricator.wikimedia.org/T131026 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: jcrespo, gerritbot, Anomie, hoo, Addshore, intracer, Ata, Base, Aklapper, Sethakill, Lewizho99, Maathavan, dg711, D3r1ck01, Izno, Wikidata-bugs, aude, jayvdb, fbstj, Mbch331, Legoktm ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs