Ladsgroup added a comment.
In T154601#6202952 <https://phabricator.wikimedia.org/T154601#6202952>, @Addshore wrote: > In T154601#6202918 <https://phabricator.wikimedia.org/T154601#6202918>, @Lucas_Werkmeister_WMDE wrote: > >> That said, I tried to run the queries against stat1007. The properties query completes in 18 seconds, that’s fine. But the items query just kept running, so I killed it after one hour or so (I don’t know how long exactly). This might need to be optimized further. > > Yup, with the old wb_terms storage this script was disabled due to the query never really finishing/causing too much load. > Hence the desire to switch to Hadoop rather than using SQL. I might be missing something obvious but that was the old horrible term store and I assume that since the new tables are ten times smaller, this would be possible (specially that we don't need to go through wbt_text for example). Can we try with the new term store SQL before trying hadoop? TASK DETAIL https://phabricator.wikimedia.org/T154601 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup Cc: Lucas_Werkmeister_WMDE, Ladsgroup, Bugreporter, WMDE-leszek, Aleksey_WMDE, Ivanhercaz, VIGNERON, Lydia_Pintscher, GoranSMilovanovic, gerritbot, Addshore, Sjoerddebruin, Aklapper, Blissjay007, Oblanco79, Alter-paule, Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, Iflorez, darthmon_wmde, Kent7301, alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
