| Anomie added a comment. |
For eowiki, with the default batch size (500):
- Each transaction took around 1-2 seconds during the initial run.
- The initial run took 13855 seconds to insert 6306218 (there was a bug that made it skip the first row, BTW).
- The second run (after fixing the bug) took 47 seconds to process 2 rows.
- The third run, with --reuse-content, took 326 seconds to load the existing rows then 48 seconds to run through and find nothing to do. Maximum resident set size reported by /usr/bin/time -v was 777008 K.
- The fourth run, without --reuse-content, took 45 seconds and reported MRSS of 109048 K.
- Sanity checks passed.
The next test will be to truncate the tables and re-run eowiki with a different batch size to see what difference that makes to the run time.
TASK DETAIL
EMAIL PREFERENCES
To: Anomie
Cc: ops-monitoring-bot, Marostegui, jcrespo, Aklapper, aude, Addshore, Anomie, Jdforrester-WMF, gerritbot, Abit, daniel, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331
Cc: ops-monitoring-bot, Marostegui, jcrespo, Aklapper, aude, Addshore, Anomie, Jdforrester-WMF, gerritbot, Abit, daniel, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, LawExplorer, Lewizho99, JJMC89, Maathavan, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
