Igorkim78 claimed this task. Igorkim78 added a comment.
Changeset created to support reference URIs inlining: https://gerrit.wikimedia.org/r/#/c/wikidata/query/blazegraph/+/505642 Baseline collected for performance test: Data files loaded: 100 ttl gz files into an empty journal Total size of ttl.gz files: 7.9GB Number of triples in the journal: 1,114,293,494 Size of the journal: 116,122,910,720 bytes (100GB) Subjects in the journal: 135,711,041 Reference subjects in the journal: 7,206,942 (5.3% of all subjects) Load performance: Load time: 156278 seconds (43 hours) Load performance Average: 7122 mutations per second Load performance Stabilized (last 10 files): 4170 mutations per second Query performance measured for simple query select * {?s ?p ?o } with ?s bound to random subject from two sets, reference URIs and all other URIs except statement URIs: For reference URIs: Stabilized query performance after ~150K queries: 80 qps with average of 4 rows per result set Normalized query performance 320 rows per second. For other URIs: Stabilized query performance after ~150K queries: 70 qps with average of 5 rows per result set Normalized query performance 350 rows per second. In progress: reload journal with configurations: - reference URIs inlining, - reference URIs inlining, raw records disabled per T213210 <https://phabricator.wikimedia.org/T213210> - reference URIs inlining, INLINE_TEXT_LITERALS for short strings per T213210 <https://phabricator.wikimedia.org/T213210> and compare results with the baseline. TASK DETAIL https://phabricator.wikimedia.org/T213375 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78 Cc: Igorkim78, Aklapper, Gehel, Smalyshev, alaa_wmde, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
