Zbyszko added a comment.
The most important parameter to streaming updater is related to storage - we have a huge surplus of computing resources in WDQS streaming updater, since edit rate is much lower in SDoC, there is no risk when it comes to throughput. The storage needs on the other hand are are derived from the data size itself, best represented as triple count. Currently WDQS sits at ~13B. WCQS is ~2.8T, which means about 21% of storage used by WDQS. Since we planned 2x resources required for WDQS Streaming Updater, we are safe to proceed. It would make sense to add some resources to offset WCQS growth in the near future. TASK DETAIL https://phabricator.wikimedia.org/T280485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, RKemper, Gehel, MPhamWMF, wkandek, JMeybohm, CBogen, Namenlos314, jijiki, Gq86, Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Dzahn
_______________________________________________ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
