dcausse created this task. dcausse added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION As a maintainer of the wdqs streaming updater I want the StateExtractionJob to run in a reasonable amount of time so that I don't have to downtime the flink application for too long. As of today running the state extraction job on an existing savepoint takes 6hours, this is way too slow and something is probably going wrong. Writing a similar size savepoint from CSV files take less than one minute. AC: - StateExtractionJob runs in less than 10minutes for wikidata TASK DETAIL https://phabricator.wikimedia.org/T283591 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: dcausse, Aklapper, MPhamWMF, CBogen, Namenlos314, Gq86, Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles
_______________________________________________ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
