[Wikidata-bugs] [Maniphest] [Commented On] T192871: Enable the query service updater to optionally use RecentChangesLinked for RC input

2018-04-25 Thread Smalyshev
Smalyshev added a comment. The dateModified triple is a global check, so yes if we do have multiple updaters running in parallel, we might not catch the failure of only one of them with a single check. There's a deeper question behind this - one that is also relevant for Kafka poller alone. If we

[Wikidata-bugs] [Maniphest] [Commented On] T192871: Enable the query service updater to optionally use RecentChangesLinked for RC input

2018-04-25 Thread Gehel
Gehel added a comment. In T192871#4156362, @Addshore wrote: Per T192963: Store Kafka poller position data in the WDQS database does this mean that right now kafka doesn't actually store the latest timestamp or any position in the query service? How does this affect the dateModified triple used

[Wikidata-bugs] [Maniphest] [Commented On] T192871: Enable the query service updater to optionally use RecentChangesLinked for RC input

2018-04-25 Thread Addshore
Addshore added a comment. Maybe we need to look for solution that includes T192963: Store Kafka poller position data in the WDQS database and have some model that can store separate data sets for different poller models. I was also looking at drafting a setup for the dockerized wikibase and query