https://bugzilla.wikimedia.org/show_bug.cgi?id=67117
Dimitris Kontokostas <jimk...@gmail.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |jimk...@gmail.com
--- Comment #8 from Dimitris Kontokostas <jimk...@gmail.com> ---
Without looking at the code we had a few comments on this extension that also
relate to performance [1] [2].
The basic idea is whether the client (wiki mirror) can delay the poll (e.g.
5-10 minutes) and aggregate multiple edits of the same page into one. OAI had a
native support for this.
The reason is that in DBpedia Live, we had a lot of scaling issues when the
database was in constant update (even with the aggregated edits with 5-10
minutes poll delay) and using in parallel the MW API to get data for
extraction.
I don't know if this is supported by the PubSubHubbub specs but the client
could do some aggregation manually.
We had another query for Hub data persistence but not sure which thread is more
appropriate for this question.
[1] https://lists.wikimedia.org/pipermail/wikidata-tech/2014-July/000533.html
[2] https://lists.wikimedia.org/pipermail/wikidata-tech/2014-July/000539.html
--
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
