| Gehel added a comment. |
A few notes (without much thinking, so don't read too much into them):
- WDQS nodes are operated in a "share nothing" mode. Which means that each node is responsible to pull it's data from different places (wikidata, categories dumps, ...). This total independence between the nodes is a very nice property in term of reliablity, easy management, etc... but it also means that there is no single write interface to any of our WDQS clusters.
- As part of reimaging a WDQS node, we do a full data reimport, starting with a dump of wikidata, and replaying updates from the date of the dump (either from recent changes or from kafka). Any additional data source needs to have a way to be replayed as well.
TASK DETAIL
EMAIL PREFERENCES
To: Gehel
Cc: Gehel, Smalyshev, Jonas, Aklapper, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Agabi10, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
Cc: Gehel, Smalyshev, Jonas, Aklapper, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Agabi10, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
