Hello!

We are working on a new update process for WDQS, based on a stream of
changes [1]. While not exactly the solution you are looking for, this might
be a building block for differential dumps. For example by aggregating the
stream of changes over a period of time.

Note that at this point, the stream of changes that we construct is
published to an internal Kafka that isn't exposed to the internet. If there
is enough interest, we might be able to expose it in some form.

Have fun!

   Guillaume



[1] https://phabricator.wikimedia.org/T244590


On Fri, Feb 26, 2021 at 8:49 AM Federico Leva (Nemo) <nemow...@gmail.com>
wrote:

> Kingsley Idehen via Wikidata, 25/02/21 19:26:
> > Is there a mechanism in place for producing and publishing delta-centric
> > dumps for Wikidata?
>
> There's
> https://phabricator.wikimedia.org/T72246
>
> Magnus Manske used to maintain some biweekly dumps as part of its WDQ
> service, IIRC.
>
> Federico
>
> _______________________________________________
> Wikidata mailing list
> Wikidata@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikidata
>


-- 
*Guillaume Lederrey* (he/him)
Engineering Manager
Wikimedia Foundation <https://wikimediafoundation.org/>
_______________________________________________
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata

Reply via email to