Re: [Wikidata-tech] Wikidata entity dumps on Labs

2016-05-18 Thread Marius Hoch
As far as I remember the sync only happens once a day. Depending on when the dump creation finishes, this means it showing up on labs can be severely delayed. If the dumps not being up to date is an issue, I'd rather suggest to just do two dumps a week, dump creation is cheap. Cheers, Marius

Re: [Wikidata-tech] Wikidata entity dumps on Labs

2016-05-18 Thread Lydia Pintscher
On Wed, May 11, 2016 at 9:17 AM Markus Krötzsch < mar...@semantic-mediawiki.org> wrote: > On 11.05.2016 08:28, Marius Hoch wrote: > > This time it took quite long to produce the dump in the first place > > (until after 8pm UTC for the gzip version, the bzip2 one didn't even > > finish until Tuesda

Re: [Wikidata-tech] Wikidata entity dumps on Labs

2016-05-11 Thread Markus Krötzsch
On 11.05.2016 08:28, Marius Hoch wrote: This time it took quite long to produce the dump in the first place (until after 8pm UTC for the gzip version, the bzip2 one didn't even finish until Tuesday). I presume that is due to one of the shards picking a slow database slave which significantly slo

Re: [Wikidata-tech] Wikidata entity dumps on Labs

2016-05-10 Thread Marius Hoch
This time it took quite long to produce the dump in the first place (until after 8pm UTC for the gzip version, the bzip2 one didn't even finish until Tuesday). I presume that is due to one of the shards picking a slow database slave which significantly slows that shard down. We should get new

Re: [Wikidata-tech] Wikidata entity dumps on Labs

2016-05-10 Thread Markus Krötzsch
Pushing this up a bit again. The 9 May dump is not available on labs yet. There is just the empty directory /public/dumps/public/wikidatawiki/entities/20160509/ I really wonder why it might be taking so long. Markus On 02.05.2016 21:36, Markus Kroetzsch wrote: Hi, I noticed that there is c