Hi Paul,
The changesets are not sequential with modified date but with extraction
from Live so we move to the 2015 folder now
http://live.dbpedia.org/changesets/2015/
Dimtiris
On Fri, Mar 13, 2015 at 5:38 PM, Paul Wilton <pwil...@gmail.com> wrote:
> hey Dimitris
> just checking in on the live updates - its been a few days, but I don't
> see any of the gaps being filled between November 11th and March here :
> http://live.dbpedia.org/changesets/2014/
> ??
>
> thanks
> Paul
>
>
>
> On Mon, Mar 9, 2015 at 10:30 AM, Dimitris Kontokostas <jimk...@gmail.com>
> wrote:
>
>> like 30 minutes ago we processed up to 2014-11-16 22:42:24 so it should
>> catch up in a few days
>>
>> On Mon, Mar 9, 2015 at 4:20 PM, Paul Wilton <pwil...@gmail.com> wrote:
>>
>>> Okay so when you say the clean diffs, there is a big gap between Nov
>>> 12th and March 6th ?
>>> How is this gap filled in ?
>>>
>>>
>>>
>>> On Mon, Mar 9, 2015 at 2:13 PM, Dimitris Kontokostas <jimk...@gmail.com>
>>> wrote:
>>>
>>>>
>>>>
>>>> On Mon, Mar 9, 2015 at 4:02 PM, Paul Wilton <pwil...@gmail.com> wrote:
>>>>
>>>>> Great thanks
>>>>> I have some questions.
>>>>> If we have mirror running based on the 30th Sept 2014 dump, and were
>>>>> mirrored up to the Nov 24th last update before it broke, how do I use the
>>>>> files here to bring it up to date now ?
>>>>> http://live.dbpedia.org/changesets/
>>>>>
>>>>
>>>> If you use the clean update diffs you should recover from the
>>>> mis-alignment between the restored backup and the diffs generated after the
>>>> backup date
>>>>
>>>>
>>>>>
>>>>>
>>>>> What is the purpose the 14Gb 2014 tar.gz file ? (it looks clear that
>>>>> our current updater is not going to cope with that, as you have deviated
>>>>> from the file/disk structure)
>>>>>
>>>>
>>>> no, this is just a diff dump for people who want to download the whole
>>>> 2014 changeset locally
>>>>
>>>>
>>>>>
>>>>> and will the abstracts eventually be brought up to date too (so no
>>>>> gaps) - these are important to us
>>>>>
>>>>
>>>> Yes, we need change some infrastructure to properly support them but
>>>> will be back soon. I suggest you use the abstracts from the static dumps in
>>>> a separate graph until we tackle this.
>>>> FYI, We now plan to provide two static releases per year (April &
>>>> October)
>>>>
>>>>
>>>>
>>>>>
>>>>> thanks
>>>>> Paul
>>>>>
>>>>>
>>>>> On Mon, Mar 9, 2015 at 1:33 PM, Dimitris Kontokostas <
>>>>> jimk...@gmail.com> wrote:
>>>>>
>>>>>> Hi Paul, all
>>>>>>
>>>>>> Live is running again. For now I disabled abstracts until we get
>>>>>> up-to-date with the latest wikipedia updates
>>>>>> I adapted a bit more the diff format and split it in 4 files to make
>>>>>> it compatible with external tools
>>>>>>
>>>>>> Main diff (like before)
>>>>>> * added -> triples to add
>>>>>> * removed -> triples to delete
>>>>>>
>>>>>> the following 2 are for clean updates (optional to execute)
>>>>>> * reinserted -> unchanged triples that can be reinserted
>>>>>> * clear -> delete queries that clear all triples for a resource
>>>>>>
>>>>>> and the proper order for execution is: removed, clear, reinserted,
>>>>>> added
>>>>>>
>>>>>> As mentioned earlier the clean updates are meant to cover bugs in
>>>>>> different stages of the update process and are optional
>>>>>> Since I recovered from an older (~1 month) backup I marked all
>>>>>> records to perform a clean update.
>>>>>> After all records are processed clean updates will be performed after
>>>>>> every 5 extractions of a wikipedia page
>>>>>>
>>>>>> The live-mirror tool is updated as well
>>>>>> https://github.com/dbpedia/dbpedia-live-mirror
>>>>>>
>>>>>>
>>>>>> On Tue, Mar 3, 2015 at 5:50 PM, Paul Wilton <pwil...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Hi Dimitris
>>>>>>> Any progress on this ?
>>>>>>>
>>>>>>> thanks and kind regards
>>>>>>> Paul
>>>>>>>
>>>>>>> On Wed, Feb 4, 2015 at 1:52 PM, Dimitris Kontokostas <
>>>>>>> jimk...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Paul , Kingsley,
>>>>>>>>
>>>>>>>> We have some server issues that we are trying to solve and Live
>>>>>>>> will be hopefully be up again by mid/end-February.
>>>>>>>>
>>>>>>>> Best,
>>>>>>>> Dimitris
>>>>>>>>
>>>>>>>>
>>>>>>>> On Tue, Feb 3, 2015 at 6:02 PM, Kingsley Idehen <
>>>>>>>> kide...@openlinksw.com> wrote:
>>>>>>>>
>>>>>>>>> On 2/3/15 5:24 AM, Paul Wilton wrote:
>>>>>>>>>
>>>>>>>>>> Hi Dimitris
>>>>>>>>>> The dbpedia live change sets have been stuck for some while at
>>>>>>>>>> Nov 12th
>>>>>>>>>> Any updates on when this is going to start working again.
>>>>>>>>>>
>>>>>>>>>> thanks
>>>>>>>>>> Paul
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Dimitris,
>>>>>>>>>
>>>>>>>>> I am increasingly confused as to why this is happening. Why is
>>>>>>>>> MySQL playing a pivot role in a workflow for which it is ultimately
>>>>>>>>> ill-suited, as demonstrated by the the current state of affairs?
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Regards,
>>>>>>>>>
>>>>>>>>> Kingsley Idehen
>>>>>>>>> Founder & CEO
>>>>>>>>> OpenLink Software
>>>>>>>>> Company Web: http://www.openlinksw.com
>>>>>>>>> Personal Weblog 1: http://kidehen.blogspot.com
>>>>>>>>> Personal Weblog 2: http://www.openlinksw.com/blog/~kidehen
>>>>>>>>> Twitter Profile: https://twitter.com/kidehen
>>>>>>>>> Google+ Profile: https://plus.google.com/+KingsleyIdehen/about
>>>>>>>>> LinkedIn Profile: http://www.linkedin.com/in/kidehen
>>>>>>>>> Personal WebID: http://kingsley.idehen.net/
>>>>>>>>> dataspace/person/kidehen#this
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ------------------------------------------------------------------------------
>>>>>>>>> Dive into the World of Parallel Programming. The Go Parallel
>>>>>>>>> Website,
>>>>>>>>> sponsored by Intel and developed in partnership with Slashdot
>>>>>>>>> Media, is your
>>>>>>>>> hub for all things parallel software development, from weekly
>>>>>>>>> thought
>>>>>>>>> leadership blogs to news, videos, case studies, tutorials and
>>>>>>>>> more. Take a
>>>>>>>>> look and join the conversation now.
>>>>>>>>> http://goparallel.sourceforge.net/
>>>>>>>>> _______________________________________________
>>>>>>>>> Dbpedia-discussion mailing list
>>>>>>>>> Dbpedia-discussion@lists.sourceforge.net
>>>>>>>>> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Kontokostas Dimitris
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Kontokostas Dimitris
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Kontokostas Dimitris
>>>>
>>>
>>>
>>
>>
>> --
>> Kontokostas Dimitris
>>
>
>
--
Kontokostas Dimitris
------------------------------------------------------------------------------
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the
conversation now. http://goparallel.sourceforge.net/
_______________________________________________
Dbpedia-discussion mailing list
Dbpedia-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
