Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
Hi Mohamed, You were right, I checked my settings and the tool does start at the correct date. I must have done something wrong earlier. Best regards, Karel On Fri, Sep 16, 2011 at 5:26 PM, Mohamed Morsey wrote: > Hi Karel, > > On 09/16/2011 04:51 PM, karel braeckman wrote: >> >> Hi guys, >> >>

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Mohamed Morsey
Hi Karel, On 09/16/2011 04:51 PM, karel braeckman wrote: > Hi guys, > > First of all, thanks for all the suggestions. I changed my settings > according to your suggestions, and at first the problem was the same > (100% CPU for quite a while when deleting triples) but after a while > (~10 minutes)

[Dbpedia-discussion] DBpedia-Live mirrors?

2011-09-16 Thread Kingsley Idehen
All, Following the earlier thread re. DBpedia-Live and Virtuoso. I am curious about the existence and experiences of others re. DBpedia-Live instance mirrors that tap into live.dbpedia.org . If these instances are public, then we should make them known to the public as DataDNS is still a fun

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Kingsley Idehen
On 9/16/11 10:51 AM, karel braeckman wrote: -16-16-01), could this be a bug? @Mohamed: It really did take two days to fill the store with the DBpedia live dump. Initially it was fast, but it got slower and slower. There already was the default DBpedia dump (not the live version) inserted int

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Mohamed Morsey
Hi Karel, On 09/16/2011 04:51 PM, karel braeckman wrote: > Hi guys, > > First of all, thanks for all the suggestions. I changed my settings > according to your suggestions, and at first the problem was the same > (100% CPU for quite a while when deleting triples) but after a while > (~10 min

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
Hi guys, First of all, thanks for all the suggestions. I changed my settings according to your suggestions, and at first the problem was the same (100% CPU for quite a while when deleting triples) but after a while (~10 minutes) Virtuoso completed the action and now the tool seems to be running ok

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Patrick van Kleef
Hi Karel, > Forgot to mention the machine details: > > 24GB RAM > 2x quadcore Xeon E5540 2.5GHz > Virtuoso data is on SSD disks Your parameters look ok, but you may want to try adding the following: [Parameters] ... DefaultIsolation = 2 ... which sets a different

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Kingsley Idehen
On 9/16/11 9:41 AM, karel braeckman wrote: And the Virtuoso config is a single instance: OpenLink Virtuoso version 06.01.3127, on Linux (x86_64-unknown-linux-gnu), Single Edition There are currently about 300M triples in the store. I read that 500M per 16GB or RAM should still run ok, so I don'

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Mohamed Morsey
Hi Karel, First of all try these settings which we use for our DBpedia-Live virtuoso instance: NumberOfBuffers= 80 MaxDirtyBuffers= 60 and please don't forget to restart you Virtuoso server after changing those settings, in order for them to take effect. Secondly

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
And the Virtuoso config is a single instance: OpenLink Virtuoso version 06.01.3127, on Linux (x86_64-unknown-linux-gnu), Single Edition There are currently about 300M triples in the store. I read that 500M per 16GB or RAM should still run ok, so I don't think a clustered version should be necessa

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
Forgot to mention the machine details: 24GB RAM 2x quadcore Xeon E5540 2.5GHz Virtuoso data is on SSD disks Regards, Karel On Fri, Sep 16, 2011 at 1:57 PM, karel braeckman wrote: > Hi all, > > We tried setting up DBpedia Live on one of our local servers and keep it in > sync with the official

[Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
Hi all, We tried setting up DBpedia Live on one of our local servers and keep it in sync with the official DBpedia live, using the dbpintegrator tool. Our setup is documented here: http://medialoep.vrtmedialab.be/blog/?p=96. However, adding / deleting triples from / to Virtuoso has become extreme