Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-19 Thread Mohamed Morsey
Hi Karel, On 09/19/2011 11:33 AM, karel braeckman wrote: > Hi Guys, > > I have let the dbpintegrator run over the weekend, but it got stuck > again (same behavior as mentioned before: Virtuoso stuck at 100% CPU > use). The good news is we think we found the problem. > > We found something strange

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-19 Thread karel braeckman
Hi Guys, I have let the dbpintegrator run over the weekend, but it got stuck again (same behavior as mentioned before: Virtuoso stuck at 100% CPU use). The good news is we think we found the problem. We found something strange in the update file with triples to delete where things got stuck. The

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
Hi Mohamed, You were right, I checked my settings and the tool does start at the correct date. I must have done something wrong earlier. Best regards, Karel On Fri, Sep 16, 2011 at 5:26 PM, Mohamed Morsey wrote: > Hi Karel, > > On 09/16/2011 04:51 PM, karel braeckman wrote: >> >> Hi guys, >> >>

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Mohamed Morsey
Hi Karel, On 09/16/2011 04:51 PM, karel braeckman wrote: > Hi guys, > > First of all, thanks for all the suggestions. I changed my settings > according to your suggestions, and at first the problem was the same > (100% CPU for quite a while when deleting triples) but after a while > (~10 minutes)

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Kingsley Idehen
On 9/16/11 10:51 AM, karel braeckman wrote: -16-16-01), could this be a bug? @Mohamed: It really did take two days to fill the store with the DBpedia live dump. Initially it was fast, but it got slower and slower. There already was the default DBpedia dump (not the live version) inserted int

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Mohamed Morsey
Hi Karel, On 09/16/2011 04:51 PM, karel braeckman wrote: > Hi guys, > > First of all, thanks for all the suggestions. I changed my settings > according to your suggestions, and at first the problem was the same > (100% CPU for quite a while when deleting triples) but after a while > (~10 min

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
Hi guys, First of all, thanks for all the suggestions. I changed my settings according to your suggestions, and at first the problem was the same (100% CPU for quite a while when deleting triples) but after a while (~10 minutes) Virtuoso completed the action and now the tool seems to be running ok

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Patrick van Kleef
Hi Karel, > Forgot to mention the machine details: > > 24GB RAM > 2x quadcore Xeon E5540 2.5GHz > Virtuoso data is on SSD disks Your parameters look ok, but you may want to try adding the following: [Parameters] ... DefaultIsolation = 2 ... which sets a different

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Kingsley Idehen
On 9/16/11 9:41 AM, karel braeckman wrote: And the Virtuoso config is a single instance: OpenLink Virtuoso version 06.01.3127, on Linux (x86_64-unknown-linux-gnu), Single Edition There are currently about 300M triples in the store. I read that 500M per 16GB or RAM should still run ok, so I don'

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread Mohamed Morsey
Hi Karel, First of all try these settings which we use for our DBpedia-Live virtuoso instance: NumberOfBuffers= 80 MaxDirtyBuffers= 60 and please don't forget to restart you Virtuoso server after changing those settings, in order for them to take effect. Secondly

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
And the Virtuoso config is a single instance: OpenLink Virtuoso version 06.01.3127, on Linux (x86_64-unknown-linux-gnu), Single Edition There are currently about 300M triples in the store. I read that 500M per 16GB or RAM should still run ok, so I don't think a clustered version should be necessa

Re: [Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
Forgot to mention the machine details: 24GB RAM 2x quadcore Xeon E5540 2.5GHz Virtuoso data is on SSD disks Regards, Karel On Fri, Sep 16, 2011 at 1:57 PM, karel braeckman wrote: > Hi all, > > We tried setting up DBpedia Live on one of our local servers and keep it in > sync with the official

[Dbpedia-discussion] Performance issues when setting up local DBpedia live

2011-09-16 Thread karel braeckman
Hi all, We tried setting up DBpedia Live on one of our local servers and keep it in sync with the official DBpedia live, using the dbpintegrator tool. Our setup is documented here: http://medialoep.vrtmedialab.be/blog/?p=96. However, adding / deleting triples from / to Virtuoso has become extreme