Re: [Dbpedia-discussion] Extraction Framework Parallelisation

2013-10-16 Thread Jona Christopher Sahnwaldt
s/kernel/core/g On 16 October 2013 20:10, Jona Christopher Sahnwaldt wrote: > > > > On 16 October 2013 18:00, Magnus Knuth wrote: > >> Hi all, >> >> are there any efforts or strategies for parallelised extraction? The >> extraction framework obviously works single threaded > > > No it doesn't. W

Re: [Dbpedia-discussion] Extraction Framework Parallelisation

2013-10-16 Thread Jona Christopher Sahnwaldt
On 16 October 2013 18:00, Magnus Knuth wrote: > Hi all, > > are there any efforts or strategies for parallelised extraction? The > extraction framework obviously works single threaded No it doesn't. With the default settings, it should use all available CPU kernels. What makes you think so? whi

[Dbpedia-discussion] Extraction Framework Parallelisation

2013-10-16 Thread Magnus Knuth
Hi all, are there any efforts or strategies for parallelised extraction? The extraction framework obviously works single threaded which makes it a pretty long running process. Without to many changes to the code, would it be possible to split the pages-articles.xml source and run multiple insta