RE: Resource requirements and configuration for loading a Wikidata dump

2020-06-09 Thread Hoffart, Johannes
nice to have this enabled by default). Thanks Johannes -Original Message- From: Andy Seaborne Sent: Monday, June 8, 2020 11:43 PM To: users@jena.apache.org Subject: Re: Resource requirements and configuration for loading a Wikidata dump Hi Johannes, On 08/06/2020 16:54, Hoffart

Resource requirements and configuration for loading a Wikidata dump

2020-06-08 Thread Hoffart, Johannes
Hi, I want to load the full Wikidata dump, available at https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.bz2 to use in Jena. I tried it using the tdb2.tdbloader with $JVM_ARGS set to -Xmx120G. Initially, the progress (measured by dataset size) is quick. It slows down very much