Re: Resource requirements and configuration for loading a Wikidata dump

2020-06-08 Thread Martynas Jusevičius
Wouldn't it be a good idea to have a page in the Fuseki/TDB2 documentation with benchmark results and/or user-reported loading statistics, including hardware specs? It would also be useful to map such specs to the AWS instance types: https://aws.amazon.com/ec2/instance-types/ On Mon, Jun 8, 2020

Re: Data backup and restore

2020-06-08 Thread Andy Seaborne
Hi Tim, Some context for our readers: gTDB and xTDB are different ways of using TDB. Last I heard, it was TDB1, not that makes very much difference here. gTDB - one graph stored in the default graph of a TDB database. Many graphs, many databases. xTDB - single, shared TDB database with grap

Re: Resource requirements and configuration for loading a Wikidata dump

2020-06-08 Thread Andy Seaborne
Hi Johannes, On 08/06/2020 16:54, Hoffart, Johannes wrote: Hi, I want to load the full Wikidata dump, available at https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.bz2 to use in Jena. I tried it using the tdb2.tdbloader with $JVM_ARGS set to -Xmx120G. Initially, the progress

Re: Resource requirements and configuration for loading a Wikidata dump

2020-06-08 Thread Andy Seaborne
Hi Johannes, On 08/06/2020 16:54, Hoffart, Johannes wrote: Hi, I want to load the full Wikidata dump, available at https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.bz2 to use in Jena. I tried it using the tdb2.tdbloader with $JVM_ARGS set to -Xmx120G. Initially, the progress

Re: Resource requirements and configuration for loading a Wikidata dump

2020-06-08 Thread Ahmed El-Roby
Thanks Johannes for starting this thread. I am facing the exact same problem with tdb2. For any significantly large file for that matter, it takes forever to load. I hope this problem has a solution. Thank you. -Ahmed On Mon, Jun 8, 2020 at 11:55 AM Hoffart, Johannes wrote: > Hi, > > I want to l

Resource requirements and configuration for loading a Wikidata dump

2020-06-08 Thread Hoffart, Johannes
Hi, I want to load the full Wikidata dump, available at https://dumps.wikimedia.org/wikidatawiki/entities/latest-all.ttl.bz2 to use in Jena. I tried it using the tdb2.tdbloader with $JVM_ARGS set to -Xmx120G. Initially, the progress (measured by dataset size) is quick. It slows down very much

Data backup and restore

2020-06-08 Thread Tim Flicker
Hi Jena Community, I'm working on an auto data backup and restore feature for our platform which uses Jena for data access (gTDB and xTDB). The requirement is to have the application up during the backup operation although it can be taken down for restore. I've been looking into the tdbbackup

Re: SelectBuilder from query string?

2020-06-08 Thread Martynas Jusevičius
No solution to this? Kind of diminishes the utility of having a query builder if it can't parse an existing query. On Tue, May 26, 2020 at 10:40 AM Martynas Jusevičius wrote: > > Hi, > > I have an existing SELECT query string that I want to add VALUES to. > > I found that I can build VALUES with