04.04.2017, 13:10, Dave Reynolds kirjoitti:
Not to detract from HDT in anyway but we routinely load 25M triple file
sets (Turtle) to TDB in around 10mins on modest cloud VMs and rather
faster on local desktops with modern SSDs. So HDT might still have some
load speed benefits but at that scale it is less than 2x and not hours
v.s. minutes.
Right, sorry, I made a mistake in my estimate.
With my modest laptop (i3-2330M, SSD), loading the Geonames dataset
(173M triples NT file) into TDB using tdbloader2 takes about 70 minutes,
so the loading rate is about 40k triples per second. The size of the
resulting TDB is 16GB.
-Osma
--
Osma Suominen
D.Sc. (Tech), Information Systems Specialist
National Library of Finland
P.O. Box 26 (Kaikukatu 4)
00014 HELSINGIN YLIOPISTO
Tel. +358 50 3199529
[email protected]
http://www.nationallibrary.fi
