Hello Pallavi,
OWLIM-Lite is an in-memory RDF database, so the limitation on how much
it can store is given by the amount of available memory on the machine.
To be honest, we have no hard figures for the ratio of raw data size to
java heap required, but there is something in the FAQ about this:
http://owlim.ontotext.com/display/OWLIMv53/OWLIM+FAQ#OWLIMFAQ-HowmuchmemorydoesOWLIMLiteneed%3F
Loading very large datasets is not possible using the openrdf-sesame
workbench, it will cause most browsers problems, e.g. connection
time-out. Again, there is a small amount of info in the FAQ about this:
http://owlim.ontotext.com/display/OWLIMv53/OWLIM+FAQ#OWLIMFAQ-HowdoIloadlargeamountsofdataintoOWLIMSEorOWLIMEnterprise%3F
My suggestion, is to use the getting started application. This can load
a directory tree of rdf files, 'chunk' them automatically into
reasonable sized transactions and can apply various levels of data
validation. You can find how to use this utility for this purpose here:
http://owlim.ontotext.com/display/OWLIMv53/OWLIM-Lite+Configuration#OWLIM-LiteConfiguration-Bulkdataloading
In any case, to load freebase into OWLIM-Lite you will certainly need a
lot of memory. If you manage it, then I can imagine that it will take a
lot of time to shutdown and to restart, as this is the only time that
the statement indices are persisted/initialised. OWLIM-Lite s not
recommended for such a large repository if you require any kind of
resilience, start/stop performance or reliability. OWLIM-SE would be a
better fit for this.
I hope this helps,
barry
Barry Bishop
OWLIM Product Manager
Ontotext AD
Tel: +43 650 2000 237
email: barry.bis...@ontotext.com
skype: bazbishop
www.ontotext.com
On 31/01/13 08:24, Pallavi Karanth wrote:
Hello Sir/Mam,
We have downloaded and installed OWLIM-Lite - version 5.3.5777
successfully on Ubuntu,
We tried creating an OWLIM repository using openrdf workbench by
specifying default parameters and were able to add data of the size of
few MBs,
On giving a N-Quad file of the size 5GB to be added to this
repository, we get connection reset error in tomcat (We have also
increased the java heap memory size for tomcat instance to 4GB)..
May we know if OWLIM - Lite can support data of the size 16GB? We
intend to use OWLIM to upload freebase data for now,
Thanks in advance,
--
Regs,
Pallavi
Linkedin Profile : http://in.linkedin.com/pub/pallavi-karanth/b/b71/26b
Blogs:
http://semanticisingtheworld.blogspot.com/
http://kudlupallavi.blogspot.com <http://kudlupallavi.blogspot.com/>
"You have achieved success if you have lived well, laughed often
and loved much."
- Author Unknown
"Being the richest man in the cemetery doesn't matter to me ... Going
to bed at night saying we've done something wonderful... that's what
matters to me."
--Steve Jobs [The Wall Street Journal, May 25, 1993]
_______________________________________________
Owlim-discussion mailing list
Owlim-discussion@ontotext.com
http://ontomail.semdata.org/cgi-bin/mailman/listinfo/owlim-discussion
_______________________________________________
Owlim-discussion mailing list
Owlim-discussion@ontotext.com
http://ontomail.semdata.org/cgi-bin/mailman/listinfo/owlim-discussion
