Pierre,
Being are very large dataset have you tuned your Virtuoso Server for running on
the target OS as detailed at:
http://docs.openlinksw.com/virtuoso/rdfperformancetuning.html
You can also use the bulk loader scripts we use for loading large datasets at
if not already doing so:
http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtBulkRDFLoader
Note we have quite sometime ago loaded other related Bio2RDF and Nuerocommons
datasets into an Amazon Virtuoso EC2 AMI enabling the instantiation and loaded
of these datasets in a fraction of the time it would take to load the from
scratch:
http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtInstallationEC2
Best Regards
Hugh Williams
Professional Services
OpenLink Software
Web: http://www.openlinksw.com
Support: http://support.openlinksw.com
Forums: http://boards.openlinksw.com/support
Twitter: http://twitter.com/OpenLink
On 15 Feb 2011, at 15:54, Pierre-Yves Chibon wrote:
> Hi,
>
> I have been trying to load the uniprot rdf file into virtuoso. Uniprot
> provides a rather big file [1] which uncompressed is ~133GB.
>
> I have been trying to load it into virtuoso (6.1.2) but it seems that
> virtuoso's performance drops after a while and eventually hangs.
> We tried to load it using the method in:
> http://docs.openlinksw.com/virtuoso/fn_rdf_load_rdfxml_mt.html
>
> I am then wondering if this is the best approach. I think bio2rdf uses a
> perl script to load the data, would this be a preferred approach ? (Has
> anyone such script for rdf files?)
>
> Thanks in advance for your help,
> Pierre
>
>
> [1]
> ftp://ftp.uniprot.org/pub/databases/uniprot/current_release/rdf/uniprot.rdf.gz
>
> ------------------------------------------------------------------------------
> The ultimate all-in-one performance toolkit: Intel(R) Parallel Studio XE:
> Pinpoint memory and threading errors before they happen.
> Find and fix more than 250 security defects in the development cycle.
> Locate bottlenecks in serial and parallel code that limit performance.
> http://p.sf.net/sfu/intel-dev2devfeb
> _______________________________________________
> Virtuoso-users mailing list
> Virtuoso-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users
