jiusheng chen wrote: > Hi Hugh, > > To speed up loading large dataset like dbpedia into one PC, if > parallel loading (split large data into several segments, loading > these segments in parallel) is effective? any further suggestions? > Hi Jiusheng,
I've usually had about 3 ISQL processes per core loading the data set. I didn't bother to split the dbpedia dataset into any smaller segments than it was to begin with. You'll need RAM - plenty of it. A good rule of thumb would be to give Virtuoso at least 2/3 of total RAM in the system. See section [Parameters] in virtuoso.ini - the ones you're interested about are NumberOfBuffers and MaxDirtyBuffers. A handy tip: you can spawn a new ISQL process when you run a stored procedure/query by using the ampersand in the ISQL command line. I.e. SQL> my_lengthy_stored_proc()& Best Regards, Yrjänä > On Wed, Sep 3, 2008 at 5:27 PM, Hugh Williams > <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> wrote: > > Hi Jiusheng, > > The isql program has a "shutdown" command that can be used to > shutdown the Virtuoso instance it is connected to: > > $ ./isql 1111 > Connected to OpenLink Virtuoso > Driver: 05.00.3033 OpenLink Virtuoso ODBC Driver > OpenLink Interactive SQL (Virtuoso), version 0.9849b. > Type HELP; for help and EXIT; to exit. > SQL> shutdown(); > $ > > Best Regards > Hugh Williams > Professional Services > OpenLink Software > Web: http://www.openlinksw.com > Support: http://support.openlinksw.com > Forums: http://boards.openlinksw.com/support > > On 3 Sep 2008, at 08:09, jiusheng chen wrote: > >> Hi Hugh, >> >> Thanks for your reply. >> >> Perhaps I got a incorrect impression before. >> >> BTW, how to stop the server instance? just kill the virtuoso_t job? >> >> On Tue, Sep 2, 2008 at 4:58 PM, Hugh Williams >> <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>> wrote: >> >> Hi Jiusheng, >> >> The Virtuoso isql program is a simple Interactive SQL client >> side tool for accessing a Virtuoso server instance on the >> specified hostname and port number (localhost, 1111 being >> defaults), and as such will always assume the specified >> server has already been started by some other means >> regardless of version. >> >> If their is specific documentation you read that gave the >> impression that isql starts a Virtuoso instance then please >> provide a link or details of it such that we can have it >> corrected or made clear as to what isql does ... >> >> Best Regards >> Hugh Williams >> Professional Services >> OpenLink Software >> Web: http://www.openlinksw.com >> Support: http://support.openlinksw.com >> Forums: http://boards.openlinksw.com/support >> >> >> >> On 2 Sep 2008, at 02:21, jiusheng chen wrote: >> >>> Thank you, guys. >>> >>> You are right, there needs to start virtuoso-t explicitly >>> before using isql. But it seemed to me this step is not >>> necessary for version 5.0.7. <http://5.0.7.> >>> >>> On Mon, Sep 1, 2008 at 5:01 PM, Tim Haynes >>> <[EMAIL PROTECTED] >>> <mailto:[EMAIL PROTECTED]>> wrote: >>> >>> jiusheng chen wrote: >>> > Hi Tim, >>> > >>> > I installed it, but seems it doesn't work. >>> > >>> > [EMAIL PROTECTED]:/disk1/sda/datasets$ isql >>> > OpenLink Interactive SQL (Virtuoso), version 0.9849b. >>> > Type HELP; for help and EXIT; to exit. >>> > SQL> select * from DB.DBA.SYS_USERS; >>> > >>> > *** Error S2801: [Virtuoso Driver]CL033: Connect failed to >>> > localhost:1111 = localhost:1111. >>> > at line 1 of Top-Level: >>> > select * from DB.DBA.SYS_USERS >>> > >>> > >>> > Virtuoso was installed with default settings. >>> > >>> Hi, >>> >>> This looks like you haven't started it. From the >>> ${prefix}/var/lib/db/ >>> directory, run virtuoso-t -df to make it start in the >>> foreground and once >>> it claims to be online, isql should work. If not, please >>> include teh server >>> debug output too. >>> >>> Regards, >>> >>> ~Tim >>> -- >>> Tim Haynes >>> Product Development Consultant >>> OpenLink Software >>> <http://www.openlinksw.com/> >>> >>> >>> >>> >>> -- >>> Thanks, >>> Chen Jiusheng >> >> >> >> >> -- >> Thanks, >> Chen Jiusheng > > > > > -- > Thanks, > Chen Jiusheng > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > ------------------------------------------------------------------------ > > _______________________________________________ > Dbpedia-discussion mailing list > Dbpedia-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion > -- Yrjana Rankka | [EMAIL PROTECTED] Developer, Virtuoso Team | http://www.openlinksw.com | Making Technology Work For You ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Dbpedia-discussion mailing list Dbpedia-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
