Re: [Virtuoso-users] virtuoso isql batch mode?
Hugh -- To clarify, I mean that I just want the SQL output without any headers or footers. This is for sysadmin-type scripting rather than for actual DB use. For example, the command: echo select U_NAME FROM SYS_USERS WHERE U_ID=106;|\ /opt/virtuoso/bin/isql dba $dba_password results in: Connected to OpenLink Virtuoso Driver: 07.20.3212 OpenLink Virtuoso ODBC Driver OpenLink Interactive SQL (Virtuoso), version 0.9849b. Type HELP; for help and EXIT; to exit. SQL U_NAME VARCHAR NOT NULL ___ SPARQL 1 Rows. -- 1 msec. SQL What I want is to get just the actual one line of output: SPARQL I can improve on the above somewhat through an approach like this: $ cat foo.sql set MESSAGE OFF; set VERBOSE OFF; set BANNER OFF; select U_NAME FROM SYS_USERS WHERE U_ID=106; $ /opt/virtuoso/bin/isql dba `cat $dba_password_file` foo.sql Connected to OpenLink Virtuoso Driver: 07.20.3212 OpenLink Virtuoso ODBC Driver SPARQL But I still get the Connected and Driver: output. The isql variables / macros are set too late to help me. So presumably, a command-line option is needed. It is possible to script around this with suitable head, tail, and grep pipe postprocessing. However, those kinds of scripts tend to be fragile in the face of software upgrades. The formats tend to change subtly between versions. So DB systems often provide a command-line option that just outputs raw data. sybase's isql command has such an option. mysql's mysql command has such an option. So does postgres's command. It would be nice if virtuoso's isql did as well, if it doesn't already. Thanks! - Morty On Tue, Apr 07, 2015 at 12:39:32AM +0100, Hugh Williams wrote: Hi Morty, Not sure what you mean by Batch mode”, Virtuoso has a “load filename;” command that can be used for executing multiple isql commands at once or are you seeking to be able to load a series sql command as part of one transaction and commit when done ? Best Regards Hugh Williams Professional Services OpenLink Software, Inc. // http://www.openlinksw.com/ Weblog -- http://www.openlinksw.com/blogs/ LinkedIn -- http://www.linkedin.com/company/openlink-software/ Twitter -- http://twitter.com/OpenLink Google+ -- http://plus.google.com/100570109519069333827/ Facebook -- http://www.facebook.com/OpenLinkSoftware Universal Data Access, Integration, and Management Technology Providers On 4 Apr 2015, at 20:59, Morty morty+virtu...@frakir.org wrote: Is there some way to put virtuoso isql into a true batch mode? Some other database system command-line interfaces provide a batch mode option that just displays results, not version banners, table headers, or time information. This is very handy for building scripts around. I can sort-of emulate this in isql by setting: set VERBOSE OFF; set BANNER OFF; set MESSAGE OFF; But I still get the Connected to and Driver lines. And I'm also concerned that later versions could add new sources of information. So it would be nice to have a command-line option that will set the options necessary to script cleanly, both now and in the future. Hopefully such a thing already exists, and I just didn't find it. If not, feature request: please implement such a mechanism. Note: this is currently under virtuoso open source version 7.2.0, under Linux. The commercial version is not an option at this time. - Morty -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/ ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users -- Mordechai T. Abzug Linux red-sonja 3.11.0-24-generic #42-Ubuntu SMP Fri Jul 4 21:19:31 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux A billion here, a billion there, sooner or later it adds up to real money. -Everett Dirksen -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net
Re: [Virtuoso-users] SPARQL query size limits (GET, POST, POST DIRECT)
Hi, On 7 Apr 2015, at 01:48, Hugh Williams hwilli...@openlinksw.com wrote: 10K is the maximum limit, see the following post: http://boards.openlinksw.com/phpBB3/viewtopic.php?f=12t=1377#p4422 in that thread you mention a 10 K limit (of bytes i assume) for GET. What are the limits for POST and POST DIRECT? Cheers, Jörn On 4 Apr 2015, at 18:45, Jörn Hees j_h...@cs.uni-kl.de wrote: Hi, for my PhD (learning graph patterns for human associations) i'm currently experimenting with some sub-graphs that i need to match via SPARQL against a Virtuoso endpoint. The sub-graph sizes range from 30 to 400K triples and are automatically transformed into SPARQL queries (basically via N3). I'm interested in the practical limits for queries via: - GET - POST - POST DIRECT in terms of bytes, chars and triples. I noticed that there seems to be a 1 line limit for the SQL query that is the outcome of the SPARQL query. I'm not sure how SPARQL queries are translated into SQL lines though... is this triple wise (so max 1 triples) or term wise (so max 1/3 triples) or something else? Experiments tell me that the GET method seems to have a ~1 byte limit (after urlencoding). Sadly, I couldn't really test POST DIRECT, as on our local 7.1.0 endpoint even queries with ~150 triples (~18000 chars) seem to crash the endpoint :( If i remove long literals (which also happen to contain a lot of unicode chars), the query doesn't return within 2 hours. If i switch to POST query, i only get a Virtuoso 42000 Error SR483: Stack Overflow error, but the server keeps running at least... If for POST queries i keep the urlencoded query size 1 bytes, it seems to work. Running the POST DIRECT query against http://dbpedia.org/sparql results in an HTTP Error 409: Invalid path. POST gives me Virtuoso 37000 Error SP031: SPARQL: Internal error: The length of generated SQL text has exceeded 1 lines of code If I run the 1 byte POST it seems to work again... Can anyone confirm my findings / give me a recommendation for how big a sane query can get? Cheers, Jörn -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF ___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
[Virtuoso-users] create procedure in bash shell
Hi,
In our application, we want to create many different dump functions to dump
different subset of triple collections from database.
According to the wiki page:
http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtRDFDatasetDump
we can define dump one graph function in isql command line. Since we will
create hundreds of customized dump functions, we do not want to copy and
paste to isql command line. Instead we want to prepare a shell script.
In the bash shell, we need to take care of single quote by converting ' to
'''.
Basically, I copy and paste the create procedure into shell script
surrounded by:
/opt/virtuoso/bin/isql dba password exec='create procedure
function'
But I always got this error
*** Error 37000: [Virtuoso Driver][Virtuoso Server]SQ074: Line 40:
at line 0 of Top-Level:
although the create procedure function itself works fine in the isql
command line.
Can anyone help me out?
Thank you very much!
Best,
Gang
---
The shell command is as follow:
/opt/virtuoso/bin/isql dba password verbose=on banner=off prompt=off
echo=ON errors=stdout \
exec='CREATE PROCEDURE dump_one_graph
( IN srcgraph VARCHAR ,
IN out_file VARCHAR ,
IN file_length_limit INTEGER := 10
)
{
DECLARE file_name VARCHAR;
DECLARE env,
ses ANY;
DECLARE ses_len,
max_ses_len,
file_len,
file_idx INTEGER;
SET ISOLATION = '''uncommitted''';
max_ses_len := 1000;
file_len := 0;
file_idx := 1;
file_name:= sprintf ('''%s%06d.ttl''', out_file, file_idx);
string_to_file ( file_name || '''.graph''',
srcgraph,
-2
);
string_to_file ( file_name,
sprintf ( '''# Dump of graph %s, as of %s\n@base
.\n''',
srcgraph,
CAST (NOW() AS VARCHAR)
),
-2
);
env := vector (dict_new (16000), 0, , , , 0, 0, 0, 0,
0);
ses := string_output ();
FOR (SELECT * FROM ( SPARQL DEFINE input:storage
SELECT ?s ?p ?o { GRAPH `iri(?:srcgraph)` { ?s ?p
?o } }
) AS sub OPTION (LOOP)) DO
{
http_ttl_triple (env, s, p, o, ses);
ses_len := length (ses);
IF (ses_len max_ses_len)
{
file_len := file_len + ses_len;
IF (file_len file_length_limit)
{
http (''' .\n''', ses);
string_to_file (file_name, ses, -1);
gz_compress_file (file_name, file_name||'''.gz''');
file_delete (file_name);
file_len := 0;
file_idx := file_idx + 1;
file_name := sprintf ('''%s%06d.ttl''', out_file,
file_idx);
string_to_file ( file_name,
sprintf ( '''# Dump of graph %s, as of
%s (part %d)\n@base .\n''',
srcgraph,
CAST (NOW() AS VARCHAR),
file_idx),
-2
);
env := VECTOR (dict_new (16000), 0, , ,
, 0, 0, 0, 0, 0);
}
ELSE
string_to_file (file_name, ses, -1);
ses := string_output ();
}
}
IF (LENGTH (ses))
{
http (''' .\n''', ses);
string_to_file (file_name, ses, -1);
gz_compress_file (file_name, file_name||'''.gz''');
file_delete (file_name);
}
}
;'
--
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] create procedure in bash shell
I double-checked the error message and found the plus sign '+' is missing
in the error message:
file_len := file_len ses_len;
Do we need to escape plus sign in shell script? Any comment?
On Tue, Apr 7, 2015 at 4:36 PM, Gang Fu gangfu1...@gmail.com wrote:
Hi,
In our application, we want to create many different dump functions to
dump different subset of triple collections from database.
According to the wiki page:
http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtRDFDatasetDump
we can define dump one graph function in isql command line. Since we will
create hundreds of customized dump functions, we do not want to copy and
paste to isql command line. Instead we want to prepare a shell script.
In the bash shell, we need to take care of single quote by converting ' to
'''.
Basically, I copy and paste the create procedure into shell script
surrounded by:
/opt/virtuoso/bin/isql dba password exec='create procedure
function'
But I always got this error
*** Error 37000: [Virtuoso Driver][Virtuoso Server]SQ074: Line 40:
at line 0 of Top-Level:
although the create procedure function itself works fine in the isql
command line.
Can anyone help me out?
Thank you very much!
Best,
Gang
---
The shell command is as follow:
/opt/virtuoso/bin/isql dba password verbose=on banner=off
prompt=off echo=ON errors=stdout \
exec='CREATE PROCEDURE dump_one_graph
( IN srcgraph VARCHAR ,
IN out_file VARCHAR ,
IN file_length_limit INTEGER := 10
)
{
DECLARE file_name VARCHAR;
DECLARE env,
ses ANY;
DECLARE ses_len,
max_ses_len,
file_len,
file_idx INTEGER;
SET ISOLATION = '''uncommitted''';
max_ses_len := 1000;
file_len := 0;
file_idx := 1;
file_name:= sprintf ('''%s%06d.ttl''', out_file, file_idx);
string_to_file ( file_name || '''.graph''',
srcgraph,
-2
);
string_to_file ( file_name,
sprintf ( '''# Dump of graph %s, as of %s\n@base
.\n''',
srcgraph,
CAST (NOW() AS VARCHAR)
),
-2
);
env := vector (dict_new (16000), 0, , , , 0, 0, 0,
0, 0);
ses := string_output ();
FOR (SELECT * FROM ( SPARQL DEFINE input:storage
SELECT ?s ?p ?o { GRAPH `iri(?:srcgraph)` { ?s ?p
?o } }
) AS sub OPTION (LOOP)) DO
{
http_ttl_triple (env, s, p, o, ses);
ses_len := length (ses);
IF (ses_len max_ses_len)
{
file_len := file_len + ses_len;
IF (file_len file_length_limit)
{
http (''' .\n''', ses);
string_to_file (file_name, ses, -1);
gz_compress_file (file_name, file_name||'''.gz''');
file_delete (file_name);
file_len := 0;
file_idx := file_idx + 1;
file_name := sprintf ('''%s%06d.ttl''', out_file,
file_idx);
string_to_file ( file_name,
sprintf ( '''# Dump of graph %s, as
of %s (part %d)\n@base .\n''',
srcgraph,
CAST (NOW() AS VARCHAR),
file_idx),
-2
);
env := VECTOR (dict_new (16000), 0, , ,
, 0, 0, 0, 0, 0);
}
ELSE
string_to_file (file_name, ses, -1);
ses := string_output ();
}
}
IF (LENGTH (ses))
{
http (''' .\n''', ses);
string_to_file (file_name, ses, -1);
gz_compress_file (file_name, file_name||'''.gz''');
file_delete (file_name);
}
}
;'
--
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
[Virtuoso-users] update/uninstall virtuoso
Hi, How can I uninstall and/or update virtuoso? We had a version 7.1 with a bug that was fixed in 7.2. I would like to update to the new version. Previous virtuoso installation was from source. I cloned the new version and compiled (I used the same for 7.1): CFLAGS=-O2 -m64 export CFLAGS ./autogen.sh --enable-maintainer-mode --prefix=/usr/local/ --with-readline --program-transform-name=s/isql/isql-vt/ ./configure --prefix=/usr/local/ --with-readline --program-transform-name=s/isql/isql-vt/ make make install It already gave an error: mkdir: cannot create directory `/usr/local/lib/sesame': File exists make[3]: [install-data-local] Error 1 (ignored) even though I deleted this sesame directory before. Anyway it created the virtuoso-t in /usr/local/bin and I can even start it (can log in with isql-vt and can see conductor web interface), but when I do make check in the source directory the result is: = Checking log files \*.output for statistics: = = Total number of tests PASSED : 2841 = Total number of tests FAILED : 4898 = Total number of tests ABORTED : 3 = *** Not all tests completed successfully *** Check the file release.output for more information = = COMPLETED test = Thu Apr 2 15:03:12 UTC 2015 = = = WARNING: Some tests failed. See *.output in test directories under /tmp/virtuoso-opensource/binsrc/tests/suite = Some aborted tests: ./thttp.ro/thttp.output:***ABORTED: wsdl_suite.sql ./tsql.ro/tsql.output:***ABORTED: Wordtest -- twords.sql ./trecov.ro/trecov.output:***ABORTED: trecov.sh: Inline Blobs = Some failed tests: ./tdav_meta.ro/tdav_meta.output:***FAILED: MGET on collection ./tdav_meta.ro/tdav_meta.output:***FAILED: MGET on existing FOAF ./tdav_meta.ro/tdav_meta.output:***FAILED: MGET on existing OPML ./tdav_meta.ro/tdav_meta.output:***FAILED: MPUT on existing OPML ./tdav_meta.ro/tdav_meta.output:***FAILED: MGET of added value on OPML = make[5]: *** [check-local] Error 3 make[5]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[4]: *** [check-am] Error 2 make[4]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[3]: *** [check-recursive] Error 1 make[3]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[2]: *** [check-recursive] Error 1 make[2]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/tmp/virtuoso-opensource/binsrc' make: *** [check-recursive] Error 1 But when I did a clean install of 7.2 in virtualbox the result is: = Checking log files \*.output for statistics: = = Total number of tests PASSED : 7740 = Total number of tests FAILED : 0 = Total number of tests ABORTED : 3 = *** Not all tests completed successfully *** Check the file release.output for more information = = COMPLETED test = Thu Apr 2 14:50:16 UTC 2015 = = = WARNING: Some tests failed. See *.output in test directories under /tmp/virtuoso-opensource/binsrc/tests/suite = Some aborted tests: ./thttp.ro/thttp.output:***ABORTED: wsdl_suite.sql ./trecov.ro/trecov.output:***ABORTED: trecov.sh: Inline Blobs ./tsql.ro/tsql.output:***ABORTED: Wordtest -- twords.sql = Some failed tests: = make[5]: *** [check-local] Error 3 make[5]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[4]: *** [check-am] Error 2 make[4]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[3]: *** [check-recursive] Error 1 make[3]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[2]: *** [check-recursive] Error 1 make[2]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/tmp/virtuoso-opensource/binsrc' make: *** [check-recursive] Error 1 The website: https://github.com/openlink/virtuoso-opensource; says this check is optional, should I worry about these failing tests? Any help would be appreciated, Kind regards, Balazs Varhegyi -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises
Re: [Virtuoso-users] Unable to bulk load nquads in Virtuoso
Hi Maria,
What do you mean by “virtuoso halts” ?
What is the size of the “Dbpedia.nq” file ?
Are you able to make another isql connection to the database and run the
“status();” command ?
What does the Linux “top” command report as to the resources being consumed by
the process ?
Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc. // http://www.openlinksw.com/
Weblog -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter -- http://twitter.com/OpenLink
Google+ -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers
On 7 Apr 2015, at 23:00, Maria Jackson maria.jackson@gmail.com wrote:
I am trying to bulk load dbpedia.nq in Virtuoso using the following command:
$ ./isql dba dba
Connected to OpenLink Virtuoso
Driver: 07.20.3212 OpenLink Virtuoso ODBC Driver
OpenLink Interactive SQL (Virtuoso), version 0.9849b.
Type HELP; for help and EXIT; to exit.
SQL DB.DBA.TTLP_MT (file_to_string_output
('/home/Virtuoso/virtuosoInstalled/share/virtuoso/vad/Dbpedia.nq'), '',
'http://localhost:8890/DAV/dbpedia
http://localhost:8890/DAV/dbpedia',512);
Whenever I try to bulk load in Virtuoso I get the following error and
Virtuoso halts. Can someone please help me as to how can I bulk load .nq
files in Virtuoso:
$ ./virtuoso-t -f -c
/home/Virtuoso/virtuosoInstalled/var/lib/virtuoso/db/virtuoso.ini
Wed Apr 08 2015
01:44:17 { Loading plugin 1: Type `plain', file `wikiv' in
`/home/Virtuoso/virtuosoInstalled/lib/virtuoso/hosting'
01:44:17 FAILED plugin 1: Unable to locate file }
01:44:17 { Loading plugin 2: Type `plain', file `mediawiki' in
`/home/Virtuoso/virtuosoInstalled/lib/virtuoso/hosting'
01:44:17 FAILED plugin 2: Unable to locate file }
01:44:17 { Loading plugin 3: Type `plain', file `creolewiki' in
`/home/Virtuoso/virtuosoInstalled/lib/virtuoso/hosting'
01:44:17 FAILED plugin 3: Unable to locate file }
01:44:17 OpenLink Virtuoso Universal Server
01:44:17 Version 07.20.3212-pthreads for Linux as of Apr 8 2015
01:44:17 uses parts of OpenSSL, PCRE, Html Tidy
01:44:27 Database version 3126
01:44:27 SQL Optimizer enabled (max 1000 layouts)
01:44:28 Compiler unit is timed at 0.000291 msec
01:44:30 Roll forward started
01:44:30 Roll forward complete
01:44:32 Checkpoint started
01:44:32 Checkpoint finished, log reused
01:44:32 HTTP/WebDAV server online at 8890
01:44:32 Server online at (pid 28041)
02:44:33 Checkpoint started
02:44:33 Checkpoint finished, log reused
03:05:37 * Monitor: Locks are held for a long time
03:05:55 * Monitor: Should read for update because lock escalation from
shared to exclusive fails frequently (1)
03:07:37 * Monitor: Locks are held for a long time
03:18:55 * Monitor: Many lock waits
I downloaded Virtuoso from: git clone
git://github.com/openlink/virtuoso-opensource.git
http://github.com/openlink/virtuoso-opensource.git
Git checkout gives me: $ git checkout -t remotes/origin/develop/7
fatal: git checkout: branch develop/7 already exists
The parameters of my virtuoso.ini file are:
;
; virtuoso.ini
;
; Configuration file for the OpenLink Virtuoso VDBMS Server
;
; To learn more about this product, or any other product in our
; portfolio, please check out our web site at:
;
; http://virtuoso.openlinksw.com/ http://virtuoso.openlinksw.com/
;
; or contact us at:
;
; general.informat...@openlinksw.com
mailto:general.informat...@openlinksw.com
;
; If you have any technical questions, please contact our support
; staff at:
;
; technical.supp...@openlinksw.com
mailto:technical.supp...@openlinksw.com
;
;
; Database setup
;
[Database]
DatabaseFile =
/home/Virtuoso/virtuosoInstalled/var/lib/virtuoso/db/virtuoso.db
ErrorLogFile =
/home/Virtuoso/virtuosoInstalled/var/lib/virtuoso/db/virtuoso.log
LockFile =
/home/Virtuoso/virtuosoInstalled/var/lib/virtuoso/db/virtuoso.lck
TransactionFile =
/home/Virtuoso/virtuosoInstalled/var/lib/virtuoso/db/virtuoso.trx
xa_persistent_file=
/home/Virtuoso/virtuosoInstalled/var/lib/virtuoso/db/virtuoso.pxa
ErrorLogLevel = 7
FileExtend= 200
MaxCheckpointRemap= 17
Striping = 0
TempStorage = TempDatabase
[TempDatabase]
DatabaseFile =
/home/Virtuoso/virtuosoInstalled/var/lib/virtuoso/db/virtuoso-temp.db
TransactionFile =
/home/Virtuoso/virtuosoInstalled/var/lib/virtuoso/db/virtuoso-temp.trx
MaxCheckpointRemap= 200
Striping = 0
;
; Server parameters
;
[Parameters]
ServerPort=
LiteMode
[Virtuoso-users] update/install virtuoso
Hi all, How can I uninstall and/or update virtuoso? We had a version 7.1 with a bug that was fixed in 7.2. I would like to update to the new version. Previous virtuoso installation was from source. I cloned the new version and compiled (I used the same for 7.1): CFLAGS=-O2 -m64 export CFLAGS ./autogen.sh --enable-maintainer-mode --prefix=/usr/local/ --with-readline --program-transform-name=s/isql/isql-vt/ ./configure --prefix=/usr/local/ --with-readline --program-transform-name=s/isql/isql-vt/ make make install It already gave an error: mkdir: cannot create directory `/usr/local/lib/sesame': File exists make[3]: [install-data-local] Error 1 (ignored) even though I deleted this sesame directory before. Anyway it created the virtuoso-t in /usr/local/bin and I can even start it (can log in with isql-vt and can see conductor web interface), but when I do make check in the source directory the result is: = Checking log files \*.output for statistics: = = Total number of tests PASSED : 2841 = Total number of tests FAILED : 4898 = Total number of tests ABORTED : 3 = *** Not all tests completed successfully *** Check the file release.output for more information = = COMPLETED test = Thu Apr 2 15:03:12 UTC 2015 = = = WARNING: Some tests failed. See *.output in test directories under /tmp/virtuoso-opensource/binsrc/tests/suite = Some aborted tests: ./thttp.ro/thttp.output:***ABORTED: wsdl_suite.sql ./tsql.ro/tsql.output:***ABORTED: Wordtest -- twords.sql ./trecov.ro/trecov.output:***ABORTED: trecov.sh: Inline Blobs = Some failed tests: ./tdav_meta.ro/tdav_meta.output:***FAILED: MGET on collection ./tdav_meta.ro/tdav_meta.output:***FAILED: MGET on existing FOAF ./tdav_meta.ro/tdav_meta.output:***FAILED: MGET on existing OPML ./tdav_meta.ro/tdav_meta.output:***FAILED: MPUT on existing OPML ./tdav_meta.ro/tdav_meta.output:***FAILED: MGET of added value on OPML = make[5]: *** [check-local] Error 3 make[5]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[4]: *** [check-am] Error 2 make[4]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[3]: *** [check-recursive] Error 1 make[3]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[2]: *** [check-recursive] Error 1 make[2]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/tmp/virtuoso-opensource/binsrc' make: *** [check-recursive] Error 1 But when I did a clean install of 7.2 in virtualbox the result is: = Checking log files \*.output for statistics: = = Total number of tests PASSED : 7740 = Total number of tests FAILED : 0 = Total number of tests ABORTED : 3 = *** Not all tests completed successfully *** Check the file release.output for more information = = COMPLETED test = Thu Apr 2 14:50:16 UTC 2015 = = = WARNING: Some tests failed. See *.output in test directories under /tmp/virtuoso-opensource/binsrc/tests/suite = Some aborted tests: ./thttp.ro/thttp.output:***ABORTED: wsdl_suite.sql ./trecov.ro/trecov.output:***ABORTED: trecov.sh: Inline Blobs ./tsql.ro/tsql.output:***ABORTED: Wordtest -- twords.sql = Some failed tests: = make[5]: *** [check-local] Error 3 make[5]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[4]: *** [check-am] Error 2 make[4]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[3]: *** [check-recursive] Error 1 make[3]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests/suite' make[2]: *** [check-recursive] Error 1 make[2]: Leaving directory `/tmp/virtuoso-opensource/binsrc/tests' make[1]: *** [check-recursive] Error 1 make[1]: Leaving directory `/tmp/virtuoso-opensource/binsrc' make: *** [check-recursive] Error 1 The website: https://github.com/openlink/virtuoso-opensource; says this check is optional, should I worry about these failing tests? Any help would be appreciated, Kind regards, Balazs Varhegyi -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises
Re: [Virtuoso-users] create procedure in bash shell
Thank you very much, Morty and Hugh!
I just found out that the isql command line has two mode: file mode and
command line mode:
isql dba dba file.sql
isql dba dba exec=command
Best,
Gang
B
On Tue, Apr 7, 2015 at 10:14 PM, Hugh Williams hwilli...@openlinksw.com
wrote:
Hi Gang,
You could also place the procedure to be loaded in a file (dump.sql) and
use the “load” command to load it into the database:
$ isql dba dba verbose=on banner=off prompt=off echo=ON errors=stdout
exec='load dump.sql'
Connected to OpenLink Virtuoso
Driver: 07.10.3211 OpenLink Virtuoso ODBC Driver
OpenLink Interactive SQL (Virtuoso), version 0.9849b.
Type HELP; for help and EXIT; to exit.
-- Line 1:
CREATE PROCEDURE dump_one_graph
( IN srcgraph VARCHAR ,
IN out_file VARCHAR ,
IN file_length_limit INTEGER := 10
)
{
DECLARE file_name VARCHAR;
DECLARE env,
ses ANY;
DECLARE ses_len,
max_ses_len,
file_len,
file_idx INTEGER;
SET ISOLATION = 'uncommitted';
max_ses_len := 1000;
file_len := 0;
file_idx := 1;
file_name:= sprintf ('%s%06d.ttl', out_file, file_idx);
string_to_file ( file_name || '.graph',
srcgraph,
-2
);
string_to_file ( file_name,
sprintf ( '# Dump of graph %s, as of %s\n@base
.\n',
srcgraph,
CAST (NOW() AS VARCHAR)
),
-2
);
env := vector (dict_new (16000), 0, '', '', '', 0, 0, 0, 0, 0);
ses := string_output ();
FOR (SELECT * FROM ( SPARQL DEFINE input:storage
SELECT ?s ?p ?o { GRAPH `iri(?:srcgraph)` { ?s ?p
?o } }
) AS sub OPTION (LOOP)) DO
{
http_ttl_triple (env, s, p, o, ses);
ses_len := length (ses);
IF (ses_len max_ses_len)
{
file_len := file_len + ses_len;
IF (file_len file_length_limit)
{
http (' .\n', ses);
string_to_file (file_name, ses, -1);
gz_compress_file (file_name, file_name||'.gz');
file_delete (file_name);
file_len := 0;
file_idx := file_idx + 1;
file_name := sprintf ('%s%06d.ttl', out_file, file_idx);
string_to_file ( file_name,
sprintf ( '# Dump of graph %s, as of %s
(part %d)\n@base .\n',
srcgraph,
CAST (NOW() AS VARCHAR),
file_idx),
-2
);
env := VECTOR (dict_new (16000), 0, '', '', '', 0, 0, 0,
0, 0);
}
ELSE
string_to_file (file_name, ses, -1);
ses := string_output ();
}
}
IF (LENGTH (ses))
{
http (' .\n', ses);
string_to_file (file_name, ses, -1);
gz_compress_file (file_name, file_name||'.gz');
file_delete (file_name);
}
}
Done. -- 13 msec.
-- Line 72:
$
Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc. // http://www.openlinksw.com/
Weblog -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter -- http://twitter.com/OpenLink
Google+ -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers
On 7 Apr 2015, at 22:08, Morty morty+virtu...@frakir.org wrote:
On Tue, Apr 07, 2015 at 04:36:39PM -0400, Gang Fu wrote:
In the bash shell, we need to take care of single quote by converting ' to
'''.
Gang --
You can avoid some issues and debug more easily by using isql's run
file syntax.
temp_file=`mktemp /somedir/tmpX`
$command_to_generate_procedure $temp_file
isql dba $dba_password $temp_file
If there are any issues, you can look at the temporary file to debug
quoting and the like.
- Morty
--
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live
exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
event?utm_
source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF
___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
[Virtuoso-users] Archiving log files
Hi, Is there a way to configure Virtuoso so that the log files can be archived automatically once a certain size is reached? e.g. virtuoso.log.1 virtuoso.log.2 virtuoso.log.3 virtuoso.log etc. Or is it up to the user to set up cron jobs to clean up the log files? Thanks, Eliza -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard Learn Process modeling best practices with Bonita BPM through live exercises http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_ source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF___ Virtuoso-users mailing list Virtuoso-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/virtuoso-users
Re: [Virtuoso-users] create procedure in bash shell
Hi Gang,
You could also place the procedure to be loaded in a file (dump.sql) and use
the “load” command to load it into the database:
$ isql dba dba verbose=on banner=off prompt=off echo=ON errors=stdout
exec='load dump.sql'
Connected to OpenLink Virtuoso
Driver: 07.10.3211 OpenLink Virtuoso ODBC Driver
OpenLink Interactive SQL (Virtuoso), version 0.9849b.
Type HELP; for help and EXIT; to exit.
-- Line 1:
CREATE PROCEDURE dump_one_graph
( IN srcgraph VARCHAR ,
IN out_file VARCHAR ,
IN file_length_limit INTEGER := 10
)
{
DECLARE file_name VARCHAR;
DECLARE env,
ses ANY;
DECLARE ses_len,
max_ses_len,
file_len,
file_idx INTEGER;
SET ISOLATION = 'uncommitted';
max_ses_len := 1000;
file_len := 0;
file_idx := 1;
file_name:= sprintf ('%s%06d.ttl', out_file, file_idx);
string_to_file ( file_name || '.graph',
srcgraph,
-2
);
string_to_file ( file_name,
sprintf ( '# Dump of graph %s, as of %s\n@base .\n',
srcgraph,
CAST (NOW() AS VARCHAR)
),
-2
);
env := vector (dict_new (16000), 0, '', '', '', 0, 0, 0, 0, 0);
ses := string_output ();
FOR (SELECT * FROM ( SPARQL DEFINE input:storage
SELECT ?s ?p ?o { GRAPH `iri(?:srcgraph)` { ?s ?p ?o }
}
) AS sub OPTION (LOOP)) DO
{
http_ttl_triple (env, s, p, o, ses);
ses_len := length (ses);
IF (ses_len max_ses_len)
{
file_len := file_len + ses_len;
IF (file_len file_length_limit)
{
http (' .\n', ses);
string_to_file (file_name, ses, -1);
gz_compress_file (file_name, file_name||'.gz');
file_delete (file_name);
file_len := 0;
file_idx := file_idx + 1;
file_name := sprintf ('%s%06d.ttl', out_file, file_idx);
string_to_file ( file_name,
sprintf ( '# Dump of graph %s, as of %s
(part %d)\n@base .\n',
srcgraph,
CAST (NOW() AS VARCHAR),
file_idx),
-2
);
env := VECTOR (dict_new (16000), 0, '', '', '', 0, 0, 0, 0, 0);
}
ELSE
string_to_file (file_name, ses, -1);
ses := string_output ();
}
}
IF (LENGTH (ses))
{
http (' .\n', ses);
string_to_file (file_name, ses, -1);
gz_compress_file (file_name, file_name||'.gz');
file_delete (file_name);
}
}
Done. -- 13 msec.
-- Line 72:
$
Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc. // http://www.openlinksw.com/
Weblog -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter -- http://twitter.com/OpenLink
Google+ -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers
On 7 Apr 2015, at 22:08, Morty morty+virtu...@frakir.org wrote:
On Tue, Apr 07, 2015 at 04:36:39PM -0400, Gang Fu wrote:
In the bash shell, we need to take care of single quote by converting ' to
'''.
Gang --
You can avoid some issues and debug more easily by using isql's run
file syntax.
temp_file=`mktemp /somedir/tmpX`
$command_to_generate_procedure $temp_file
isql dba $dba_password $temp_file
If there are any issues, you can look at the temporary file to debug
quoting and the like.
- Morty
--
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15utm_medium=emailutm_campaign=VA_SF
___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users
--
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
