Re: [Virtuoso-users] virtuoso.qrl (query logs) has a special format ?

2016-05-16 Thread Hugh Williams
Hi Thomas,

I have been able to recreate on my local Mac OS X installation and have 
reported to development to fix …

Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc.  //  http://www.openlinksw.com/
Weblog   -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter  -- http://twitter.com/OpenLink
Google+  -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers

> On 13 May 2016, at 15:23, Thomas Michaux  wrote:
> 
> Thanks, did not read the doc... sorry
> 
> Btw,
> 
> I found a strange case leading to a virtuoso crash when querying this view, I 
> can reproduce this way :
> 
> ok SQL :
> 
> SELECT ql_id,ql_start_dt,ql_client_ip, ql_error,ql_sqlstate,(100 * 
> ql_thread_clocks / ql_rt_clocks) as 
> cpu_percent,ql_rt_msec,ql_c_clocks,ql_c_msec,ql_thread_clocks,ql_disk_wait_clocks,ql_qp_threads,ql_c_memory,ql_text
>   FROM sys_query_log
>  WHERE qrl_file = 
> '/usr/local/virtuoso-opensource/var/lib/virtuoso/db/virtuoso.qrl'
>AND qrl_start_dt = cast ('2016-05-13 00' as datetime)
>AND qrl_end_dt = cast ('2016-05-13 23' as datetime)
> and ql_user='SPARQL'
> 
> crash SQL : the same as abovee, just add an order by clause at the end on 
> ql_thread_clocks column :
> 
> 
> 16:09:21 OpenLink Virtuoso Universal Server
> 16:09:21 Version 07.20.3215-pthreads for Linux as of Mar 29 2016
> 16:09:21 uses parts of OpenSSL, PCRE, Html Tidy
> 16:09:29 Database version 3126
> 16:09:29 Unlinked the temp db file 
> /usr/local/virtuoso-opensource/var/lib/virtuoso/db/virtuoso-temp.db as its 
> size (94MB) was greater than TempDBSize INI (10MB)
> 16:09:29 SQL Optimizer enabled (max 1000 layouts)
> 16:09:30 Compiler unit is timed at 0.000185 msec
> 16:09:55 built-in procedure "WS.WS.SPARQL_ENDPOINT_STYLE" overruled by the 
> RDBMS
> 16:09:55 built-in procedure "WS.WS.SPARQL_ENDPOINT_GENERATE_FORM" overruled 
> by the RDBMS
> 16:09:55 Roll forward started
> 16:09:55 118 transactions, 21607 bytes replayed (100 %)
> 16:09:55 Roll forward complete
> 16:09:57 Checkpoint started
> 16:09:57 Checkpoint finished, new log is 
> /usr/local/virtuoso-opensource/var/lib/virtuoso/db/virtuoso20160513160956.trx
> 16:09:59 HTTP/WebDAV server online at 8890
> 16:09:59 Failed HTTP listen at :80 code (-6).
> 16:09:59 Server online at  (pid 28721)
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x8c41ba]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x8c4218]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x4b3127]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x476c58]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x489c6b]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x80d940]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x810ae0]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x813f85]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5321e0]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x49f77d]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x49f9fd]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x49fc47]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x591998]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x599e77]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x592026]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x59a2e7]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x592026]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x59a2e7]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e197f]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e52d3]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x591998]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x599e77]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e197f]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e52d3]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x591998]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x599e77]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
> 16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() 

Re: [Virtuoso-users] virtuoso.qrl (query logs) has a special format ?

2016-05-13 Thread Thomas Michaux

Thanks, did not read the doc... sorry

Btw,

I found a strange case leading to a virtuoso crash when querying this 
view, I can reproduce this way :


ok SQL :

SELECT ql_id,ql_start_dt,ql_client_ip, ql_error,ql_sqlstate,(100 * 
ql_thread_clocks / ql_rt_clocks) as 
cpu_percent,ql_rt_msec,ql_c_clocks,ql_c_msec,ql_thread_clocks,ql_disk_wait_clocks,ql_qp_threads,ql_c_memory,ql_text

  FROM sys_query_log
 WHERE qrl_file = 
'/usr/local/virtuoso-opensource/var/lib/virtuoso/db/virtuoso.qrl'

   AND qrl_start_dt = cast ('2016-05-13 00' as datetime)
   AND qrl_end_dt = cast ('2016-05-13 23' as datetime)
and ql_user='SPARQL'

crash SQL : the same as abovee, just add an order by clause at the end 
on ql_thread_clocks column :



16:09:21 OpenLink Virtuoso Universal Server
16:09:21 Version 07.20.3215-pthreads for Linux as of Mar 29 2016
16:09:21 uses parts of OpenSSL, PCRE, Html Tidy
16:09:29 Database version 3126
16:09:29 Unlinked the temp db file 
/usr/local/virtuoso-opensource/var/lib/virtuoso/db/virtuoso-temp.db as 
its size (94MB) was greater than TempDBSize INI (10MB)

16:09:29 SQL Optimizer enabled (max 1000 layouts)
16:09:30 Compiler unit is timed at 0.000185 msec
16:09:55 built-in procedure "WS.WS.SPARQL_ENDPOINT_STYLE" overruled by 
the RDBMS
16:09:55 built-in procedure "WS.WS.SPARQL_ENDPOINT_GENERATE_FORM" 
overruled by the RDBMS

16:09:55 Roll forward started
16:09:55 118 transactions, 21607 bytes replayed (100 %)
16:09:55 Roll forward complete
16:09:57 Checkpoint started
16:09:57 Checkpoint finished, new log is 
/usr/local/virtuoso-opensource/var/lib/virtuoso/db/virtuoso20160513160956.trx

16:09:59 HTTP/WebDAV server online at 8890
16:09:59 Failed HTTP listen at :80 code (-6).
16:09:59 Server online at  (pid 28721)
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x8c41ba]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x8c4218]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x4b3127]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x476c58]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x489c6b]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x80d940]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x810ae0]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x813f85]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5321e0]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x49f77d]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x49f9fd]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x49fc47]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x591998]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x599e77]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x592026]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x59a2e7]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x592026]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x59a2e7]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e197f]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e52d3]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x591998]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x599e77]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e197f]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e52d3]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x591998]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x599e77]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x592026]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x59a2e7]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e197f]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e52d3]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x591998]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x599e77]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c0442]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5c934d]
16:13:30 /usr/local/virtuoso-opensource/bin/virtuoso-t() [0x5e197f]
16:13:30 

Re: [Virtuoso-users] virtuoso.qrl (query logs) has a special format ?

2016-04-21 Thread Hugh Williams
Hi Thomas,

You analyse the Query log by querying the special “sys_query_log” view in 
Virtuoso as detailed at:

http://docs.openlinksw.com/virtuoso/databaseadmsrv.html#querylogging 


Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc.  //  http://www.openlinksw.com/
Weblog   -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter  -- http://twitter.com/OpenLink
Google+  -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers

> On 21 Apr 2016, at 17:39, Thomas Michaux  wrote:
> 
> Hello,
> 
> I activated  QueryLog = virtuoso.qrl in my virtuoso.ini to 
> collect and analyze logs for queries performed against our Virtuoso instance 
> but i've problems reading special chars in the results :
> 
> - is the file format simple text ?
> - does it use compression ?
> - proprietary format ? encoding ?
> 
> Thanks,
> 
> Thomas
> 
> here is an excerpt when the file is opended in Notepad++ :
> 
> After code:
>   0: __ro2sq := Call __ro2sq (.O)
>   5: DB.DBA.RDF_LANGUAGE_OF_OBJ := Call DB.DBA.RDF_LANGUAGE_OF_OBJ 
> (__ro2sq)
>   12: BReturn 0
> time 0% fanout 0 input 0 rows
> Select (__ro2sq, DB.DBA.RDF_LANGUAGE_OF_OBJ, _cvt)
> }
> ̽ @ ¼ Á¼+½  ‚Ó;L–HÒ‘   ¼½ @@µ10.34.11.31µSPARQLÌ̼ ½ 纽  9ö¶   
> select __ro2sq (O), DB.DBA.RDF_LANGUAGE_OF_OBJ (__ro2sq (O)) , cast 
> (b3s_lbl_order (P, 0) as int) from RDF_QUAD table option (with 'facets')
> where S = __i2id (?) and P = __i2id 
> ('http://www.openlinksw.com/schemas/virtrdf#label 
> ', 0) and not 
> is_bnode_iri_id (O) order by 3 option (same_as)Ì÷|„¥aHå½ ¤„¼¼ ¼ ¼ ¼ ¼ 
> ¼B¼ÿ¼3¼¼½ >.¼ ¼ ¼ ¼ ¼ ¼ ¼ ¼ ¼ ¼ ¼ ¼ ¶  ^{ 
> Params: <$29 dtp 242 (0, 0) > 
> time  0.95% fanout 1 input 1 rows
> time20% fanout 1 input 1 rows
>  
> Precode:
>   0: __i2id := Call __i2id (:0)
>   5: BReturn 0
> { fork
> time32% fanout 1 input 1 rows
>   Multistate transitive canned,  input (__i2id) output (i-__i2id) 
> time16% fanout63 input 1 rows
> RDF Inference subproperty iterates inferred  o=p=  ##label 
> time30% fanout 0 input63 rows
> RDF_QUAD  0.47 rows(.O, .P)
>  inlined  P = inferred ,  S = k_i-__i2id
> time 0% fanout 0 input 0 rows
> END Node
> 
> 
> --
> Find and fix application performance issues faster with Applications Manager
> Applications Manager provides deep performance insights into multiple tiers of
> your business applications. It resolves application problems quickly and
> reduces your MTTR. Get your free trial!
> https://ad.doubleclick.net/ddm/clk/302982198;130105516;z___
> Virtuoso-users mailing list
> Virtuoso-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users



smime.p7s
Description: S/MIME cryptographic signature
--
Find and fix application performance issues faster with Applications Manager
Applications Manager provides deep performance insights into multiple tiers of
your business applications. It resolves application problems quickly and
reduces your MTTR. Get your free trial!
https://ad.doubleclick.net/ddm/clk/302982198;130105516;z___
Virtuoso-users mailing list
Virtuoso-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/virtuoso-users