Re: [basex-talk] Slow query

I think I've already mentioned that the new query is different. The reference to 8.2.1 is included here where also the old query can be found: https://www.mail-archive.com/basex-talk%40mailman.uni-konstanz.de/msg06544.html With kind regards, Menashè On 08/03/2015 03:38 PM, Christian Grün wrot

Re: [basex-talk] Slow query

On 08/03/2015 03:24 PM, Christian Grün wrote: What was the last version it was working with? 8.2.1. Not really working, but better...

Re: [basex-talk] No debug info

Hi, I've simply used the client GUI. Should I see query logs in the server? In the past maybe the logs I've seen were always a result of the Java client queries, not the GUI. With kind regards, Menashè On 07/30/2015 10:23 AM, Christian Grün wrote: I don't know why I don't see anymore query lo

Re: [basex-talk] Applying indexes

Hi, So in case of six exact conditions (With different xpaths) should I see the usage of six indexes? Anyway, I'll send the exact query inside the old thread. On 07/30/2015 10:21 AM, Christian Grün wrote: Hi Menashè, Because none of our index structures is particularly suited for range queri

[basex-talk] Query plan: long printing

Hello, I have a query which is quite fast, but I see in the query plan (Using the client GUI) that the printing is very very slow, even when the number of hits is zero. I wonder what it means, and it is a problem. I'm sending these messages in different posts for helping users fin

[basex-talk] No debug info

Hello, I don't know why I don't see anymore query log events like "admin OK QUERY" in the .logs folder. Not even when I use the -d flag. BaseX 8.2.2 -- With kind regards, Menashè

[basex-talk] Applying indexes

Hello, 1. In which cases the "applying index" phrase should I see in the query plan? I have an old query (the one I've sent here at 06/22/2015) where only for one condition I've seen "applying index", and even this one doesn't appear anymore using a newer (8.2.2) version of BaseX and

Re: [basex-talk] Slow query

:) I've thought to do it as a second step, but I should do it earlier. Thank you. With kind regards, Menashè On 07/14/2015 03:22 PM, Christian Grün wrote: ...it only makes sense if you store the data in its normalized representation. On Tue, Jul 14, 2015 at 2:42 PM, Menashè Eliezer

Re: [basex-talk] Reporting function for a subset

s:float($x//latitudine) where $beginPosition>="1889-01-01" and $beginPosition<="2015-07-10" and $lat<=46.733 and $lat>=-67.81 and $lon<=72.7006667 and $lon >=-79.967 return $x return ... On Tue, Jul 14, 2015 at 12:55 PM, Menashè Eliezer

Re: [basex-talk] Slow query

Hi, It sounds like a great idea and I can also implement it to the date comparisons, but unfortunately the new query is much slower. Please see the attached log. With kind regards, Menashè On 07/14/2015 12:50 PM, Christian Grün wrote: Should geo:within of http://docs.basex.org/wiki/Geo_Module

Re: [basex-talk] Reporting function for a subset

On 07/14/2015 12:51 PM, Christian Grün wrote: E.g. like that: let $count := function($nodes) { count($nodes) } let $nodes := (, ) return $count($nodes) On Tue, Jul 14, 2015 at 12:41 PM, Menashè Eliezer wrote: Thank you, but would you please show me how to pass (only once) for each

Re: [basex-talk] Reporting function for a subset

= function($a, $b) { $a * $b } for $function in ($add, $multiply) return $function(3, 5) Instead of $add and $multiply, you could have $report-pivoting and $report-count. On Tue, Jul 14, 2015 at 11:40 AM, Menashè Eliezer wrote: Hi, The initial of the code should be modified, so here i

Re: [basex-talk] Reporting function for a subset

Hi, The initial of the code should be modified, so here is only the essence of one of the pivoting reports: for $singleDataType in $dataType for $singleDevice in $device for $singleAvailability in $availability for $singleCountry in $country for $singleParameter in $parameter group by $si

Re: [basex-talk] Slow query

Hi, On 07/14/2015 11:05 AM, Christian Grün wrote: It may be slightly faster if you remove the explicit string() conversion No, it's actually slower. But please note that BaseX provides no native range index, which would be a good fit for your longitude/latitude filter. Should *geo:within *of

Re: [basex-talk] Reporting function for a subset

Hi Christian, On 07/14/2015 09:30 AM, Christian Grün wrote: What about the reporting function, does it already exist? What is a subset: Is it a sequence of XML nodes resulting from a path expression? Could you possibly provide us with some code you have written so far? Christian I mean a seque

Re: [basex-talk] Slow query

on on the query compilation (are any indexes used?). C. On Mon, Jul 13, 2015 at 3:32 PM, Menashè Eliezer wrote: Hello, Creating a database of partial xml documents had almost no effect. Therefore I've created a database with very simple xml structure. I'm attaching an example (demo.x

[basex-talk] Reporting function for a subset

Hello, I want to call a reporting function with a subset of documents created inside a loop which will return a xml report. I couldn't find information how and if can it be done. The idea is that there is a main query which results in a subset. Then I want to make different processing only on t

Re: [basex-talk] Slow query

Hello, Creating a database of partial xml documents had almost no effect. Therefore I've created a database with very simple xml structure. I'm attaching an example (demo.xml). BaseX version: 8.2.2 Number of documents: 374739 However, the attached query takes 4 seconds (attached simple_query.lo

Re: [basex-talk] Slow query

Hi, Just create a new database from the input data with this option turned on. I've expected db:add to do it. Not important. If it's not well-formed, you can't store it in BaseX.. If you can do so, it would be an error (and rather surprising to me ;). Well, the not well-formed is the respons

Re: [basex-talk] Slow query

Hi Christian, True. I forgot to mention that the 'stripns' option (as all other XML parsing options [1]) only applies to newly parsed XML strings. But these strings belong to new documents being added using db:add. Anyway, how can I strip the namespaces in my new database? I don't need them.

Re: [basex-talk] Slow query

Hi Christian, I've created a new database with only the relevant part of each xml. It's much smaller and I hope it would help. The created xml is not a valid one since the xml and xml-model tags are missing, but it shouldn't be a problem. I've used map { 'stripns': true(), 'intparse': true() }

Re: [basex-talk] db:add OPTIONS

Great. Thanks! With kind regards, Menashè On 06/25/2015 01:51 PM, Christian Grün wrote: I've followed the documentation of db:add which states: Allowed options are all parsing and XML parsing options. "The key must be in lower case"… Agreed, we should possibly add this in the documentation.

[basex-talk] db:add OPTIONS

Hello, I've followed the documentation of db:add which states: Allowed options are allparsing andXML parsing options. using OPTIONS as /map { 'STRIPNS': true() }/ However, I get an error that STRIPNS is

Re: [basex-talk] Slow query

Hi Christian, The usual approach is to simply create another database that only contains the relevant parts of your document. This can directly be done in XQuery (using db:create, db:add, ...), or, if memory consumption is too high, by exporting and importing parts of your document. I couldn't fi

Re: [basex-talk] Slow query

Thank you Christian for the helpful reply. With kind regards, Menashè On 06/23/2015 01:32 PM, Christian Grün wrote: Is there also an option to define inside the part only the xpaths which I would need? I guess no, but to be honest, I am not exactly sure what you mean? Would you like to restri

Re: [basex-talk] Slow query

Thank you Christian, I may try it later as a last option. I hope you can find an alternative solution. Is there also an option to define inside the part only the xpaths which I would need? Otherwise, many elements and attributes which I don't need are being indexed. Another question, how can

Re: [basex-talk] Slow query

applying attribute index for ("ALKY", "AYMD") in log. Second launch: 1333.71 ms Latest snapshot (BaseX80-20150202.121033): 1st: Total Time: 1873.02 ms 2nd: Total Time: 548.62 ms With kind regards, Menashè On 02/02/2015 02:02 PM, Menashè Eliezer wrote: Hi Christian, Thank y

Re: [basex-talk] Slow query

Hi, I've used ssh -X for producing query info right from the server machine. Please see attached. I hope it would help. With kind regards, Menashè On 06/22/2015 04:48 PM, Menashè Eliezer wrote: Hi Christian, I'm have again performance problems. I have BaseX 8.2.1. As you may rememb

Re: [basex-talk] Slow query

quot; The network layer between client and server is very fast. P.S. Id there an undocumented way to log the full xquery in BaseX server logs? I've seen the -V option, but I don't use the standalone version, but: java -cp /usr/share/java/basex.jar org.basex.BaseXServer -d doesn't give me extr

[basex-talk] BaseX Java examples

Hello, The page http://docs.basex.org/wiki/Java_Examples is very detailed. However, I wonder in which cases one should use the BaseX XQJ API and not the standard client. e.g., which client offers a better performance? -- With kind regards, Menashè

Re: [basex-talk] Add metadata to a group of documents inside the database

/github.com/BaseXdb/basex/issues/988 If I may ask, what metadata information do you need to record about each document? Vincent -Original Message- From:basex-talk-boun...@mailman.uni-konstanz.de [mailto:basex-talk-boun...@mailman.uni-konstanz.de] On Behalf Of Christian Grün Sent: Tu

Re: [basex-talk] Add metadata to a group of documents inside the database

es and use a single XQuery expression to query all documents: for $db in ('db1', 'db2') return db:open($db)/... Hope this helps, Christian On Tue, May 12, 2015 at 2:14 PM, Menashè Eliezer wrote: Hello, I have two groups of xml to be included in the same database.

[basex-talk] Add metadata to a group of documents inside the database

Hello, I have two groups of xml to be included in the same database. Usually the same query will be performed on both of them, but I need to able to query only one group. The difference between the groups is known only to add the xml files, e.g. the origin of the files. This information is not f

Re: [basex-talk] Querying a subset

dress XML nodes of a BaseX database, you can use the db:node-pre/db:open-pre or db:node-id/db:open-id functions. Please have a look at the Wiki for more information [1]. Hope this helps, Christian [1] http://docs.basex.org/wiki/Database_Module#Read_Operations On Thu, Apr 30, 2015 at 2:49 PM, Me

Re: [basex-talk] Querying a subset

Hope this helps, Christian [1] http://docs.basex.org/wiki/Database_Module#Read_Operations On Thu, Apr 30, 2015 at 2:49 PM, Menashè Eliezer wrote: Hello, I'm using Java org.xmldb.api package for accessing the Basex server (xmldb:basex://...) After getting the resultSet I need to make furthe

Re: [basex-talk] Querying a subset

And: XQuery has no formal notion of files inside a database/collection http://stackoverflow.com/questions/3363442/refer-to-a-specific-document-in-a-basex-db-using-xquery With kind regards, Menashè On 04/30/2015 02:49 PM, Menashè Eliezer wrote: Hello, I'm using Java org.xmldb.api packag

[basex-talk] Querying a subset

Hello, I'm using Java org.xmldb.api package for accessing the Basex server (xmldb:basex://...) After getting the resultSet I need to make further queries about the requested subset (for reporting, etc.) I have seen that getId() cannot be used since the Resource will be anonymous if it is obtain

Re: [basex-talk] xml serialisation

ery_3.1#Adaptive_Serialization On Thu, Mar 12, 2015 at 12:09 PM, Menashè Eliezer wrote: Hello, I need xquery reply which is composed of multiple values. I've chosen the xml format, but I need also the collection name of each record since I'm searching in multiple collections. However fo

[basex-talk] xml serialisation

Hello, I need xquery reply which is composed of multiple values. I've chosen the xml format, but I need also the collection name of each record since I'm searching in multiple collections. However for parsing the entire reply as xml I need to add an arbitrary xml tag to base-uri($x). I couldn't

Re: [basex-talk] impressed! and already trying to run before I can walk

Hi Niels, Just confirming BaseX is very good. I've confronted its performance and support to the biggest open source alternative, which I won't mention its name here. With kind regards, Menashè On 02/02/2015 02:48 PM, Bridger Dyson-Smith wrote: Hi Niels, BaseX has some very nice documentati

Re: [basex-talk] Slow query

t;, "AYMD") in log. Second launch: 1333.71 ms Latest snapshot (BaseX80-20150202.121033): 1st: Total Time: 1873.02 ms 2nd: Total Time: 548.62 ms With kind regards, Menashè On 02/02/2015 02:02 PM, Menashè Eliezer wrote: Hi Christian, Thank you very much! Unfortunately I'll be at the office on

Re: [basex-talk] Slow query

all of your conditions: >>>> >>>> gmd:MD_Metadata/gmd:identificationInfo/sdn:SDN_DataIdentification >>>> >>>> If that will be always be the case, it surely makes sense to move all >>>> of them to the "for" clause. >>

Re: [basex-talk] Slow query

t;> >>>> It's indeed interesting that your query does not use any of the >>>> existing index structures (if they did, you would find strings like >>>> "applying text index" or "applying attribute index" in the query >>>

Re: [basex-talk] Slow query

any of the existing index structures (if they did, you would find strings like "applying text index" or "applying attribute index" in the query info). Maybe/hopefully things look different with Version 8.0. On Fri, Jan 30, 2015 at 5:26 PM, Menashè Eliezer wrote: On 0

Re: [basex-talk] Slow query

ur case. Christian [1] http://files.basex.org/releases/latest On Fri, Jan 30, 2015 at 3:55 PM, Menashè Eliezer wrote: Hello, I wonder if the attached query can be optimised. I'm attaching all relevant information. Basex 7.9, Debian, powerful server. This is just an example. The qu

Re: [basex-talk] Slow query

indexing? Hope this helps, Christian [1] http://files.basex.org/releases/latest On Fri, Jan 30, 2015 at 3:55 PM, Menashè Eliezer wrote: Hello, I wonder if the attached query can be optimised. I'm attaching all relevant information. Basex 7.9, Debian, powerful server. This is just an exam

[basex-talk] Slow query

Hello, I wonder if the attached query can be optimised. I'm attaching all relevant information. Basex 7.9, Debian, powerful server. This is just an example. The queries will be built based on a compilation of a search form. So reordering the conditions for having smaller subset right from the