I have a setup using rsync to keep database directory copies synchronized with
a master over the network. It works very well for me.22. mai 2018 10:16
kirjutas kuupäeval Alexander Holupirek <[email protected]>:
>
> Hi Martin,
>
> export/import is one option. backup/restore another [1].
> And a third could be to copy the database directory (provided the servers
> have a more or less similar setup).
>
> Cheers,
> Alex
>
> [1] http://docs.basex.org/wiki/Backups (can also be done via DBA [2])
> [2] http://docs.basex.org/wiki/DBA
>
> > On 21. May 2018, at 18:32, Martin Lourduswamy <[email protected]>
> > wrote:
> >
> > Hi,
> > I would like to know how to copy a database from one server to another
> > server, please let me know.
> > Is it export and get and load xml or is there another way to do it, thanks
> > for the clarification,
> > Regards
> > Martin Lourduswamy
> >
> > On Mon, May 21, 2018 at 6:00 AM,
> > <[email protected]> wrote:
> > Send BaseX-Talk mailing list submissions to
> > [email protected]
> >
> > To subscribe or unsubscribe via the World Wide Web, visit
> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
> > or, via email, send a message with subject or body 'help' to
> > [email protected]
> >
> > You can reach the person managing the list at
> > [email protected]
> >
> > When replying, please edit your Subject line so it is more specific
> > than "Re: Contents of BaseX-Talk digest..."
> >
> >
> > Today's Topics:
> >
> > 1. Fwd: BaseX performance improvements (Christian Gr?n)
> > 2. Re: BaseX performance improvements (Christian Gr?n)
> >
> >
> > ----------------------------------------------------------------------
> >
> > Message: 1
> > Date: Sun, 20 May 2018 18:51:03 +0200
> > From: Christian Gr?n <[email protected]>
> > To: Martin Lourduswamy <[email protected]>, BaseX
> > <[email protected]>
> > Subject: [basex-talk] Fwd: BaseX performance improvements
> > Message-ID:
> >
> ><CAP94bnPHW=nqzxxy-cfubgslzwloiipzj_wfnj6twyzfg0d...@mail.gmail.com>
> > Content-Type: text/plain; charset="UTF-8"
> >
> > Hi Martin (cc to the list),
> >
> > > 1. each XML node => 500 bytes
> > > 2. total size of XML DB => 10million nodes(which will grow continuously
> > > as
> > > new files are added).
> >
> > So one node is one document, right? I?m just asking because, in the
> > XML terminology, each XML document has nodes itself: element nodes,
> > attributes nodes, text nodes, etc.
> >
> > If you are working with millions of documents, it can be helpful to
> > work with a "daily" database, which contains auxiliary references on
> > documents that have been deleted or updated. If there is a time
> > interval in which no people access your database (e.g. each night),
> > you can merge these databases and recreate your index structures. If
> > you query your database, you can a few more lines of XQuery: first
> > check your daily database, and (if it doesn?t contain the required
> > document) look up the document in your fully indexed database.
> >
> > > I have to do a update of the nodes as I need to replace them. I chose
> > > delete
> > > + insert instead of replace
> >
> > Please note that a replace operation can be much faster: If the
> > structure of the updated document is similar to the old document, the
> > document can be replace in-place.
> >
> > > Also, I am thinking of indexing on the node id, as that is like the
> > > primary
> > > key on which I base my operations, any suggestions might also be helpful,
> >
> > Here it may also be interesting to know if you will only address
> > documents or arbitrary nodes of your document. In the first case,
> > addressing the document path via db:open should be sufficient [1]. In
> > the latter case, you could possibly use the existing function
> > db:node-id [2].
> >
> > Hope this helps,
> > Christian
> >
> > [1] http://docs.basex.org/wiki/Databases
> > [2] http://docs.basex.org/wiki/Database_Module#db:node-id
> >
> >
> >
> > > Thanks again,
> > > Regards
> > > Martin Lourduswamy
> > >
> > > On Sun, May 20, 2018 at 9:28 AM, Christian Gr?n
> > > <[email protected]>
> > > wrote:
> > >>
> > >> Hi Martin,
> > >>
> > >> > I am new to BaseX, I would like ot speed up XQuery of insert and
> > >> > delete
> > >> > and
> > >> > replace through options.
> > >>
> > >> Welcome to the list. As there are numerous ways to do updates in
> > >> BaseX, feel free to give us more information on your insert and delete
> > >> operations. Do you work with large single documents or many small
> > >> documents? How large is your database?
> > >>
> > >> > While I query basex through perl, and try to
> > >> > connect through GUI, the perl connection aborts. Is there a parameters
> > >> > for
> > >> > parallel connections, please let me know.
> > >>
> > >> I can?t tell why your perl connection is interrupted by opening the
> > >> GUI (because they should be completely independent from each other). A
> > >> step-by-step description on how you proceeded might be helpful.
> > >>
> > >> Because there is no coupling between GUI and the client/server
> > >> architecture, however, you should avoid running updates outside the
> > >> GUI. Please check out [1] for more information.
> > >>
> > >> Best,
> > >> Christian
> > >>
> > >> [1] http://docs.basex.org/wiki/Startup#Concurrent_Operations
> > >>
> > >>
> > >>
> > >> >
> > >> > Thanks,
> > >> > Regards
> > >> > Martin Lourduswamy
> > >
> > >
> >
> >
> > ------------------------------
> >
> > Message: 2
> > Date: Sun, 20 May 2018 18:56:45 +0200
> > From: Christian Gr?n <[email protected]>
> > To: Martin Lourduswamy <[email protected]>, BaseX
> > <[email protected]>
> > Subject: Re: [basex-talk] BaseX performance improvements
> > Message-ID:
> >
> ><cap94bnn6w7zaanu43aqdzrkysaqaxkgsamrnp8zy3fmeejz...@mail.gmail.com>
> > Content-Type: text/plain; charset="UTF-8"
> >
> > > Java heap space at C:\Users\lourduswamym\oracle_scripts/BaseXClient.pm
> > > line
> > > 213.
> >
> > How much memory have you assigned to BaseX [1]?
> >
> > > Actually the error on the server log. The insert operation was taking
> > > 1+minutes due to slow network and then the error happened. I have been
> > > running this server instance continuously for 1 day with continuous
> > > insert from a per script.
> >
> > If you create a new database, you can specify a directory with the
> > files that are to be initially added to your database. This might save
> > you a lot of time.
> >
> > > So I think I should be careful to run only one single process of client
> > > at a
> > > time or make sure memory is enough to handle multiple client operations,
> > > please let me know your thoughts,
> >
> > If your documents are small, you shouldn?t usually encounter any
> > errors. But it might have to do with the large number of documents you
> > are dealing with. One more option is to distribute your docs across
> > multiple databases (you can access all of them via a single XQuery
> > expression).
> >
> > Best,
> > Christian
> >
> > [1] http://docs.basex.org/wiki/Start_Scripts
> >
> >
> >
> >
> > > Thanks again,
> > > Regards
> > > Martin Lourduswamy
> > >
> > > On Sun, May 20, 2018 at 9:48 AM, Martin Lourduswamy
> > > <[email protected]>
> > > wrote:
> > >>
> > >> Hi,
> > >>
> > >> Thanks for the clarifications. My database is
> > >>
> > >> DB Size:
> > >> ======
> > >> 1. each XML node => 500 bytes
> > >> 2. total size of XML DB => 10million nodes(which will grow continuously
> > >> as
> > >> new files are added).
> > >> 3. I will be having multiple DB's of same size and more size as the DB
> > >> continuously grows
> > >>
> > >> I have to do a update of the nodes as I need to replace them. I chose
> > >> delete + insert instead of replace for each of the node through perl, as
> > >> I
> > >> will make sure there are no duplicate nodes left in the database.(just a
> > >> precaution that even if some nodes get duplicated, through some other
> > >> processes I will be able to remove them by delete)
> > >>
> > >> DB Speed:
> > >> ========
> > >> I will disable logging as it might speed up the database operations.
> > >>
> > >> DB Architecture
> > >> ============
> > >> 1 server(windows or Linux) running baseX
> > >> multiple client computers trying to query the same machine for select
> > >> through fn:doc(...) API to get the data through perl
> > >> then do a delete + insert from perl
> > >>
> > >> I would like to know if you think this might work for production and any
> > >> suggestion for data retrieval and update
> > >> Any changes to the way I architecture it might help
> > >>
> > >> Also, I am thinking of indexing on the node id, as that is like the
> > >> primary key on which I base my operations, any suggestions might also be
> > >> helpful,
> > >> Thanks again,
> > >> Regards
> > >> Martin Lourduswamy
> > >>
> > >> On Sun, May 20, 2018 at 9:28 AM, Christian Gr?n
> > >> <[email protected]> wrote:
> > >>>
> > >>> Hi Martin,
> > >>>
> > >>> > I am new to BaseX, I would like ot speed up XQuery of insert and
> > >>> > delete
> > >>> > and
> > >>> > replace through options.
> > >>>
> > >>> Welcome to the list. As there are numerous ways to do updates in
> > >>> BaseX, feel free to give us more information on your insert and delete
> > >>> operations. Do you work with large single documents or many small
> > >>> documents? How large is your database?
> > >>>
> > >>> > While I query basex through perl, and try to
> > >>> > connect through GUI, the perl connection aborts. Is there a
> > >>> > parameters
> > >>> > for
> > >>> > parallel connections, please let me know.
> > >>>
> > >>> I can?t tell why your perl connection is interrupted by opening the
> > >>> GUI (because they should be completely independent from each other). A
> > >>> step-by-step description on how you proceeded might be helpful.
> > >>>
> > >>> Because there is no coupling between GUI and the client/server
> > >>> architecture, however, you should avoid running updates outside the
> > >>> GUI. Please check out [1] for more information.
> > >>>
> > >>> Best,
> > >>> Christian
> > >>>
> > >>> [1] http://docs.basex.org/wiki/Startup#Concurrent_Operations
> > >>>
> > >>>
> > >>>
> > >>> >
> > >>> > Thanks,
> > >>> > Regards
> > >>> > Martin Lourduswamy
> > >>
> > >>
> > >
> >
> >
> > End of BaseX-Talk Digest, Vol 101, Issue 37
> > *******************************************
> >
>
