Hey Vladimir,You can use sharding approach for you data import and split all DBs even every month.
On Mon, Jun 25, 2018 at 11:50 AM Ветошкин Владимир <en-tra...@yandex.ru> wrote:Hi, Alexander!Thank you!In my previous letter I have described the proccess in short.I'll think about separated DB. But I'm afraid that this base will also be very big in future.Although I can try to split data to several databases - one per year.. Hmm..25.06.2018, 11:25, "Alexander Shpack" <shadow...@gmail.com>:Hey, Vladimir!Just put this specific files to the separated DB and than index it.
You can process it automatically, BaseX allows to create and index DB right from XQuery.
I hope it helps you. Anyhow, you can provide more details about your task and we can figure out the best solution for you.On Mon, Jun 25, 2018 at 10:42 AM Ветошкин Владимир <en-tra...@yandex.ru> wrote:Hi, Fabrice!Thank you.All databases constantly change.That is why there is no way to single out "a big readonly collection" :(Maybe it is possible to use some other incremental indexes?I have to index specific xml-files, not all files in database.21.06.2018, 17:16, "Fabrice ETANCHAUD" <fetanch...@pch.cerfrance.fr>:Hi Vladimir,
I don’t think there is something like a incremental full text index for the moment [1].
As index is per collection, the recommanded way shall be to split your data in two collections :
- A big readonly collection of all the past updates, indexed once
- A small/medium sized collection whom full text index can be recreated in an acceptable time after each update.
At the end of a predefined time period, you have to add the live collection to the readonly one, reindex it, and truncate the live one.
Best regards from France,
Fabrice Etanchaud
[1] http://docs.basex.org/wiki/Indexes#Updates
De : BaseX-Talk [mailto:basex-talk-boun...@mailman.uni-konstanz.de] De la part de ???????? ????????
Envoyé : jeudi 21 juin 2018 16:02
À : BaseX
Objet : [basex-talk] Full-Text
Hi, everyone!
Is there any way to index only imported xml-files?
Now, when I import xml-files the full-text index is deleted.
After importing I recreate whole full-text index and it takes too much time :(
--
С уважением,
Ветошкин Владимир Владимирович
--С уважением,Ветошкин Владимир Владимирович
--s0rr0w--С уважением,Ветошкин Владимир Владимирович
--s0rr0w
Hi, Alexander,
Some questions:
After that, how can I perform a search in all of these databases?
Can I search for substring without fulltext using only text index?
25.06.2018, 11:56, "Alexander Shpack" <shadow...@gmail.com>:
--
С уважением,
Ветошкин Владимир Владимирович
- [basex-talk] Full-Text Ветошкин Владимир
- Re: [basex-talk] Full-Text Fabrice ETANCHAUD
- Re: [basex-talk] Full-Text Ветошкин Владимир
- Re: [basex-talk] Full-Text Fabrice ETANCHAUD
- Re: [basex-talk] Full-T... Ветошкин Владимир
- Re: [basex-talk] Full-Text Alexander Shpack
- Re: [basex-talk] Full-T... Ветошкин Владимир
- Re: [basex-talk] F... Alexander Shpack
- Re: [basex-tal... Ветошкин Владимир
- Re: [basex... Alexander Shpack
- Re: [basex... Ветошкин Владимир
- Re: [basex... Ветошкин Владимир
- Re: [basex... Christian Grün
- Re: [basex... Ветошкин Владимир
- Re: [basex... Christian Grün
- Re: [basex... Ветошкин Владимир
- Re: [basex... Christian Grün
- Re: [basex... Ветошкин Владимир
- Re: [basex... Christian Grün