Re: Cyrus 3.0.8 running :) and feedback of the upgrade
Hi mates! I don't really know where the difference is, but in the dev environment, searches are hugely faster. I know, in dev is not the same as production in terms of muas traffic and so... but... we are talking in differences like from 5 seconds to perhaps 40-50 seconds and obviously when saying this... production is a non loaded env... I mean we have there 4000 accounts, but io is fine, cpu and mem are nice... os limits too there's no any bottleneck... The real difference between my dev env and prod one... is basically the way they were built. FOR DEV I created a copy of one production machine. A copy... for being able to be the most close as we could, from the prod env in this testing env. That prod env, was at 2.3. I then, connected to it 2.4-Cyrus root fs (with Cyrus 2.4). Tested this version and converted to 12 version some databases (just the ones for testing, the same ones as where I have seen this speed effect). Later I disconnected the 2.4-Cyrus root disk and connected a 3.0-Cyrus root disk. Did a reconstruct -r -V max, ctl_conversationsdb -z on-testing-used-mailboxes and ctl_conversationsdb -b on-testing-used-mailboxes. FOR PROD we connected to 2.3 server the 2.4-Cyrus root disk. Later we setup an empty slave with 3.0 and started a user by user, user mode replication there. Later a rolling one (with the file generated between last "all users, user by user sync" and the moment we started the rolling one) when almost all in the slave was very near to the present state of the master in that moment. This replication was done with Csync not IMAP. These too are the basic differences... could this give you some kind of clue?... I'll try to debug code too in order to see something Cheers! --- EGOITZ AURREKOETXEA Departamento de sistemas 944 209 470 Parque Tecnológico. Edificio 103 48170 Zamudio (Bizkaia) ego...@sarenet.es www.sarenet.es [1] Antes de imprimir este correo electrónico piense si es necesario hacerlo. El 13-02-2019 18:19, Egoitz Aurrekoetxea escribió: > thanks a lot mate! > > I'm doing checks... for comparing the previous testing env and live > production :) > > Cheers! > > --- > > EGOITZ AURREKOETXEA > Departamento de sistemas > 944 209 470 > Parque Tecnológico. Edificio 103 > 48170 Zamudio (Bizkaia) > ego...@sarenet.es > www.sarenet.es [1] > Antes de imprimir este correo electrónico piense si es necesario hacerlo. > > El 13-02-2019 17:58, Robert Stepanek escribió: > On Wed, Feb 13, 2019, at 2:24 PM, Egoitz Aurrekoetxea wrote: > > Or.. if using in imapd.conf "search_fuzzy_always: 1" isn't it?. > > Yes, that will instruct imapd to always use FUZZY search for IMAP SEARCH > commands [1]. If you use JMAP, it always use fuzzy search (and hence the > Xapian backend). > > [1] https://github.com/cyrusimap/cyrus-imapd/blob/master/imap/imapd.c#L6059 Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus Links: -- [1] http://www.sarenet.es Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: Cyrus 3.0.8 running :) and feedback of the upgrade
thanks a lot mate! I'm doing checks... for comparing the previous testing env and live production :) Cheers! --- EGOITZ AURREKOETXEA Departamento de sistemas 944 209 470 Parque Tecnológico. Edificio 103 48170 Zamudio (Bizkaia) ego...@sarenet.es www.sarenet.es [1] Antes de imprimir este correo electrónico piense si es necesario hacerlo. El 13-02-2019 17:58, Robert Stepanek escribió: > On Wed, Feb 13, 2019, at 2:24 PM, Egoitz Aurrekoetxea wrote: > >> Or.. if using in imapd.conf "search_fuzzy_always: 1" isn't it?. > > Yes, that will instruct imapd to always use FUZZY search for IMAP SEARCH > commands [1]. If you use JMAP, it always use fuzzy search (and hence the > Xapian backend). > > [1] https://github.com/cyrusimap/cyrus-imapd/blob/master/imap/imapd.c#L6059 Links: -- [1] http://www.sarenet.es Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: Cyrus 3.0.8 running :) and feedback of the upgrade
On Wed, Feb 13, 2019, at 2:24 PM, Egoitz Aurrekoetxea wrote: > Or.. if using in imapd.conf "search_fuzzy_always: 1" isn't it?. Yes, that will instruct imapd to always use FUZZY search for IMAP SEARCH commands [1]. If you use JMAP, it always use fuzzy search (and hence the Xapian backend). [1]https://github.com/cyrusimap/cyrus-imapd/blob/master/imap/imapd.c#L6059 Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: Cyrus 3.0.8 running :) and feedback of the upgrade
Or.. if using in imapd.conf "search_fuzzy_always: 1" isn't it?. If a search returns results... I assume is going through it... isn't it?. else.. I assume nothing would be found... I really attached too the configs (in url format of pastebin), https://pastebin.com/CtCEedty just for... the cause you could see something missing there... which by the way... I don't think something could be missed but I'm new to Xapian :) :) although have been running Cyrus more than ten years ago :) :) ... Cheers! --- EGOITZ AURREKOETXEA Departamento de sistemas 944 209 470 Parque Tecnológico. Edificio 103 48170 Zamudio (Bizkaia) ego...@sarenet.es www.sarenet.es [1] Antes de imprimir este correo electrónico piense si es necesario hacerlo. El 13-02-2019 13:21, Robert Stepanek escribió: > Hi Egoitz, > > On Wed, Feb 13, 2019, at 1:10 PM, Egoitz Aurrekoetxea wrote: > >> Xapian version is xapian-core-1.4.9_1 (FreeBSD port). Could I see by some >> debbuging log Xapian is working in the searchs in order to know, that can't >> be faster and that all is ok?. At the moment I have tree tiers. But I'm just >> with the default one in almost all mailboxes > > If you use FUZZY search in your search expression then it must go through > Xapian. > > Cheers, > Robert > > > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus Links: -- [1] http://www.sarenet.es Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: Cyrus 3.0.8 running :) and feedback of the upgrade
Hi Egoitz, On Wed, Feb 13, 2019, at 1:10 PM, Egoitz Aurrekoetxea wrote: > Xapian version is xapian-core-1.4.9_1 (FreeBSD port). Could I see by > some debbuging log Xapian is working in the searchs in order to know, > that can't be faster and that all is ok?. At the moment I have tree > tiers. But I'm just with the default one in almost all mailboxes If you use FUZZY search in your search expression then it must go through Xapian. Cheers, Robert Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Cyrus 3.0.8 running :) and feedback of the upgrade
Hi mates! This has been the great day. We have upgraded a server pair (master/slave). Almost all has gone fine, apart from the fact that we have two extrange issues : - Some users had found their folders unsubscribed and seems the same too, lost them Sieve filters. Perhaps due to autocreate or xlist?? which we weren't previously using¿? - I'm not really sure, if Xapian is "actively" working. We have upgraded from 2.4 Cyrus to 3.0.8 with the replication method. First has been finally fixed with a couple of scripts. The second one... I paste the master/slave config here : https://pastebin.com/CtCEedty I think it's all ok... and by the way log is saying : Feb 13 13:07:19 masterserver squatter[13446]: Xapian committed 1 updates in 0.146300 sec Feb 13 13:07:19 masterserver squatter[13446]: Xapian committed 3 updates in 0.075679 sec Feb 13 13:07:21 masterserver squatter[13446]: Xapian committed 36 updates in 1.219806 sec Feb 13 13:07:22 masterserver squatter[13446]: Xapian committed 1 updates in 0.256899 sec Feb 13 13:07:22 masterserver squatter[13446]: Xapian committed 5 updates in 0.165767 sec Feb 13 13:07:22 masterserver squatter[13446]: Xapian committed 1 updates in 0.252658 sec Feb 13 13:07:22 masterserver squatter[13446]: Xapian committed 4 updates in 0.083638 sec Feb 13 13:07:24 masterserver squatter[13446]: Xapian committed 4 updates in 0.952737 sec Xapian version is xapian-core-1.4.9_1 (FreeBSD port). Could I see by some debbuging log Xapian is working in the searchs in order to know, that can't be faster and that all is ok?. At the moment I have tree tiers. But I'm just with the default one in almost all mailboxes. Thank you so much mates :) :) (as always) Cheers! -- EGOITZ AURREKOETXEA Departamento de sistemas 944 209 470 Parque Tecnológico. Edificio 103 48170 Zamudio (Bizkaia) ego...@sarenet.es www.sarenet.es [1] Antes de imprimir este correo electrónico piense si es necesario hacerlo. Links: -- [1] http://www.sarenet.es Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
