Re: [Dovecot] dsync replication available for testing
Hi, On 03/04/12 11:44, Timo Sirainen wrote: In dovecot-2.1 hg you can now test dsync-based replication. Everything isn't finished yet, but it appears to work and I've enabled it for my @dovecot.fi mails. Some issues: - public namespace isn't replicated at all - shared namespace is replicated, but not private mail flags - I've only tested SSH replication setup now, not director replication setup (and director setup is still missing many things) - SSH replication setup uses aggregator process, which isn't really necessary and can probably be avoided in future Do you plan to make it more performant in the future? I mean calling doveadm (and ssh) for every change -even when they are aggregated- seems to be very resource intensive, it won't keep up on a machine with a lot of modifications happening every seconds. It would be good to have constantly running daemons on both sides to eliminate the high startup/teardown costs. (if I understand things correctly) Thanks for working on this.
Re: [Dovecot] testing fts-solr?
Stan, * Stan Hoeppner : > On 3/4/2012 4:47 PM, Patrick Ben Koetter wrote: > > > On 04.03.2012 23:29, Stan Hoeppner wrote: > > > > > > > >> not worth discussing seems a bit naive, or arrogant, or both. Given how > >> long it takes, never in some cases, for Mozilla to fix IMAP related > >> problems in TBird, you can't blame the OP for looking in other > >> directions for a solution. Note the bug I filed 2+ years on broken IMAP > >> custom header search: > >> > >> https://bugzilla.mozilla.org/show_bug.cgi?id=546925 > >> > >> 2 years later and it's not even been assigned to a dev... > > > > We started buying features/fixes. > > Does Mozilla have a page listing such services and prices, err, > required/expected donation amounts? to my knowledge they don't have a page listing services and prices. Recently they discussed pros and cons of crowd sourcing, but without much progress. I can get you in contact with one of the TB programmers, who implemented features for us, if you want to. p@rick -- state of mind () http://www.state-of-mind.de Franziskanerstraße 15 Telefon +49 89 3090 4664 81669 München Telefax +49 89 3090 4666 Amtsgericht MünchenPartnerschaftsregister PR 563 smime.p7s Description: S/MIME cryptographic signature
Re: [Dovecot] BlackBerry will not setup my POP3 email, all other mail clients fine
Am 05.03.2012 02:42, schrieb Ian Solecki: > Hello, hoping someone here might be able to help me or at least point me in > the right direction. > > My company recently (last week) moved to a new dedicated server for website > and email hosting. It is a fairly run-of-the-mill Linux machine running > cPanel and Dovecot (with the BlackBerry Fastmail service enabled) as a mail > server. > > When we first set up the server, I was able to create a mailbox, access it > via any desktop mail client, webmail, AND by setting it up as a basic POP3 > account on my BlackBerry. Mail was running fine to and from the BlackBerry, > no problems. > > I deleted that account from my BlackBerry as it was a test account, and > went to add my actual account but was unable to do so. Received the "Cannot > log in. Verify your email address, user name and password. If the error > persists, contact (my domain name)" message. I tried the test account that > had been running successfully and sending/receiving emails not minutes > earlier, and it would not set up either. > > I have since tried multiple accounts on multiple BlackBerry devices > (different models) on multiple carriers on several of my different domains > (all of which point to the same server, of course), to no avail. > > Yet, any of these accounts still work flawlessly in any desktop mail client > (Outlook, OE, Thunderbird, iPad, iPhone, etc). Also, any of these > BlackBerrys work flawlessly with any other mail server. > > The username to log in to these mailboxes is not standard, it's mailboxname+ > example.com if the email address is mailboxn...@example.com and the mail > server is mail.example.com. So, I know I have to access the "Advanced > Settings" in BlackBerry email setup in order to put this username in. > Still, no effect. > > So, there is something wrong with how mail SETUP works (not > sending/receiving, though that may also not work, I have no way of knowing > now) between RIM and my server, and it's something that has changed since > the server was set up a week ago. > > My carrier(s) are clueless, my dedicated server provider (Lunarpages) is > clueless. Can anyone help? > this is the dovecot mail list, not support for blackberry, we cant help unless you have dovecot configs and dediacted logs to your problem -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria
Re: [Dovecot] dsync replication available for testing
On 4.3.2012, at 23.39, Michael Grimm wrote: >> Anyway, replicator simply runs doveadm, so there's not much that can go >> wrong. So >> you could even ignore 1) and just let it sync everyone at startup. > > Does that mean that the new functionality (queue) does only run dsync > replication > the usual way whenever new mail arrives? That's at least what I read in your > code > committed today (but I'm not that good in reading code I do have to confess). > > If you could approve my assumption, I'm willing to give it a try to all users. Yes, the replicator simply runs "doveadm sync -u user@domain -d" (and sometimes with -f). The -d gets the default location from mail_replica setting.
Re: [Dovecot] doveconf: Warning: Obsolete settings.... in /etc/dovecot/dovecot.conf: ...
Dovecot v2.0 changed the settings a lot compared to v1.x. There are no longer auth default or socket listen sections. The doveconf -n generated dovecot.conf should contain all of the settings that you had in v1.x, converted for v2.0. So you should be able to use it directly without problems. If you want, you could look for Dovecot's example-config that probably comes with Ubuntu (in /usr/share/doc/dovecot*/ maybe?), copy those to /etc/dovecot/ and change the settings in there based on the generated dovecot.conf. In any case you shouldn't try to add those v1.x-specific things back there anymore, since they'll add back the "obsolete settings" warnings. On 5.3.2012, at 5.57, Dennis Chen wrote: > Thanks Timo, > > I believe I'm running dovecot 2.0.x when first installed Ubuntu server 11.04 > then upgraded to 11.10. The primary reason I posted this question was not > only the warning msg but also looking for the default dovecot.conf so that I > can modify from the scratch, however, I couldn't find the "auth default" > section or the "socket listen" option in the dovecot.conf; note that the > "auth default" section and "socket listen" need to be modified according > Ubuntu 11.10 serverguide for Dovecot SASL configuration. There is a > dovecot.conf.ucf under /etc/dovecot which contain the "auth default" and > "socket listen" stuff, I renamed it to dovecot.conf and modified the "auth > default" section and "socket listen" option there accordingly. Note that the > dovecot.conf.ucf file is about 50k while the new dovecot.conf generated from > the "doveconf -n" is about 4k ! Now I'm confused of using of which > dovecot.conf I should use (the one generated from the "doveconf -n" or the > one renamed from the dovecot.conf.ucf" ?) > > Does your dovecot.conf contain the "auth default" section and the "socket > listen" ? If not, should I complain to the Ubuntu serverguide ? > > I also posted the similar question to ubuntuforums, but not much response. > > Hope you understand my point. > > It's very frustrated! > > > Sent from my iPhone > > On Mar 4, 2012, at 4:36 AM, Timo Sirainen wrote: > >> On 4.3.2012, at 8.25, D Chen wrote: >> >>> Got duplicated Warnings from the "doveconf -n" output ! Can anyone explain >>> and fix them ? thx! >> >> v2.0 has different configuration from v1.x, you need to migrate the >> configuration the way it says: >> >>> doveconf: Warning: NOTE: You can get a new clean config file with: >>> doveconf -n > dovecot-new.conf >> >> So, doveconf -n > dovecot-new.conf >> mv dovecot-new.conf /etc/dovecot/dovecot.conf >> >> That should do it. >> >
Re: [Dovecot] doveconf: Warning: Obsolete settings.... in /etc/dovecot/dovecot.conf: ...
Thanks Timo, I believe I'm running dovecot 2.0.x when first installed Ubuntu server 11.04 then upgraded to 11.10. The primary reason I posted this question was not only the warning msg but also looking for the default dovecot.conf so that I can modify from the scratch, however, I couldn't find the "auth default" section or the "socket listen" option in the dovecot.conf; note that the "auth default" section and "socket listen" need to be modified according Ubuntu 11.10 serverguide for Dovecot SASL configuration. There is a dovecot.conf.ucf under /etc/dovecot which contain the "auth default" and "socket listen" stuff, I renamed it to dovecot.conf and modified the "auth default" section and "socket listen" option there accordingly. Note that the dovecot.conf.ucf file is about 50k while the new dovecot.conf generated from the "doveconf -n" is about 4k ! Now I'm confused of using of which dovecot.conf I should use (the one generated from the "doveconf -n" or the one renamed from the dovecot.conf.ucf" ?) Does your dovecot.conf contain the "auth default" section and the "socket listen" ? If not, should I complain to the Ubuntu serverguide ? I also posted the similar question to ubuntuforums, but not much response. Hope you understand my point. It's very frustrated! Sent from my iPhone On Mar 4, 2012, at 4:36 AM, Timo Sirainen wrote: > On 4.3.2012, at 8.25, D Chen wrote: > >> Got duplicated Warnings from the "doveconf -n" output ! Can anyone explain >> and fix them ? thx! > > v2.0 has different configuration from v1.x, you need to migrate the > configuration the way it says: > >>doveconf: Warning: NOTE: You can get a new clean config file with: >> doveconf -n > dovecot-new.conf > > So, doveconf -n > dovecot-new.conf > mv dovecot-new.conf /etc/dovecot/dovecot.conf > > That should do it. >
Re: [Dovecot] BlackBerry will not setup my POP3 email, all other mail clients fine
Do you have the dovecot logs? What do they say about connections coming from RIM? On 03/04/2012 08:42 PM, Ian Solecki wrote: Hello, hoping someone here might be able to help me or at least point me in the right direction. My company recently (last week) moved to a new dedicated server for website and email hosting. It is a fairly run-of-the-mill Linux machine running cPanel and Dovecot (with the BlackBerry Fastmail service enabled) as a mail server. When we first set up the server, I was able to create a mailbox, access it via any desktop mail client, webmail, AND by setting it up as a basic POP3 account on my BlackBerry. Mail was running fine to and from the BlackBerry, no problems. I deleted that account from my BlackBerry as it was a test account, and went to add my actual account but was unable to do so. Received the "Cannot log in. Verify your email address, user name and password. If the error persists, contact (my domain name)" message. I tried the test account that had been running successfully and sending/receiving emails not minutes earlier, and it would not set up either. I have since tried multiple accounts on multiple BlackBerry devices (different models) on multiple carriers on several of my different domains (all of which point to the same server, of course), to no avail. Yet, any of these accounts still work flawlessly in any desktop mail client (Outlook, OE, Thunderbird, iPad, iPhone, etc). Also, any of these BlackBerrys work flawlessly with any other mail server. The username to log in to these mailboxes is not standard, it's mailboxname+ example.com if the email address is mailboxn...@example.com and the mail server is mail.example.com. So, I know I have to access the "Advanced Settings" in BlackBerry email setup in order to put this username in. Still, no effect. So, there is something wrong with how mail SETUP works (not sending/receiving, though that may also not work, I have no way of knowing now) between RIM and my server, and it's something that has changed since the server was set up a week ago. My carrier(s) are clueless, my dedicated server provider (Lunarpages) is clueless. Can anyone help?
[Dovecot] BlackBerry will not setup my POP3 email, all other mail clients fine
Hello, hoping someone here might be able to help me or at least point me in the right direction. My company recently (last week) moved to a new dedicated server for website and email hosting. It is a fairly run-of-the-mill Linux machine running cPanel and Dovecot (with the BlackBerry Fastmail service enabled) as a mail server. When we first set up the server, I was able to create a mailbox, access it via any desktop mail client, webmail, AND by setting it up as a basic POP3 account on my BlackBerry. Mail was running fine to and from the BlackBerry, no problems. I deleted that account from my BlackBerry as it was a test account, and went to add my actual account but was unable to do so. Received the "Cannot log in. Verify your email address, user name and password. If the error persists, contact (my domain name)" message. I tried the test account that had been running successfully and sending/receiving emails not minutes earlier, and it would not set up either. I have since tried multiple accounts on multiple BlackBerry devices (different models) on multiple carriers on several of my different domains (all of which point to the same server, of course), to no avail. Yet, any of these accounts still work flawlessly in any desktop mail client (Outlook, OE, Thunderbird, iPad, iPhone, etc). Also, any of these BlackBerrys work flawlessly with any other mail server. The username to log in to these mailboxes is not standard, it's mailboxname+ example.com if the email address is mailboxn...@example.com and the mail server is mail.example.com. So, I know I have to access the "Advanced Settings" in BlackBerry email setup in order to put this username in. Still, no effect. So, there is something wrong with how mail SETUP works (not sending/receiving, though that may also not work, I have no way of knowing now) between RIM and my server, and it's something that has changed since the server was set up a week ago. My carrier(s) are clueless, my dedicated server provider (Lunarpages) is clueless. Can anyone help?
Re: [Dovecot] Dovecot 2.1 with custom OpenSSL fails to build
Hello Timo! Timo Sirainen wrote: > The SSL libraries shouldn't be linked when imapc isn't built. Also it > probably wouldn't have built with you if you used configure > --without-shared-libs. I did a bit large change that hopefully fixes > everything: > http://hg.dovecot.org/dovecot-2.1/rev/e540404debb7 Thanks for this patch. I've applied it to the dovecot-20120303 nightly snapshot. The good news is, compilation works fine. The bad news is, the libraries and binaries don't work because they don't find the custom SSL libraries. Greetings, Andreas === $ patch -p1 -s < ../dovecot-20120303-e540404debb7.patch $ env SSL_CFLAGS="-I/usr/local/ssl/include" SSL_LIBS="-L/usr/local/ssl/lib -Wl,-R/usr/local/ssl/lib -lcrypto -lssl" ./configure --prefix=/usr/local/Dovecot-20120303 --with-ssl=openssl --with-ssldir=/usr/local/Dovecot-20120303/etc/dovecot/certs && make && make install === $ ldd src/*/.libs/*.so src/auth/.libs/libauthdb_imap.so: linux-gate.so.1 => (0x0013a000) libcrypto.so.1.0.0 => not found libssl.so.1.0.0 => not found libdovecot.so.0 => /usr/local/src/dovecot-20120303/src/lib-dovecot/.libs/libdovecot.so.0 (0x0091d000) librt.so.1 => /lib/librt.so.1 (0x003c7000) libc.so.6 => /lib/libc.so.6 (0x00c6a000) libdl.so.2 => /lib/libdl.so.2 (0x009a6000) libpthread.so.0 => /lib/libpthread.so.0 (0x00491000) /lib/ld-linux.so.2 (0x007a4000) src/lib-dovecot/.libs/libdovecot.so: linux-gate.so.1 => (0x0053c000) libdl.so.2 => /lib/libdl.so.2 (0x0056d000) librt.so.1 => /lib/librt.so.1 (0x00925000) libc.so.6 => /lib/libc.so.6 (0x00626000) /lib/ld-linux.so.2 (0x00a61000) libpthread.so.0 => /lib/libpthread.so.0 (0x003ec000) src/lib-lda/.libs/libdovecot-lda.so: linux-gate.so.1 => (0x00b75000) libdovecot-storage.so.0 => /usr/local/src/dovecot-20120303/src/lib-storage/.libs/libdovecot-storage.so.0 (0x00c9a000) libdovecot.so.0 => /usr/local/src/dovecot-20120303/src/lib-dovecot/.libs/libdovecot.so.0 (0x0062d000) librt.so.1 => /lib/librt.so.1 (0x00b3d000) libc.so.6 => /lib/libc.so.6 (0x0011) libcrypto.so.1.0.0 => not found libssl.so.1.0.0 => not found libdl.so.2 => /lib/libdl.so.2 (0x002f1000) libpthread.so.0 => /lib/libpthread.so.0 (0x00ab1000) /lib/ld-linux.so.2 (0x00f23000) src/lib-sql/.libs/libdovecot-sql.so: linux-gate.so.1 => (0x006d3000) libdovecot.so.0 => /usr/local/src/dovecot-20120303/src/lib-dovecot/.libs/libdovecot.so.0 (0x0096c000) libdl.so.2 => /lib/libdl.so.2 (0x0078c000) librt.so.1 => /lib/librt.so.1 (0x0011) libc.so.6 => /lib/libc.so.6 (0x00119000) /lib/ld-linux.so.2 (0x00731000) libpthread.so.0 => /lib/libpthread.so.0 (0x00569000) src/lib-ssl-iostream/.libs/libdovecot-ssl.so: linux-gate.so.1 => (0x00ea1000) libdl.so.2 => /lib/libdl.so.2 (0x00b31000) libcrypto.so.1.0.0 => /usr/local/ssl/lib/libcrypto.so.1.0.0 (0x0011) libssl.so.1.0.0 => /usr/local/ssl/lib/libssl.so.1.0.0 (0x00dcf000) librt.so.1 => /lib/librt.so.1 (0x00fa5000) libc.so.6 => /lib/libc.so.6 (0x002d3000) /lib/ld-linux.so.2 (0x002b4000) libpthread.so.0 => /lib/libpthread.so.0 (0x00d3c000) src/lib-storage/.libs/libdovecot-storage.so: linux-gate.so.1 => (0x002ee000) libcrypto.so.1.0.0 => not found libssl.so.1.0.0 => not found libdovecot.so.0 => /usr/local/src/dovecot-20120303/src/lib-dovecot/.libs/libdovecot.so.0 (0x00395000) libdl.so.2 => /lib/libdl.so.2 (0x00958000) librt.so.1 => /lib/librt.so.1 (0x00333000) libc.so.6 => /lib/libc.so.6 (0x00d45000) /lib/ld-linux.so.2 (0x008e9000) libpthread.so.0 => /lib/libpthread.so.0 (0x00f06000) src/login-common/.libs/libdovecot-login.so: linux-gate.so.1 => (0x00d66000) libcrypto.so.1.0.0 => not found libssl.so.1.0.0 => not found libdovecot.so.0 => /usr/local/src/dovecot-20120303/src/lib-dovecot/.libs/libdovecot.so.0 (0x00c82000) librt.so.1 => /lib/librt.so.1 (0x00f64000) libc.so.6 => /lib/libc.so.6 (0x0011) libdl.so.2 => /lib/libdl.so.2 (0x00b26000) libpthread.so.0 => /lib/libpthread.so.0 (0x0029a000) /lib/ld-linux.so.2 (0x0052) === $ ldd /usr/local/Dovecot-20120303/lib/dovecot/*.so /usr/local/Dovecot-20120303/*bin/* /usr/local/Dovecot-20120303/lib/dovecot/lib01_acl_plugin.so: linux-gate.so.1 => (0x0023) librt.so.1 => /lib/librt.so.1 (0x00b69000) libc.so.6 => /lib/libc.so.6 (0x00231000) libpthread.so.0 => /lib/libpthread.so.0 (0x00a820
Re: [Dovecot] Log sybnch error
Sorry. I wasn't clear. The message did repeat for the same mailbox. eg Mar 5 09:41:40 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=42304 for /home/scldad/Mail/Mail/.imap/Trash/dovecot.index: Extension header update points outside header size Mar 5 09:41:44 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=42392 for /home/scldad/Mail/Mail/.imap/Trash/dovecot.index: Extension header update points outside header size Mar 5 09:42:58 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=42480 for /home/scldad/Mail/Mail/.imap/Trash/dovecot.index: Extension header update points outside header size Mar 5 09:42:58 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=11864 for /home/scldad/Mail/Mail/.imap/Drafts/dovecot.index: Extension header update points outside header size Mar 5 09:42:58 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=11864 for /home/scldad/Mail/Mail/.imap/Templates/dovecot.index: Extension header update points outside header size Mar 5 09:42:58 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=12964 for /home/scldad/Mail/Mail/.imap/Sent/dovecot.index: Extension header update points outside header size Mar 5 09:42:58 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=42568 for /home/scldad/Mail/Mail/.imap/Trash/dovecot.index: Extension header update points outside header size Mar 5 09:42:58 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=11864 for /home/scldad/Mail/Mail/.imap/Junk/dovecot.index: Extension header update points outside header size Mar 5 09:42:58 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=11864 for /home/scldad/Mail/Mail/.imap/Outbox/dovecot.index: Extension header update points outside header size Mar 5 09:42:58 server dovecot: imap(scldad): Error: Log synchronization error at seq=2,offset=60240 for /home/scldad/Mail/Mail/.imap/storage1/dovecot.index: Extension header update points outside header size I have deleted the .imap directories and the message seems to have disappeared. Cheers and thanks, Stephen On Sun, 4 Mar 2012 11:05:18 PM Timo Sirainen wrote: > On 3.3.2012, at 1.45, Stephen Davies wrote: > > No NFS. The file system is local. > > > > Yes. There are multiple copies of the message for multiple mailboxes for > > each of at least two users. > > But does the error keep repeating for the same mailbox? It's supposed to > fix itself automatically after logging the error once. > > > Yes. Did recently upgrade from 1.2.15. > > I think in earlier versions mbox used somewhat different index file > structures and now Dovecot logs some errors about them. > > Anyway, one sure way to fix this is to just delete all the .imap/ > directories. -- = Stephen Davies Consulting P/L Voice: 08-8177 1595 Adelaide, South Australia.Fax : 08-8177 0133 Records & Collections Management. Mobile:040 304 0583
Re: [Dovecot] testing fts-solr?
On 3/4/2012 4:47 PM, Patrick Ben Koetter wrote: > On 04.03.2012 23:29, Stan Hoeppner wrote: > > > >> not worth discussing seems a bit naive, or arrogant, or both. Given how >> long it takes, never in some cases, for Mozilla to fix IMAP related >> problems in TBird, you can't blame the OP for looking in other >> directions for a solution. Note the bug I filed 2+ years on broken IMAP >> custom header search: >> >> https://bugzilla.mozilla.org/show_bug.cgi?id=546925 >> >> 2 years later and it's not even been assigned to a dev... > > We started buying features/fixes. Does Mozilla have a page listing such services and prices, err, required/expected donation amounts? -- Stan
Re: [Dovecot] testing fts-solr?
On 04.03.2012 23:29, Stan Hoeppner wrote: > not worth discussing seems a bit naive, or arrogant, or both. Given how > long it takes, never in some cases, for Mozilla to fix IMAP related > problems in TBird, you can't blame the OP for looking in other > directions for a solution. Note the bug I filed 2+ years on broken IMAP > custom header search: > > https://bugzilla.mozilla.org/show_bug.cgi?id=546925 > > 2 years later and it's not even been assigned to a dev... We started buying features/fixes. p@rick -- state of mind () http://www.state-of-mind.de Franziskanerstraße 15 Telefon +49 89 3090 4664 81669 München Telefax +49 89 3090 4666 Amtsgericht MünchenPartnerschaftsregister PR 563 smime.p7s Description: S/MIME Cryptographic Signature
Re: [Dovecot] testing fts-solr?
On 3/4/2012 11:39 AM, Bradley Giesbrecht wrote: > It has been demonstrated that dovecot+fts is working properly and that this > not a dovecot issue. Most software contains workarounds to bugs/misfeatures in other vendors' programs. Dovecot already has many: NFS: mmap_disable = no mail_nfs_index = no Workarounds for various client bugs: delay-newmail: netscape-eoh: tb-extra-mailbox-sep: To state that a problem in other software that interacts with Dovecot is not worth discussing seems a bit naive, or arrogant, or both. Given how long it takes, never in some cases, for Mozilla to fix IMAP related problems in TBird, you can't blame the OP for looking in other directions for a solution. Note the bug I filed 2+ years on broken IMAP custom header search: https://bugzilla.mozilla.org/show_bug.cgi?id=546925 2 years later and it's not even been assigned to a dev... -- Stan
Re: [Dovecot] dsync replication available for testing
Hi --
On 04.03.2012, at 12:38, Timo Sirainen wrote:
> On 4.3.2012, at 13.34, Michael Grimm wrote:
>> On 04.03.2012, at 11:44, Timo Sirainen wrote:
>>> In dovecot-2.1 hg you can now test dsync-based replication.
>>
>> Great news. I would love to test it, if I will be able to run this on a test
>> account, only. All other users should become synced the "old way" for the
>> time
>> being.
>>
>> Would that be possible with the current implementation?
>
> 1) Replicator syncs all users at startup. If you can change your userdb
> iteration
>to return only one test user for replicator that avoids it. (You may be
> able to
>do protocol replicator { userdb {..} } and protocol !replicator { .. })
>
> 2) You can enable replication plugin only for one user by changing
> mail_plugins
>setting via userdb extra fields.
>
> Anyway, replicator simply runs doveadm, so there's not much that can go
> wrong. So
> you could even ignore 1) and just let it sync everyone at startup.
Does that mean that the new functionality (queue) does only run dsync
replication
the usual way whenever new mail arrives? That's at least what I read in your
code
committed today (but I'm not that good in reading code I do have to confess).
If you could approve my assumption, I'm willing to give it a try to all users.
Regards,
Michael
Re: [Dovecot] testing fts-solr?
On 2012-03-04 11:59 AM, Christian Roessner wrote: you will see that it uses solr. So from my point of view it would be a Thunderbird thing. As I said, I would like confirmation *from the OP* about his last comment that his problem with Thunderbird was actually fixed by fixing whatever 'third party init script who was the problem'... ok One other thing I neglected to mention - I'll probably use fts+lucene, since it appears to be simpler (is a plugin and only requires clucene as a dependency)... Next is to push for full support in Thunderbird for a per account config option to simply run all searches on the server Should only be enabled for an account the server for which support fts search indexes): https://bugzilla.mozilla.org/show_bug.cgi?id=564168 -- Best regards, Charles
Re: [Dovecot] testing fts-solr?
On Mar 4, 2012, at 7:57 AM, Charles Marcus wrote: > On 2012-03-03 4:16 PM, Bradley Giesbrecht wrote: >> On Mar 3, 2012, at 12:14 PM, Charles Marcus wrote: >>> On 2012-03-02 5:13 PM, Robin wrote: This mailing list is for dovecot, not Thunderbird support. The lack of replies to Thunderbird usage questions no doubt reflects this. > >>> What precisely about a possible bug with *any* IMAP client when >>> using dovecot+fts makes you think that this is not on topic for the >>> dovecot list? > >> Show dovecot misbehaving. > > The OP showed where *something* was misbehaving - maybe you should read an > entire thread before jumping in? I have been reading this thread from the beginning. You asked the question: On Mar 3, 2012, at 12:14 PM, Charles Marcus wrote: > What precisely about a possible bug with *any* IMAP client when using > dovecot+fts makes you think that this is not on topic for the dovecot list? It has been demonstrated that dovecot+fts is working properly and that this not a dovecot issue. At what point should this issue be taken to a Thunderbird support venue? I will butt out now.
Re: [Dovecot] testing fts-solr?
>>> > >> well as I wrote in the mini-tutorial, if you use roundcube search, > > ? First post from you in this thread, much less a reference to some > mini-tutorial you wrote This: http://www.roessner-network-solutions.com/2012/02/19/full-text-search-with-solr-and-dovecot-on-ubuntu-10-04/ is from my blog ;) > >> you will see that it uses solr. So from my point of view it would be >> a Thunderbird thing. > > As I said, I would like confirmation *from the OP* about his last comment > that his problem with Thunderbird was actually fixed by fixing whatever > 'third party init script who was the problem'... > ok -Christian --- Roessner-Network-Solutions Bachelor of Science Informatik Nahrungsberg 81, 35390 Gießen F: +49 641 5879091, M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com
Re: [Dovecot] testing fts-solr?
On 2012-03-04 11:21 AM, Christian Roessner wrote: The OP showed where *something* was misbehaving - maybe you should read an entire thread before jumping in? The bottom line, though, until it can be determined that it *is* a Thunderbird bug, we won't know if it is a dovecot bug or not, will we? well as I wrote in the mini-tutorial, if you use roundcube search, ? First post from you in this thread, much less a reference to some mini-tutorial you wrote you will see that it uses solr. So from my point of view it would be a Thunderbird thing. As I said, I would like confirmation *from the OP* about his last comment that his problem with Thunderbird was actually fixed by fixing whatever 'third party init script who was the problem'... Looks like he isn't interested in replying (or has unsubbed from the list), so looks like there is no point in pursuing this at this point. I'll just have to wait until we get switched over to dovecot, and see if we have any problems with fts... -- Best regards, Charles
Re: [Dovecot] testing fts-solr?
> The OP showed where *something* was misbehaving - maybe you should read an > entire thread before jumping in? > > The bottom line, though, until it can be determined that it *is* a > Thunderbird bug, we won't know if it is a dovecot bug or not, will we? well as I wrote in the mini-tutorial, if you use roundcube search, you will see that it uses solr. So from my point of view it would be a Thunderbird thing. -Christian --- Roessner-Network-Solutions Bachelor of Science Informatik Nahrungsberg 81, 35390 Gießen F: +49 641 5879091, M: +49 176 93118939 USt-IdNr.: DE225643613 http://www.roessner-network-solutions.com
Re: [Dovecot] testing fts-solr?
On 2012-03-03 4:16 PM, Bradley Giesbrecht wrote: On Mar 3, 2012, at 12:14 PM, Charles Marcus wrote: On 2012-03-02 5:13 PM, Robin wrote: This mailing list is for dovecot, not Thunderbird support. The lack of replies to Thunderbird usage questions no doubt reflects this. What precisely about a possible bug with *any* IMAP client when using dovecot+fts makes you think that this is not on topic for the dovecot list? Show dovecot misbehaving. The OP showed where *something* was misbehaving - maybe you should read an entire thread before jumping in? The bottom line, though, until it can be determined that it *is* a Thunderbird bug, we won't know if it is a dovecot bug or not, will we? -- Best regards, Charles
Re: [Dovecot] doveconf: Warning: Obsolete settings.... in /etc/dovecot/dovecot.conf: ...
On 2012-03-04 7:36 AM, Timo Sirainen wrote: So, doveconf -n> dovecot-new.conf mv dovecot-new.conf /etc/dovecot/dovecot.conf That should do it. One suggestion... since 'doveconf -n' is sort of a clone of 'postconf -n', maybe it would be a good idea to clone the postfix way for upgrading the configuration file as well? Postfix does it as: postfix upgrade-configuration Man page details for options are here: http://www.postfix.org/postfix.1.html I hate to keep suggesting that you 'copy' anyone or anything, but if you *are*, I think postfix is one of the ones you'd want to emulate... ;) Just a thought... it would be more intuitive for those of us who use postfix with dovecot (and I think there are a lot)... -- Best regards, Charles
Re: [Dovecot] Another hint from the clue box 8-) imapc/imap proxy user mailbox server location
On 4.3.2012, at 16.48, Terry Carmen wrote: >> pass_attrs = ..., \ >> msExchHomeServerName=userdb_imapc_host=%49.100$.example.com >> >> If the prefix differs, but all of the exchange server names have the same >> length, for example 10, you can also do: >> >> pass_attrs = ..., \ >> msExchHomeServerName=userdb_imapc_host=%-10$.example.com >> There's no otherwise nice way to parse this string. > > > If by prefix, you mean the "/O=example/OU=INT/cn=Configuration/cn=Servers/" > part, then, yes, they're different. OK, so if the prefix or suffix isn't always the same length you can't do the above. > I could export the data to a text file as username:homeexchangeserver (or > whatever other format is needed). > > homeservers.txt: > user1:exch1.example.com > user2:exch1.example.com > user3:exch1.example.com > user4:exch2.example.com > > Is it possible to do a lookup in a text file to get this? If you can use userdb passwd-file and export the data to that file, it'll work. http://wiki2.dovecot.org/AuthDatabase/PasswdFile Example line: user1::1000:1000::/home/user::userdb_imapc_host=exch1.example.com Note that you can't then return any userdb fields from passdb ldap lookup.
Re: [Dovecot] Another hint from the clue box 8-) imapc/imap proxy user mailbox server location
- Message from Timo Sirainen - Date: Sun, 4 Mar 2012 14:45:48 +0200 From: Timo Sirainen Subject: Re: [Dovecot] Another hint from the clue box 8-) imapc/imap proxy user mailbox server location To: Terry Carmen Cc: dovecot@dovecot.org On 2.3.2012, at 0.35, Terry Carmen wrote: With the exchange server being returned in the msExchHomeServerName property as: /O=example/OU=INT/cn=Configuration/cn=Servers/cn=exchangeservername I believe this should somehow end up in the userdb section, which currently contains "driver = prefetch", but can't seem to figure out specifically what should be there. .. > The only important part is "cn=exchangeservername", which is the machine name and would need to be prepended to example.com to get the fqdn. Do all of the values have the same prefix? Then I guess you can do: pass_attrs = ..., \ msExchHomeServerName=userdb_imapc_host=%49.100$.example.com If the prefix differs, but all of the exchange server names have the same length, for example 10, you can also do: pass_attrs = ..., \ msExchHomeServerName=userdb_imapc_host=%-10$.example.com There's no otherwise nice way to parse this string. If by prefix, you mean the "/O=example/OU=INT/cn=Configuration/cn=Servers/" part, then, yes, they're different. I could export the data to a text file as username:homeexchangeserver (or whatever other format is needed). homeservers.txt: user1:exch1.example.com user2:exch1.example.com user3:exch1.example.com user4:exch2.example.com Is it possible to do a lookup in a text file to get this? Terry
Re: [Dovecot] 2.1: Error: Maildir filename has wrong S value, renamed the file from
On 2.3.2012, at 12.43, Ralf Hildebrandt wrote: >> Alternatively you can just tell Dovecot not to care about it: >> maildir_broken_filename_sizes=yes. Although you probably can't do that if >> you have compressed mails. > > In the case above that mail was gzipped twice :( Yes, looks like Dovecot can't correctly fix the wrong S size for gzipped mails. I don't know if I should bother fixing it, especially since in your case the doubly-gzipped mails will look corrupted to user..
Re: [Dovecot] [PATCH] Pop3 order in courier migration script
On 27.2.2012, at 9.23, Christoph Bußenius wrote: > I found a problem in the courier conversion script > (courier-dovecot-migrate.pl). In some cases, it does not correctly preserve > the order of POP3 UIDLs. Thanks, updated. BTW. The script should some day be updated for Dovecot v2.0.13+ which supports storing separate POP3 and IMAP message order.
Re: [Dovecot] migrating/converting from system users -> virtual users
On 28.2.2012, at 19.45, Steve Platt wrote: > Most of this is working but I'm stuck on how to convert users' mail folders > from the existing setup to the new one. I'm using the convert plugin but of > course the problem is that the plugin executes as the "vmail" user and cannot > access the existing mail folders that belong to the users: and I'd be worried > if it could, of course! Convert plugin also has some other problems. > I have the idea that I should be able to run some command (as a privileged > user) on the mail server and have it do the conversion for me, changing the > ownership/permissions on the way. > > Can convert-tool do this? Possibly, but I remember it had some problems. The best solution would be to use Dovecot v2.0's dsync. Also you can use one of the scripts in http://wiki2.dovecot.org/Migration/MailFormat such as mb2md. > I'd prefer to go with the automatic (plugin) conversion if I can bodge the > ownership issues somehow. Failing that, some tool or script may be the next > best answer. You could set mail_drop_priv_before_exec=yes, mail_access_groups=vmail and chgrp vmail, chmod g+rw the old mailboxes.
Re: [Dovecot] Dovecot 2.1 with custom OpenSSL fails to build
On 29.2.2012, at 3.03, Andreas M. Kirchwitz wrote: > Timo Sirainen wrote: > >>> There seems to be a new dependency in some modules (eg, lib-storage, >>> libdovecot-lda, libdovecot-ssl) on OpenSSL. In Dovecot 2.0, those >>> modules didn't require OpenSSL, but 2.1 does. >>> >>> For the linking process the path to the OpenSSL library isn't >>> specified properly (SSL_LIBS). Dovecot fails to build if OpenSSL >>> is in a non-standard path. (Haven't checked if SSL_CFLAGS isn't >>> properly used as well.) >> >> Maybe http://hg.dovecot.org/dovecot-2.1/rev/c07415305d9e fixes >> everything? > > That's the way to go. Makes things better, but I've found three more > dependencies. This patch is against the daily snapshot 20120228. > (Sorry for the changes to Makefile.in which you won't need. But this way > I don't have to rebuild Makefile.in from Makefile.am when compiling. ;-) The SSL libraries shouldn't be linked when imapc isn't built. Also it probably wouldn't have built with you if you used configure --without-shared-libs. I did a bit large change that hopefully fixes everything: http://hg.dovecot.org/dovecot-2.1/rev/e540404debb7
Re: [Dovecot] doveadm -A stops processing at first uid
On 1.3.2012, at 10.44, Joseph Tam wrote: > but any doveadm command that uses "-A" to iterate through all users will > stop processing at the first account with UID > doveadm(sysdaemon): Error: user sysdaemon: Couldn't drop > privileges: Mail access for users with GID 5551 not permitted > (see first_valid_gid in config file, gid from userdb lookup). > doveadm(sysdaemon): Error: User init failed > doveadm: Error: Failed to iterate through some users And one more thing: Does it really even stop there? Looking at the code it's supposed to log an error and continue to next user. Note that it says "Failed to iterate through SOME users".
Re: [Dovecot] doveadm -A stops processing at first uid
On 1.3.2012, at 10.44, Joseph Tam wrote: > doveadm(sysdaemon): Error: user sysdaemon: Couldn't drop > privileges: Mail access for users with GID 5551 not permitted > (see first_valid_gid in config file, gid from userdb lookup). Oh, it says about first_valid_gid. Is sysdaemon's UID within valid range? I also added this today: http://hg.dovecot.org/dovecot-2.1/rev/85a8d582d37f
Re: [Dovecot] doveadm -A stops processing at first uid
On 1.3.2012, at 10.44, Joseph Tam wrote: > I would like to run various doveadm commands that involves all (mail) users > like > > doveadm expunge -A mailbox Trash savedbefore 30d > > but any doveadm command that uses "-A" to iterate through all users will > stop processing at the first account with UID > doveadm(sysdaemon): Error: user sysdaemon: Couldn't drop > privileges: Mail access for users with GID 5551 not permitted > (see first_valid_gid in config file, gid from userdb lookup). > doveadm(sysdaemon): Error: User init failed > doveadm: Error: Failed to iterate through some users > > However, these accounts are system accounts (locked password, no shell) > and are in userdb to provide UID<->name mapping for utilities like ls, > chown, etc. What userdb are you using? userdb passwd should already skip users that aren't in the valid range. And what Dovecot version are you using?
Re: [Dovecot] Another hint from the clue box 8-) imapc/imap proxy user mailbox server location
On 2.3.2012, at 0.35, Terry Carmen wrote: > With the exchange server being returned in the msExchHomeServerName property > as: > > /O=example/OU=INT/cn=Configuration/cn=Servers/cn=exchangeservername > > I believe this should somehow end up in the userdb section, which currently > contains "driver = prefetch", but can't seem to figure out specifically what > should be there. .. > The only important part is "cn=exchangeservername", which is the machine name > and would need to be prepended to example.com to get the fqdn. Do all of the values have the same prefix? Then I guess you can do: pass_attrs = ..., \ msExchHomeServerName=userdb_imapc_host=%49.100$.example.com If the prefix differs, but all of the exchange server names have the same length, for example 10, you can also do: pass_attrs = ..., \ msExchHomeServerName=userdb_imapc_host=%-10$.example.com There's no otherwise nice way to parse this string.
Re: [Dovecot] Multiple namespaces seems to be used at the same time
On 1.3.2012, at 16.16, Steve Campbell wrote: > I've just converted from an old Centos 3 box to a Centos 6.2 box. I've > switched from UW-imap to dovecot in the process. In my configurations, I've > placed the multiple namespace sections as suggested by the "Backward > compatability" part of the wiki. I use mbox since I mostly copied the home > directories from the old to the new server. > > On some of the clients, it appears that the client is using multiple > namespaces at the same time. When they view their subscribed folders, they > see multiple "mail" folders instead of just the single "mail" folder under > their home directory. > > The .subscription files are more than likely not correct (haven't looked yet, > but will fix them as a user calls), but should this ever happen? I'm also > sure the client's prefix isn't set since the old system never required it and > there are just so many other things that are required right now on this > conversion. Difficult to say without knowing 1) doveconf -n output and 2) .subscriptions file contents. > Speaking of prefixes, I'd like to get the default of "" (nothing entered) to > work for the majority of the users to avoid having to add this to the > multiple users we have. Hopefully, by going through each user's home > directory and copying the old .mailboxlist to a new .subscriptions file and > ensuring the imap folders are in ~/mail will do this. Does this sound > resonable? Yes, assuming you have: mail_location = mbox:~/mail (with maybe the :INBOX=/var/mail/%u) Also the .subscriptions needs to be in ~/mail/ then.
Re: [Dovecot] doveconf: Warning: Obsolete settings.... in /etc/dovecot/dovecot.conf: ...
On 4.3.2012, at 8.25, D Chen wrote: > Got duplicated Warnings from the "doveconf -n" output ! Can anyone explain > and fix them ? thx! v2.0 has different configuration from v1.x, you need to migrate the configuration the way it says: > doveconf: Warning: NOTE: You can get a new clean config file with: > doveconf -n > dovecot-new.conf So, doveconf -n > dovecot-new.conf mv dovecot-new.conf /etc/dovecot/dovecot.conf That should do it.
Re: [Dovecot] Log sybnch error
On 3.3.2012, at 1.45, Stephen Davies wrote: > No NFS. The file system is local. > > Yes. There are multiple copies of the message for multiple mailboxes for each > of at least two users. But does the error keep repeating for the same mailbox? It's supposed to fix itself automatically after logging the error once. > Yes. Did recently upgrade from 1.2.15. I think in earlier versions mbox used somewhat different index file structures and now Dovecot logs some errors about them. Anyway, one sure way to fix this is to just delete all the .imap/ directories.
Re: [Dovecot] doveadm fetch prints duplicate results in 2.1
On 3.3.2012, at 14.33, Christoph Bußenius wrote: > On 02/29/2012 10:31 AM, Christoph Bußenius wrote: >> when the private namespace has "prefix = INBOX." and you use doveadm >> fetch to search for "mailbox INBOX", then it prints every message twice: > > Apparently the bug has been introduced with this changeset: > > changeset: 14112:f5353573d3a0 > user:Timo Sirainen > date:Sun Feb 12 02:50:49 2012 +0200 > summary: lib-storage: Added MAILBOX_LIST_ITER_LIST_PREFIXES flag. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/bbe6b6c2ee99
Re: [Dovecot] 2.1.1: Incorrect quoting of RFC 2822 personal parts in ENVELOPE data
On 3.3.2012, at 2.48, Michael M Slusarz wrote:
> I'm seeing this:
>
> 1 UID FETCH 31734 (ENVELOPE)
> * 23 FETCH (UID 31734 ENVELOPE ("Fri, 2 Mar 2012 19:05:24 -0500 (EST)"
> "XX" (({22}
> X \"X-XX\" XX NIL "XXX" "X.XXX")) (({22}
> X \"X-XX\" XX NIL "XXX" "X.XX.XXX")) ((NIL NIL
> "XXX" "X.XXX")) ((NIL NIL "slusarz" "curecanti.org")) NIL NIL NIL
> "<1109380587237.1109118788902.20323.7.35190001@scheduler>"))
>
> It should be:
>
> 1 UID FETCH 31734 (ENVELOPE)
> * 23 FETCH (UID 31734 ENVELOPE ("Fri, 2 Mar 2012 19:05:24 -0500 (EST)"
> "XX" (({20}
> X "X-XX" XX NIL "XXX" "X.XXX")) (({20}
> X "X-XX" XX NIL "XXX" "X.XX.XXX")) ((NIL NIL
> "XXX" "X.XXX")) ((NIL NIL "slusarz" "curecanti.org")) NIL NIL NIL
> "<1109380587237.1109118788902.20323.7.35190001@scheduler>"))
>
> since the RFC 2822 quoting characters must be removed.
Oops. This has been buggy forever. Added the fix to all Dovecot hg trees.
Re: [Dovecot] Failing: doveadm sync <--remote host--> dsync mirror
On 4.3.2012, at 13.41, Michael Grimm wrote: >> By "undeletable" do you mean you have mails that always come back after >> expunging them? > > Yes. Deleting by the client will return them after the next dsync run. > >> I'd like to get dovecot.index and dovecot.index.log files from those >> mailboxes from both servers, they >> don't contain any sensitive information. > > From all mailboxes? I can do that if you wish. But that will need some time > (tomorrow). Just one mailbox where that consistently happens is enough: 1. Expunge the mail 2. Get a copy of the dbox-Mails/dovecot.index, dbox-Mails/dovecot.index.log and dbox-Mails/dovecot.index.log.2 from both servers 3. Run dsync, and verify that the message is undeleted 4. Get another copy of the indexes from both servers
Re: [Dovecot] Failing: doveadm sync <--remote host--> dsync mirror
Hi --
On 04.03.2012, at 12:35, Timo Sirainen wrote:
> On 4.3.2012, at 13.31, Michael Grimm wrote:
>> That doesn't work in my ssh setup, because I'm using a different ssh port
>> and thus have to run:
>>
>> ssh -p 1234 vm...@remote-host.tld
>>
>> Sorry, I should have mentioned that before.
>>
>> In your other mail about 'dsync replication' you refer to a config option:
>> #dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u
>> -l%{lock_timeout} -n%{namespace}
>>
>> Would that allow for ssh options to be set?
>
> Yes.
Good news.
Now, I will stick to 2.1.x because syncing is done without loss of mails
(after 10 days of testing).
The only inconvenience remaining is reappearing of deleted and
"undeletable" mail. But it seems that
I'm the only one reporting that. How could I help to debug this issue?
>>>
>>> Is anything else besides Dovecot modifying the mailboxes? Especially
>>> deleting mails? No cronjobs or
>>> other scripts that "rm" mails?
>>
>> No. Only dovecot is allowed to deliver mail (lmtp). Sieve's 'copy:' and
>> 'fileinto' are used as well.
>> But no scripts or such are used to remove mail. I'm running mdbox only.
>
> By "undeletable" do you mean you have mails that always come back after
> expunging them?
Yes. Deleting by the client will return them after the next dsync run.
> I'd like to get dovecot.index and dovecot.index.log files from those
> mailboxes from both servers, they
> don't contain any sensitive information.
From all mailboxes? I can do that if you wish. But that will need some time
(tomorrow).
Thanks and regards,
Michael
Re: [Dovecot] dsync replication available for testing
On 4.3.2012, at 13.34, Michael Grimm wrote:
> On 04.03.2012, at 11:44, Timo Sirainen wrote:
>
>> In dovecot-2.1 hg you can now test dsync-based replication.
>
> Great news. I would love to test it, if I will be able to run this on a test
> account, only. All other users should become synced the "old way" for the
> time
> being.
>
> Would that be possible with the current implementation?
1) Replicator syncs all users at startup. If you can change your userdb
iteration to return only one test user for replicator that avoids it. (You may
be able to do protocol replicator { userdb {..} } and protocol !replicator { ..
})
2) You can enable replication plugin only for one user by changing mail_plugins
setting via userdb extra fields.
Anyway, replicator simply runs doveadm, so there's not much that can go wrong.
So you could even ignore 1) and just let it sync everyone at startup.
Re: [Dovecot] Failing: doveadm sync <--remote host--> dsync mirror
On 4.3.2012, at 13.31, Michael Grimm wrote:
> That doesn't work in my ssh setup, because I'm using a different ssh port and
> thus have to run:
>
> ssh -p 1234 vm...@remote-host.tld
>
> Sorry, I should have mentioned that before.
>
> In your other mail about 'dsync replication' you refer to a config option:
> #dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u
> -l%{lock_timeout} -n%{namespace}
>
> Would that allow for ssh options to be set?
Yes.
>> doveadm sync -f -u test remote:vmail@host
>
> See above regarding ssh options.
So this works by changing the dsync_remote_cmd.
>>> Now, I will stick to 2.1.x because syncing is done without loss of mails
>>> (after 10 days of testing).
>>> The only inconvenience remaining is reappearing of deleted and
>>> "undeletable" mail. But it seems that
>>> I'm the only one reporting that. How could I help to debug this issue?
>>
>> Is anything else besides Dovecot modifying the mailboxes? Especially
>> deleting mails? No cronjobs or
>> other scripts that "rm" mails?
>
> No. Only dovecot is allowed to deliver mail (lmtp). Sieve's 'copy:' and
> 'fileinto' are used as well.
> But no scripts or such are used to remove mail. I'm running mdbox only.
By "undeletable" do you mean you have mails that always come back after
expunging them? I'd like to get dovecot.index and dovecot.index.log files from
those mailboxes from both servers, they don't contain any sensitive information.
Re: [Dovecot] dsync replication available for testing
Hi -- On 04.03.2012, at 11:44, Timo Sirainen wrote: > In dovecot-2.1 hg you can now test dsync-based replication. Great news. I would love to test it, if I will be able to run this on a test account, only. All other users should become synced the "old way" for the time being. Would that be possible with the current implementation? Regards, Michael
Re: [Dovecot] Failing: doveadm sync <--remote host--> dsync mirror
Hi --
On 04.03.2012, at 12:05, Timo Sirainen wrote:
> On 3.3.2012, at 20.03, Michael Grimm wrote:
>> vmail> dsync -v -f -u test mirror ssh vm...@remote-host.tld dsync -v -f
>> -u test
>> dsync-local(test): Error: remote: dsync: illegal option -- f
>> doveadm dsync-server [-u |-A] [-S ]
>> dsync-local(test): Error: read() from worker server failed: EOF
>>
>> If I do omit the remote '-f' the old syntax is being accepted. Thanks for
>> fixing that.
>
> Right, the remote -f parameter doesn't do anything. But it's anyway now
> allowed:
> http://hg.dovecot.org/dovecot-2.1/rev/9c6eeeb810c0
Ok, that means it has always been ignored in 2.0.x ;-)
>>> doveadm sync -f -u test t...@remote-host.tld
>>
>> vmail> doveadm sync -f -u test ssh vm...@remote-host.tld
>> dsync-local(test): Error: remote: dsync-server: Command not found.
>> dsync-local(test): Error: read() from worker server failed: EOF
>
> Remove the "ssh" parameter from the middle and change vmail@ to test@
That doesn't work in my ssh setup, because I'm using a different ssh port and
thus have to run:
ssh -p 1234 vm...@remote-host.tld
Sorry, I should have mentioned that before.
In your other mail about 'dsync replication' you refer to a config option:
#dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u
-l%{lock_timeout} -n%{namespace}
Would that allow for ssh options to be set?
>> Users are virtual ones at both mail servers, and vmail is the only system
>> user to run ssh.
>> Thus I can't test user suggestion. But it's ok to add a 'doveadm
>> dsync-server -u test'.
>
> In this syntax the test@ means Dovecot user, not system user. Although I'm
> not sure if that's
> a good idea. In the latest hg version the preferred way is:
>
> doveadm sync -f -u test remote:vmail@host
See above regarding ssh options.
>> Now, I will stick to 2.1.x because syncing is done without loss of mails
>> (after 10 days of testing).
>> The only inconvenience remaining is reappearing of deleted and "undeletable"
>> mail. But it seems that
>> I'm the only one reporting that. How could I help to debug this issue?
>
> Is anything else besides Dovecot modifying the mailboxes? Especially deleting
> mails? No cronjobs or
> other scripts that "rm" mails?
No. Only dovecot is allowed to deliver mail (lmtp). Sieve's 'copy:' and
'fileinto' are used as well.
But no scripts or such are used to remove mail. I'm running mdbox only.
Thanks and regards,
Michael
Re: [Dovecot] LIST-STATUS issue
On 3.3.2012, at 3.48, Michael M Slusarz wrote: > I can now verify that QRESYNC is triggering this behavior. Fixed: http://hg.dovecot.org/dovecot-2.1/rev/8cbc130c2b72 http://hg.dovecot.org/dovecot-2.1/rev/31ae11fe18b2
Re: [Dovecot] directly addressable public folders issues
On 3.3.2012, at 22.08, Tom Fernandes wrote:
> I would like to have an address i...@example.com whose mails are stored in a
> public folder.
..
> From what I understand it's a good idea to have a separate location for home
> and
> for mail_location.
>
> For my normal accounts I have:
> home = /var/vmail/
> mail_location = ~/Maildir
mail_location = maildir:~/Maildir
to unnecessary avoid autodetection.
> Is there a way to have the same for public folders? This are my current
> settings:
>
> namespace public {
> separator = /
> prefix = public/
> location = maildir:/var/vmail/public
> subscriptions = no
> }
That's ok.
> user_attrs = homeDirectory=home=/var/vmail/%$, =mail=maildir:~/Maildir
The "mail" isn't necessary here, since it's already globally set.
> The LDAP-homeDirectory-attribute for i...@example.com is "public/.info"
That's not going to work too well.
> Like this an incoming mail is stored below /var/vmail/public/.info/Maildir
> which
> is good. The MUA seems to read to read from /var/vmail/public/.info though.
>
> How can I make the MUA read from /var/vmail/public/.info/Maildir instead?
You can't.
> And in case this works - is it possible to have only certain users modify the
> sieve-rule for this public folder or do I definitely need a passdb-entry for
> i...@example.com?
> Modifying scripts via commandline is not an option...
The way I did it was to make info@, sales@ and others aliases to "company"
user, which is a rather regular user (except can't actually log in). For this
"company" user I've a Sieve script that puts the mails into the proper mailbox,
e.g. fileinto "public/info".
Re: [Dovecot] Failing: doveadm sync <--remote host--> dsync mirror
On 3.3.2012, at 20.03, Michael Grimm wrote: > vmail> dsync -v -f -u test mirror ssh vm...@remote-host.tld dsync -v -f > -u test > dsync-local(test): Error: remote: dsync: illegal option -- f > doveadm dsync-server [-u |-A] [-S ] > dsync-local(test): Error: read() from worker server failed: EOF > > If I do omit the remote '-f' the old syntax is being accepted. Thanks for > fixing that. Right, the remote -f parameter doesn't do anything. But it's anyway now allowed: http://hg.dovecot.org/dovecot-2.1/rev/9c6eeeb810c0 >> doveadm sync -f -u test t...@remote-host.tld > > vmail> doveadm sync -f -u test ssh vm...@remote-host.tld > dsync-local(test): Error: remote: dsync-server: Command not found. > dsync-local(test): Error: read() from worker server failed: EOF Remove the "ssh" parameter from the middle and change vmail@ to test@ > Users are virtual ones at both mail servers, and vmail is the only system > user to run ssh. Thus I > can't test user suggestion. But it's ok to add a 'doveadm dsync-server -u > test'. In this syntax the test@ means Dovecot user, not system user. Although I'm not sure if that's a good idea. In the latest hg version the preferred way is: doveadm sync -f -u test remote:vmail@host It automatically adds the remote -u test. > Now, I will stick to 2.1.x because syncing is done without loss of mails > (after 10 days of testing). > The only inconvenience remaining is reappearing of deleted and "undeletable" > mail. But it seems that > I'm the only one reporting that. How could I help to debug this issue? Is anything else besides Dovecot modifying the mailboxes? Especially deleting mails? No cronjobs or other scripts that "rm" mails?
[Dovecot] dsync replication available for testing
In dovecot-2.1 hg you can now test dsync-based replication. Everything
isn't finished yet, but it appears to work and I've enabled it for my
@dovecot.fi mails. Some issues:
- public namespace isn't replicated at all
- shared namespace is replicated, but not private mail flags
- I've only tested SSH replication setup now, not director replication
setup (and director setup is still missing many things)
- SSH replication setup uses aggregator process, which isn't really
necessary and can probably be avoided in future
Below is a configuration for virtual user setup. System user
configuration works pretty much the same, except doveadm/ssh is run as root.
Try first that dsync works successfully with ssh in host1:
doveadm sync -u user@domain remote:vm...@host2.example.com
and also in host2:
doveadm sync -u user@domain remote:vm...@host1.example.com
--
mail_plugins = $mail_plugins notify replication
service aggregator {
# give enough permissions for mail processes
fifo_listener replication-notify-fifo {
user = vmail
mode = 0600
}
unix_listener replication-notify {
user = vmail
mode = 0600
}
}
service replicator {
# start replication at startup
process_min_avail = 1
}
plugin {
# host1 replicates to host2
mail_replica = remote:vm...@host2.example.com
# host2 replicates to host1
#mail_replica = remote:vm...@host1.example.com
}
#dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u
-l%{lock_timeout} -n%{namespace}
service doveadm {
# if you're using a single virtual user, set this to
# start ssh as vmail (not root)
user = vmail
}
