Re: [Dovecot] great disappearing email mystery

2009-02-14 Thread Charles Marcus
On 2/14/2009 9:59 AM, Maarten Bezemer wrote:
>>> I can see 1.1.9-1 in Experimental, but not even in Unstable yet.
>>> So I'm not ready to try it on production machines.

>> I could never use a distro that required me to use outdated/buggy 
>> software...

> So you prefer to use the new&shiny versions of the software that
> include all new&shiny bugs?

Please don't put words in my mouth. I said what I said, and meant it.

> Given my experience with a lot of software, that's just not an
> acceptable policy.

With software that is a fast moving target and bugs get squashed
quickly, it is the only sensible policy, imnsho.

Of course, as the old saying goes, if it ain't broke, don't fix it - and
this is NOT in contradiction to what I said earlier... I said I wouldn't
use a distro that REQUIRED me to use outdated/buggy s/w...

> in general, bleeding edge isn't the way to go.

For SYSTEM packages, I totally agree. But again, for software that is a
fast moving target, quick upgrades to latest versions THAT FIX BUGS
BEING ENCOUNTERED BY THE CURRENT VERSION is the only sensible thing to do.

> For production environments, I'm more than happy with Debian Stable plus
> backports versions of things like dovecot.

I prefer Gentoo due to its 'rolling release' nature (mine has been kept
up to date from day one for the last 5 years, with not one major glitch
- knock on wood). I keep the 'system' pinned at stable, and keyword the
fast moving packages to unstable... accomplishes the same thing, except
that most of the critical packages I use are updated to latest versions
within hours or days (with some irritating exceptions, like Samba), as
opposed to weeks or months like most other distros.

But to each his/her own...

-- 

Best regards,

Charles


Re: [Dovecot] Strange Dovecot Issue with 64-bit AMD Processor

2009-02-14 Thread Gene Steinberg
I'm at a disadvantage here.  I'm more of the end user than admin, but  
I cope.


But if someone wanted to assist me in maybe trying this again --  
perhaps with the latest stable version -- I'd be interested in another  
test.


Peace,
Gene

On Feb 14, 2009, at 11:30 AM, Jose Celestino  wrote:


Words by Gene Steinberg [Sat, Feb 14, 2009 at 02:58:06AM -0700]:


On Feb 14, 2009, at 12:24 AM, Frank Bonnet wrote:



Hello

Does the debug mode give something understandable ?




I've been reluctant to try this again, because this is a production
server. But my admin and cPanel support say they can't find any  
reason

for this.



Is kind of dificult to get to a conclusion of what the problem may be
without any further testing or any logs or traces. Do you have any lab
where you can test a more recent version on the same hardware ?

--
Jose Celestino | http://japc.uncovering.org/files/japc-pgpkey.asc

"One man’s theology is another man’s belly laugh." -- Robert A.  
Heinlein


Re: [Dovecot] Strange Dovecot Issue with 64-bit AMD Processor

2009-02-14 Thread Jose Celestino
Words by Gene Steinberg [Sat, Feb 14, 2009 at 02:58:06AM -0700]:
>
> On Feb 14, 2009, at 12:24 AM, Frank Bonnet wrote:
>
>>
>> Hello
>>
>> Does the debug mode give something understandable ?
>>
>
>
> I've been reluctant to try this again, because this is a production  
> server. But my admin and cPanel support say they can't find any reason  
> for this.
>

Is kind of dificult to get to a conclusion of what the problem may be
without any further testing or any logs or traces. Do you have any lab
where you can test a more recent version on the same hardware ?

-- 
Jose Celestino | http://japc.uncovering.org/files/japc-pgpkey.asc

"One man’s theology is another man’s belly laugh." -- Robert A. Heinlein


Re: [Dovecot] Expire failing with error Remote Disconnected

2009-02-14 Thread dovecot

At 11:13 AM 2/14/2009, Jeff Grossman wrote:
It is not based on the message date, it is based on the date those 
messages got moved into the expire folders.  You will have to wait 
14 days from the date they got moved into Spam or Trash.


AH. thank you!

rick





Jeff






Re: [Dovecot] Expire failing with error Remote Disconnected

2009-02-14 Thread Jeff Grossman

On 2/13/2009 11:39 PM, dove...@corwyn.net wrote:

At 06:22 PM 2/13/2009, Timo Sirainen wrote:

On Fri, 2009-02-13 at 17:54 -0500, dove...@corwyn.net wrote:
> When I delete that, now dovecot --exec-mail ext
> /usr/libexec/dovecot/expire-tool
> runs with no errors, no output, no anything.

The expire database is empty, so it has nothing to do. Expire plugin
updates the database while messages are being saved/copied to the expire
mailboxes.


So if I understand correctly (obviously not *sigh*) :-)

I have Trash and Spam defined as expire databases, I sent a number of 
messages, and then deleted them. They were then in Trash. I manually 
moved a bunch of messages to Spam as well. The Spam messages were > 14 
days old.


I then reran
dovecot --exec-mail ext  /usr/libexec/dovecot/expire-tool

I still get no events in /var/log/messages, and my Spam messages from 
Jan 22 are still there. On the bright side I do have an expire.db file 
now with data in it, tho I can't quite figure out what makes it update.


shouldn't the messages > 14 days old (the date I have set in.conf) go 
away?
It is not based on the message date, it is based on the date those 
messages got moved into the expire folders.  You will have to wait 14 
days from the date they got moved into Spam or Trash.


Jeff


Re: [Dovecot] great disappearing email mystery

2009-02-14 Thread Maarten Bezemer


On Fri, 13 Feb 2009, Charles Marcus wrote:


On 2/12/2009, Maarten Bezemer (mcbdove...@robuust.nl) wrote:

Strangest thing about this is that it only seems to happen when an
email is read first through webmail.


What were you using for webmail again?


Squirrelmail, using the same imap server as a back-end.
Nothing special happens to the emails in question. The mail store is 
Maildir++, and the message files don't change. They are moved from new/ to 
cur/, and the Seen flag is added, but that's something that happens all 
the time and works fine. Except for some strange cases, but I doubt that 
has anything to do with the Seen flag. Outlook seems to be seeing a 
Deleted flag which obviously isn't there.


Maarten


Re: [Dovecot] great disappearing email mystery

2009-02-14 Thread Maarten Bezemer


On Fri, 13 Feb 2009, Charles Marcus wrote:


On 2/12/2009, Maarten Bezemer (mcbdove...@robuust.nl) wrote:

I can see 1.1.9-1 in Experimental, but not even in Unstable yet. So
I'm not ready to try it on production machines.


I could never use a distro that required me to use outdated/buggy
software...


So you prefer to use the new&shiny versions of the software that include 
all new&shiny bugs? Given my experience with a lot of software, that's 
just not an acceptable policy. Not everything is as bad as Microsoft 
software, which usually needs at least Service Pack 1 to operate normally, 
but in general, bleeding edge isn't the way to go.


For production environments, I'm more than happy with Debian Stable plus 
backports versions of things like dovecot. That way I don't have to worry 
about upgrading every single package by hand when (not if) security 
updates have to be applied, and still have the advantage of running a 
close-to-bleeding-edge version of packages like dovecot. Without having to 
do much about it when new versions come out. If they prove to be good 
enough for unstable and testing, I can grab them and use them.




Re: [Dovecot] great disappearing email mystery

2009-02-14 Thread dhottinger

Quoting John and Catherine Allen :


dhottin...@harrisonburg.k12.va.us wrote:
Have there been any issues with dovecot and using outlook express   
(imap) as an email client?  I have had a couple of users come up   
with random missing emails.  Im trying to figure out if it is user   
error, or something wacky in my mailserver.   I cant find anything   
telling in maillog files or my messages.  Dovecot version is 1.0.3.  
  Its ok to reply to me, I get list messages digest.




Dwayne,

I've seen a lot of answers to your question which talked about Outlook,
not Outlook Express. As far as I know, Outlook Express is a completely
different piece of software.

I've been using Outlook Express and Thunderbird as IMAP clients for
years (more than 8 years in the case of Outlook Express) and hundreds
of thousands of emails, and there's never been any systematic problem
with either of these applications used as IMAP clients.

Occasional apparent "missing" emails were caused by:
- The local Outlook Express mail file getting out of sync with the
server. Fixed by using the button to "delete all headers and message
bodies" on the local file. But if your missing emails are also missing
on the server, then this is irrelevant.

- My email is retrieved using fetchmail and delivered to my mailserver
using exim. When moving the whole operation to a new server, there was
a glitch when some deliveries were accidentally made to the old server
which was still running.  The emails were not lost but they had to be
retrieved from the old server. As I see that you changed servers 2
years ago, is it possible that you have a similar issue?

- Spam filtering and other automated sorting: my Popfile system
occasionally puts emails into unexpected places. When in doubt, I check
the Popfile logs. But this is generally an issue for current emails.
Are your users running any kind of sorting or filtering tools?

I really can't see any way in which Dovecot could be involved in losing
emails from the mailserver.

John

--
John Allen
Bofferdange, Luxembourg
al...@vo.lu
http://allenlux.dyndns.org


Thanks for the information.  I totally agree with you in that dovecot  
couldnt be involved in any missing email.  I think the user either A.  
deleted the emails sometime ago and forgot or b. They didnt get moved  
over from the old mailserver when it crashed.   The user said that  
they should have emails from 2004, but I couldnt find any newer than  
Jan. 2007.  Also, none of the 'missing emails' were on my backup, and  
I get 5 days worth of backups of mail and home folders.


take care,

ddh

--
Dwayne Hottinger
Network Administrator
Harrisonburg City Public Schools

"Everything should be made as simple as possible, but not simpler."
-- Albert Einstein

"The hottest places in Hell are reserved for those who, in times of moral
crisis, preserved their neutrality."
-- Dante



Re: [Dovecot] Smooth mailbox to maildir migration

2009-02-14 Thread Dirk Essl

On 10.02.2009 16:49 Uhr, Luciano Mannucci wrote:

Hi all,


Hi,


I have a postfix+procmail+dovecot installation, now running basicaly
on pop3 hence mailbox format, with few thousand users and less than
twenty gigabytes mail.
I need to move all of them to maildir, to take advantage of IMAP
subfolders that do not work with mbox format (so I'm told :).
Of course I cannot safely stop the service for more than a bunch of
seconds...

What I'm about to do:

create a second dovecot instance to cope with imap client configured
for maildir (and possibly pop3 on another port for those using both),
which means a dovecot launched with -c /path/to/alternate.conf and a
new /etc/init.d/dovecot2-theRevenge having the proper -i option given
to startproc in order to make it ignore the other instance.

for each user:

convert the mailbox with some sort of mb2mb (which is the better one?)

create a .procmailrc with a proper DEFAULT= bearing the magic trailing
slash indicating maildir to procmail for each converted user.

And I'm done...

Have I forgotten something?
Is there a better way?


I do all migrations with perdition (imap proxy) It is very simpe to 
configure and rock solid. So you can make perdition listen on 110, 
dovecotA listens on 111 and dovecotB listens on 112. A text file tells 
who is on which server. With this setup you can even migrate into the 
same directory from mbox to maildir.



Any one else tryed such a thing?

Cheers to all,

luciano.


cheers,
dirk


Re: [Dovecot] great disappearing email mystery

2009-02-14 Thread John and Catherine Allen

dhottin...@harrisonburg.k12.va.us wrote:
Have there been any issues with dovecot and using outlook express (imap) 
as an email client?  I have had a couple of users come up with random 
missing emails.  Im trying to figure out if it is user error, or 
something wacky in my mailserver.   I cant find anything telling in 
maillog files or my messages.  Dovecot version is 1.0.3.  Its ok to 
reply to me, I get list messages digest.




Dwayne,

I've seen a lot of answers to your question which talked 
about Outlook, not Outlook Express. As far as I know, 
Outlook Express is a completely different piece of software.


I've been using Outlook Express and Thunderbird as IMAP 
clients for years (more than 8 years in the case of Outlook 
Express) and hundreds of thousands of emails, and there's 
never been any systematic problem with either of these 
applications used as IMAP clients.


Occasional apparent "missing" emails were caused by:
- The local Outlook Express mail file getting out of sync 
with the server. Fixed by using the button to "delete all 
headers and message bodies" on the local file. But if your 
missing emails are also missing on the server, then this is 
irrelevant.


- My email is retrieved using fetchmail and delivered to my 
mailserver using exim. When moving the whole operation to a 
new server, there was a glitch when some deliveries were 
accidentally made to the old server which was still running. 
 The emails were not lost but they had to be retrieved from 
the old server. As I see that you changed servers 2 years 
ago, is it possible that you have a similar issue?


- Spam filtering and other automated sorting: my Popfile 
system occasionally puts emails into unexpected places. When 
in doubt, I check the Popfile logs. But this is generally an 
issue for current emails. Are your users running any kind of 
sorting or filtering tools?


I really can't see any way in which Dovecot could be 
involved in losing emails from the mailserver.


John

--
John Allen
Bofferdange, Luxembourg
al...@vo.lu
http://allenlux.dyndns.org


Re: [Dovecot] Strange Dovecot Issue with 64-bit AMD Processor

2009-02-14 Thread Gene Steinberg


On Feb 14, 2009, at 12:24 AM, Frank Bonnet wrote:



Hello

Does the debug mode give something understandable ?




I've been reluctant to try this again, because this is a production  
server. But my admin and cPanel support say they can't find any reason  
for this.


Peace,
Gene


Re: [Dovecot] Expire failing with error Remote Disconnected

2009-02-14 Thread dovecot

At 06:22 PM 2/13/2009, Timo Sirainen wrote:

On Fri, 2009-02-13 at 17:54 -0500, dove...@corwyn.net wrote:
> When I delete that, now dovecot --exec-mail ext
> /usr/libexec/dovecot/expire-tool
> runs with no errors, no output, no anything.

The expire database is empty, so it has nothing to do. Expire plugin
updates the database while messages are being saved/copied to the expire
mailboxes.


So if I understand correctly (obviously not *sigh*) :-)

I have Trash and Spam defined as expire databases, I sent a number of 
messages, and then deleted them. They were then in Trash. I manually 
moved a bunch of messages to Spam as well. The Spam messages were > 
14 days old.


I then reran
dovecot --exec-mail ext  /usr/libexec/dovecot/expire-tool

I still get no events in /var/log/messages, and my Spam messages from 
Jan 22 are still there. On the bright side I do have an expire.db 
file now with data in it, tho I can't quite figure out what makes it update.


shouldn't the messages > 14 days old (the date I have set in.conf) go away?

Aha. So if I run it with --test I get
# dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool --test
Info: test...@example.com/Trash: stop, expire time in future: Sat Feb 
28 02:26:38 2009


That mean it's working? (and if so why are my messages from 1/22 
still there when I run it without --test?)


Thx!

Rick

As I've been tinkering with dovecot.conf, here's an updated copy:
# 1.1.8: /etc/dovecot.conf
# OS: Linux 2.6.18-92.el5 i686 Red Hat Enterprise Linux Server 
release 5.2 (Tikanga) ext3

ssl_cert_file: /etc/httpd/certs/example.com.crt
ssl_key_file: /etc/httpd/certs/example.com.key.no.password
login_dir: /var/run/dovecot/login
login_executable(default): /usr/libexec/dovecot/imap-login
login_executable(imap): /usr/libexec/dovecot/imap-login
login_executable(pop3): /usr/libexec/dovecot/pop3-login
mail_uid: 1015
mail_gid: 105
mail_location: maildir:/var/spool/mail/%d/%n/Maildir
mail_executable(default): /usr/libexec/dovecot/imap
mail_executable(imap): /usr/libexec/dovecot/imap
mail_executable(pop3): /usr/libexec/dovecot/pop3
mail_plugins(default): quota imap_quota expire trash
mail_plugins(imap): quota imap_quota expire trash
mail_plugins(pop3): quota
mail_plugin_dir(default): /usr/lib/dovecot/imap
mail_plugin_dir(imap): /usr/lib/dovecot/imap
mail_plugin_dir(pop3): /usr/lib/dovecot/pop3
imap_client_workarounds(default): delay-newmail outlook-idle
imap_client_workarounds(imap): delay-newmail outlook-idle
imap_client_workarounds(pop3):
pop3_client_workarounds(default):
pop3_client_workarounds(imap):
pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh
dict_db_config: /etc/dovecot-db.conf
auth default:
  mechanisms: plain login
  passdb:
driver: sql
args: /etc/dovecot-sql.conf
  userdb:
driver: passwd
  userdb:
driver: sql
args: /etc/dovecot-sql.conf
  userdb:
driver: static
  socket:
type: listen
client:
  path: /var/spool/postfix/private/auth
  mode: 432
  user: postfix
  group: postfix
master:
  path: /var/run/dovecot/auth-master
  mode: 384
  user: vuser
  group: vuser
plugin:
  quota: maildir
  quota_rule: *:storage=10240
  quota_rule2: Trash:storage=100M
  trash: /etc/dovecot-trash.conf
  expire: Trash 14 Trash/* 14 Spam 14
  expire_dict: proxy::expire
dict:
  expire: db:/var/lib/dovecot/expire.db