Re: [Dovecot] Sieve MySQL integration

2007-12-07 Thread Evaggelos Balaskas
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

 or just implement a webinterface that allows editing the values in the
 DB and afterwards dumps a new vacation script for the user to disk
 
 darix

+1 for the answer
my for personal use i do the same

Evaggelos Balaskas - http://ebalaskas.gr
Unix System Engineer
Informatics Engineer Technological Education
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFHWQwVWIK+Pe9twhoRAll4AKCy0eq3dbJMGdPCLSN6ikHUc+mZYwCdGg3Q
FkU/DXlTX0FKvDLDg6r0mY8=
=JXtk
-END PGP SIGNATURE-


Re: [Dovecot] Internal Error - Cannot select inbox

2007-12-07 Thread Timo Sirainen

On 7.12.2007, at 9.25, Eric Beda wrote:

1 NO Internal error occurred. Refer to server log for more  
information.

[2007-12-07 12:51:56]

there are no errors reported in the log files related to that issue  
for

both dovecot.log and maillog


There really should be an error logged. It just might be in a  
different log file than you expected. See http://wiki.dovecot.org/ 
Logging


PGP.sig
Description: This is a digitally signed message part


Re: [Dovecot] imap crash with fts squat enabled.

2007-12-07 Thread Timo Sirainen

On 7.12.2007, at 4.52, Joe Wong wrote:


Just tested with the latest build, no crash but also no fts result.
I found the following in the log:

..

Corrupted squat uidlist file
/mailfs/4/22/3/joewong99:[EMAIL PROTECTED]/ 
Maildir/dovecot.index.search.uids:

Broken uidlists
dovecot: Dec 07 10:45:22 Error: IMAP(joewong99:joew.outblaze.com):
Corrupted squat uidlist file

..
What else do I missed? Mailbox and indexes are on NFS, is this the  
cause

of the problem?


What OS do you use? Squat currently uses mmap(), which doesn't work  
very well if multiple servers are accessing the same squat indexes.  
But if there's just one server, I think it should have worked.




PGP.sig
Description: This is a digitally signed message part


Re: [Dovecot] imap crash with fts squat enabled.

2007-12-07 Thread Timo Sirainen
On Fri, 2007-12-07 at 11:05 +0200, Timo Sirainen wrote:
  dovecot: Dec 07 10:45:22 Error: IMAP(joewong99:joew.outblaze.com):
  Corrupted squat uidlist file
 ..
  What else do I missed? Mailbox and indexes are on NFS, is this the  
  cause
  of the problem?
 
 What OS do you use? Squat currently uses mmap(), which doesn't work  
 very well if multiple servers are accessing the same squat indexes.  
 But if there's just one server, I think it should have worked.

http://hg.dovecot.org/dovecot/rev/66b3e894041b adds support for
mmap_disable=yes



signature.asc
Description: This is a digitally signed message part


[Dovecot] i18n.kde.org

2007-12-07 Thread Oliver Eales
151.189.12.245

i18n.kde.org

[snip]
   
 Dec  7 14:19:26 [EMAIL PROTECTED]/tg3 dovecot: IMAP([EMAIL PROTECTED]): 
 Corrupted transaction log file 
 /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: 
 Append with UID 50, but next_uid = 15870
 

 This is the real error. What kind of a system do you have? Do you use
 NFS or other shared filesystem? Post your dovecot -n output?

   

Standard local disk partition. No NFS.

tg3 daniel # dovecot -n
# 1.0.7: /etc/dovecot/dovecot.conf
syslog_facility: local5
protocols: imap imaps pop3 pop3s
listen(default): *:143
listen(imap): *:143
listen(pop3): *:110
ssl_listen(default): *:993
ssl_listen(imap): *:993
ssl_listen(pop3): *:995
ssl_cert_file: /var/ssl/certs/imapd.pem
ssl_key_file: /var/ssl/private/imapd.pem
disable_plaintext_auth: no
login_dir: /var/run/dovecot/login
login_executable(default): /usr/libexec/dovecot/imap-login
login_executable(imap): /usr/libexec/dovecot/imap-login
login_executable(pop3): /usr/libexec/dovecot/pop3-login
login_process_per_connection: no
login_processes_count: 5
verbose_proctitle: yes
default_mail_env: maildir:/home/virtual/%h
mail_location: maildir:/home/virtual/%h
mail_full_filesystem_access: yes
mmap_disable: yes
dotlock_use_excl: yes
fsync_disable: yes
maildir_copy_with_hardlinks: yes
mail_executable(default): /usr/libexec/dovecot/imap
mail_executable(imap): /usr/libexec/dovecot/imap
mail_executable(pop3): /usr/libexec/dovecot/pop3
mail_process_size: 128
mail_plugins(default): imap_quota quota
mail_plugins(imap): imap_quota quota
mail_plugins(pop3): quota
mail_plugin_dir: /usr/lib/dovecot/imap
mail_log_max_lines_per_sec: 30
imap_client_workarounds(default): outlook-idle delay-newmail
imap_client_workarounds(imap): outlook-idle delay-newmail
imap_client_workarounds(pop3): outlook-idle
pop3_uidl_format: %08Xv%08Xu
namespace:
  type: private
  separator: /
  inbox: yes
namespace:
  type: private
  separator: /
  prefix: mail/
  location: maildir:/home/virtual/%h
  hidden: yes
auth default:
  cache_size: 2048
  cache_ttl: 900
  master_user_separator: *
  worker_max_count: 5
  passdb:
driver: passwd-file
args: /etc/master.pwd
master: yes
  passdb:
driver: sql
args: /etc/dovecot-mysql.conf
  userdb:
driver: sql
args: /etc/dovecot-mysql.conf
plugin:
  quota: maildir

 Shouldn't Dovecot be able to recover from this? 
 

 It does, that's why there are those marked corrupted errors. But it
 probably does cause the current operation to fail. v1.1 handles this by
 logging the error but continuing anyway, so the operation shouldn't
 fail.

 If you mean that it repeatedly fails with the same error, then the same
 error condition is created over and over again for some reason.
   
Yes it repeatedly fails until I manually remove the index files. However
after removing them it does not seem to reoccur.

Thanks Timo,
Dan



Re: [Dovecot] Corrupted Transaction Log File: v1.0.7

2007-12-07 Thread Timo Sirainen
On Fri, 2007-12-07 at 14:33 +, Daniel Watts wrote:
 Following errors have happened quite a bit:
 
 Dec  7 14:19:26 [EMAIL PROTECTED]/tg3 dovecot: IMAP([EMAIL PROTECTED]): 
 Transaction log file 
 /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: 
 marked corrupted
 
 Dec  7 14:19:26 [EMAIL PROTECTED]/tg3 dovecot: IMAP([EMAIL PROTECTED]): 
 Transaction log file 
 /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log.2: 
 marked corrupted

These happen because of another error that caused them to be marked
corrupted.

 Dec  7 14:19:26 [EMAIL PROTECTED]/tg3 dovecot: IMAP([EMAIL PROTECTED]): 
 Corrupted transaction log file 
 /home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: 
 Append with UID 50, but next_uid = 15870

This is the real error. What kind of a system do you have? Do you use
NFS or other shared filesystem? Post your dovecot -n output?

 Shouldn't Dovecot be able to recover from this? 

It does, that's why there are those marked corrupted errors. But it
probably does cause the current operation to fail. v1.1 handles this by
logging the error but continuing anyway, so the operation shouldn't
fail.

If you mean that it repeatedly fails with the same error, then the same
error condition is created over and over again for some reason.


signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] open files

2007-12-07 Thread Timo Sirainen
On Fri, 2007-12-07 at 09:24 -0500, Joe Allesi -X (joallesi - Coyote
Creek Consulting at Cisco) wrote:
 Most likely you hit this threshold:
 
 [EMAIL PROTECTED] ~]# cat /proc/sys/fs/file-max
 380081
 
 Check the current usage here:
 
 [EMAIL PROTECTED] ~]# cat /proc/sys/fs/file-nr
 21450   380081

That actually gives a slightly different error message: Too many open
files in system.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] open files

2007-12-07 Thread Timo Sirainen
On Fri, 2007-12-07 at 11:23 +, Steve Heaven wrote:
 This morning dovecot stopped allowing pop3 logins. In the logs I found
 the messages below
 Is there a config value for the max open files ?
 
 
 Dec  7 10:00:22 frigga dovecot: execv(/usr/local/libexec/dovecot/pop3)
 failed: Too many open files
 Dec  7 10:01:14 frigga dovecot: pipe() failed: Too many open files

You probably had lots and lots of pop3 processes running, overflowing
the number of available fds for logging. v1.1 gives a warning about this
at startup.

Change your ulimit or settings so that ulimit -n before starting
Dovecot gives a somewhat larger number than max_mail_processes +
login_max_processes_count.



signature.asc
Description: This is a digitally signed message part


[Dovecot] Corrupted Transaction Log File: v1.0.7

2007-12-07 Thread Daniel Watts

Following errors have happened quite a bit:

Dec  7 14:19:26 [EMAIL PROTECTED]/tg3 dovecot: IMAP([EMAIL PROTECTED]): 
Transaction log file 
/home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: 
marked corrupted


Dec  7 14:19:26 [EMAIL PROTECTED]/tg3 dovecot: IMAP([EMAIL PROTECTED]): 
Transaction log file 
/home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log.2: 
marked corrupted


Dec  7 14:19:26 [EMAIL PROTECTED]/tg3 dovecot: IMAP([EMAIL PROTECTED]): 
Corrupted transaction log file 
/home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: 
Append with UID 50, but next_uid = 15870


Causing Peter Day not to be able to delete emails. Seems mostly to 
happen in the Trash I think.


Shouldn't Dovecot be able to recover from this? And then have some rule 
that if it cannot recover, delete the index file and rebuild? When I 
manually remove the file it works fine.


Thanks,
Daniel




Re: [Dovecot] open files

2007-12-07 Thread Steve Heaven
On Fri, 2007-12-07 at 09:24 -0500, Joe Allesi -X (joallesi - Coyote
Creek Consulting at Cisco) wrote:

 Most likely you hit this threshold:
 
 [EMAIL PROTECTED] ~]# cat /proc/sys/fs/file-max
 380081
 
 Check the current usage here:
 
 [EMAIL PROTECTED] ~]# cat /proc/sys/fs/file-nr
 21450   380081
 


I doubt it, the current figures are:

# cat /proc/sys/fs/file-nr
21120   24748
# cat /proc/sys/fs/file-max
24748

So we are using less than a tenth of the available handles


-- 
thorNET 

Internet Services, Consultancy  Training
www.thornet.co.uk


Re: [Dovecot] open files

2007-12-07 Thread Joe Allesi -X (joallesi - Coyote Creek Consulting at Cisco)

Most likely you hit this threshold:

[EMAIL PROTECTED] ~]# cat /proc/sys/fs/file-max
380081

Check the current usage here:

[EMAIL PROTECTED] ~]# cat /proc/sys/fs/file-nr
21450   380081

-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of
Steve Heaven
Sent: Friday, December 07, 2007 6:24 AM
To: dovecot@dovecot.org
Subject: [Dovecot] open files

Is there a config value for the max open files ?


Re: [Dovecot] Corrupted Transaction Log File: v1.0.7

2007-12-07 Thread Daniel Watts

[snip]
  
Dec  7 14:19:26 [EMAIL PROTECTED]/tg3 dovecot: IMAP([EMAIL PROTECTED]): 
Corrupted transaction log file 
/home/virtual/mydomain.com/home/peter.day/Maildir/.Trash/dovecot.index.log: 
Append with UID 50, but next_uid = 15870



This is the real error. What kind of a system do you have? Do you use
NFS or other shared filesystem? Post your dovecot -n output?

  


Standard local disk partition. No NFS.

tg3 daniel # dovecot -n
# 1.0.7: /etc/dovecot/dovecot.conf
syslog_facility: local5
protocols: imap imaps pop3 pop3s
listen(default): *:143
listen(imap): *:143
listen(pop3): *:110
ssl_listen(default): *:993
ssl_listen(imap): *:993
ssl_listen(pop3): *:995
ssl_cert_file: /var/ssl/certs/imapd.pem
ssl_key_file: /var/ssl/private/imapd.pem
disable_plaintext_auth: no
login_dir: /var/run/dovecot/login
login_executable(default): /usr/libexec/dovecot/imap-login
login_executable(imap): /usr/libexec/dovecot/imap-login
login_executable(pop3): /usr/libexec/dovecot/pop3-login
login_process_per_connection: no
login_processes_count: 5
verbose_proctitle: yes
default_mail_env: maildir:/home/virtual/%h
mail_location: maildir:/home/virtual/%h
mail_full_filesystem_access: yes
mmap_disable: yes
dotlock_use_excl: yes
fsync_disable: yes
maildir_copy_with_hardlinks: yes
mail_executable(default): /usr/libexec/dovecot/imap
mail_executable(imap): /usr/libexec/dovecot/imap
mail_executable(pop3): /usr/libexec/dovecot/pop3
mail_process_size: 128
mail_plugins(default): imap_quota quota
mail_plugins(imap): imap_quota quota
mail_plugins(pop3): quota
mail_plugin_dir: /usr/lib/dovecot/imap
mail_log_max_lines_per_sec: 30
imap_client_workarounds(default): outlook-idle delay-newmail
imap_client_workarounds(imap): outlook-idle delay-newmail
imap_client_workarounds(pop3): outlook-idle
pop3_uidl_format: %08Xv%08Xu
namespace:
 type: private
 separator: /
 inbox: yes
namespace:
 type: private
 separator: /
 prefix: mail/
 location: maildir:/home/virtual/%h
 hidden: yes
auth default:
 cache_size: 2048
 cache_ttl: 900
 master_user_separator: *
 worker_max_count: 5
 passdb:
   driver: passwd-file
   args: /etc/master.pwd
   master: yes
 passdb:
   driver: sql
   args: /etc/dovecot-mysql.conf
 userdb:
   driver: sql
   args: /etc/dovecot-mysql.conf
plugin:
 quota: maildir

Shouldn't Dovecot be able to recover from this? 



It does, that's why there are those marked corrupted errors. But it
probably does cause the current operation to fail. v1.1 handles this by
logging the error but continuing anyway, so the operation shouldn't
fail.

If you mean that it repeatedly fails with the same error, then the same
error condition is created over and over again for some reason.
  
Yes it repeatedly fails until I manually remove the index files. However 
after removing them it does not seem to reoccur.


Thanks Timo,
Dan


Re: [Dovecot] open files

2007-12-07 Thread Steve Heaven
On Fri, 2007-12-07 at 16:38 +0200, Timo Sirainen wrote:


 
 Change your ulimit or settings so that ulimit -n before starting
 Dovecot gives a somewhat larger number than max_mail_processes +
 login_max_processes_count.


OK, thanks

-- 
thorNET 

Internet Services, Consultancy  Training
www.thornet.co.uk


[Dovecot] open files

2007-12-07 Thread Steve Heaven

This morning dovecot stopped allowing pop3 logins. In the logs I found
the messages below
Is there a config value for the max open files ?


Dec  7 10:00:22 frigga dovecot: execv(/usr/local/libexec/dovecot/pop3)
failed: Too many open files
Dec  7 10:01:14 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:03:40 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:03:40 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:03:40 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:03:40 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:03:43 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:03:45 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:04:39 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:04:41 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:04:50 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:05:00 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:05:02 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:06:05 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:06:05 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:06:05 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:06:06 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:07:48 frigga dovecot: pipe() failed: Too many open files
Dec  7 10:08:05 frigga dovecot: pipe() failed: Too many open files




Re: [Dovecot] Mails get lost - RHEL 5.1 - dovecot-1.0-1.2.rc15.el5

2007-12-07 Thread Götz Reinicke
Nikolay Shopik schrieb:
 On 04.12.2007 19:35, Götz Reinicke wrote:
 Hi,

 we do have a Voiceboxserver which forward recorded avi messages to the
 mailserver account of users. I'v tested it for my account 10 minutes ago
  and everything works.

 Some users don't get the messages shown up in there mailclient while the
 logs show a delivery of that mail.

 May be some mail caches are messed up?

 We use Thunderbird 2 and the users concerned use imap.

 Where may I look or what may I check?

 Thanks for your help!

 Regards

 Götz
   
 So you sure it was delivered, seen this on dovecot.info log? If you are
 using maildir you may check if file delivered and exist.

Hi,

has somewone done an upgrade of the red hat package from an other
source? E.g. I have rebuild the latest fedora core 8 rpm
(dovecot-1.0.7-2) without erros. But will an update to this version
break anything? May I addjust some settings?

Thanks for any suggestions!


Regards

Götz
-- 
Götz Reinicke
IT Koordinator

Tel. +49 7141 969 420
Fax  +49 7141 969 55 420
E-Mail [EMAIL PROTECTED]

Filmakademie Baden-Württemberg GmbH
Mathildenstr. 20
71638 Ludwigsburg
www.filmakademie.de

Eintragung Amtsgericht Stuttgart HRB 205016
Vorsitzender des Aufsichtsrats:
Dr. Christoph Palmer, MdL, Minister a.D.

Geschäftsführer:
Prof. Thomas Schadt




Re: [Dovecot] Internal Error - Cannot select inbox

2007-12-07 Thread Charles Marcus

On 12/7/2007, Eric Beda ([EMAIL PROTECTED]) wrote:

# dovecot --version
1.0.rc15


Also - this is really old - lots of changes in the released version...

You really should upgrade - or maybe wait until 1.1 goes gold, and then 
upgrade - but do yourself a favor and do it soon.


--

Best regards,

Charles


Re: [Dovecot] Corrupted Transaction Log File: v1.0.7

2007-12-07 Thread Timo Sirainen
On Fri, 2007-12-07 at 15:01 +, Daniel Watts wrote:
  Shouldn't Dovecot be able to recover from this? 
  
 
  It does, that's why there are those marked corrupted errors. But it
  probably does cause the current operation to fail. v1.1 handles this by
  logging the error but continuing anyway, so the operation shouldn't
  fail.
 
  If you mean that it repeatedly fails with the same error, then the same
  error condition is created over and over again for some reason.

 Yes it repeatedly fails until I manually remove the index files. However 
 after removing them it does not seem to reoccur.

The next time this happens, could you send me:

 - dovecot.index
 - dovecot.index.log*
 - dovecot-uidlist
 - ls new/ cur/

None of those should contain any sensitive information.



signature.asc
Description: This is a digitally signed message part


[Dovecot] Is dovecot the right choice for this problem?

2007-12-07 Thread Darren McLaughlin
Is dovecot the right choice for this problem?

I have a shared server with verio.  I have one particular client that sends and 
receives numerous large emails, and those emails were causing me to run out of 
processes on my verio server, and basically slow things down a great deal due 
to the shared mail queue.  Verio suggested Dovecot to reduce server load and 
allow this one client to have less problems with sending and receiving email.  
Does this sound logical to anyone in the know?

Thanks!

Darren



Re: [Dovecot] Is dovecot the right choice for this problem?

2007-12-07 Thread Darren McLaughlin
Bill,

There's a ringing endorsement of Verio.  They told me that the server had 
agroup mail file and all the users had their mail stored together.  If I 
installed Dovecot, they said it would split the mailboxes up into individual 
files, and reduce the load on teh server, thus allowing it to better handle 
large mailboxes.  I guess they are just making it up as they go along...  
thanks for the info though.  I suppose I will seek an independent email host 
somewhere and have their mail forwarded, or upgrade my server on verio.

Thanks,

Darren

*** REPLY SEPARATOR  ***

RESPONSE TAG: 8483057671202
On 12/7/2007 at 10:49 PM Bill Cole wrote:

At 11:56 AM -0600 12/7/07, Darren McLaughlin wrote:
Is dovecot the right choice for this problem?

I have a shared server with verio.  I have one particular client
that sends and receives numerous large emails, and those emails were
causing me to run out of processes on my verio server, and basically
slow things down a great deal due to the shared mail queue.  Verio
suggested Dovecot to reduce server load and allow this one client to
have less problems with sending and receiving email.  Does this
sound logical to anyone in the know?

It does not sound right. Dovecot is not involved in sending mail. It
never comes anywhere near the mail queue.

It does sound about par for the course for Verio support though. Spot on.
--
Bill Cole
[EMAIL PROTECTED]



--
No virus found in this incoming message.
Checked by AVG Free Edition.
Version: 7.5.503 / Virus Database: 269.16.17/1176 - Release Date:
12/6/2007 11:15 PM


.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.
Darren McLaughlin
Mindstream Technologies
Business Technology Consulting

C: (217) 841-5167
P: (217) 867-2522
F: (217) 867-2522
.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.



Re: [Dovecot] pipe plugin - is anyone interested (or using it)?

2007-12-07 Thread Nicolas Boullis

Quoting Johannes Berg [EMAIL PROTECTED]:


 I do think, however, that the two plugins could possibly converge.

I don't think they can converge, they work in very different ways,
since yours work at the IMAP level while mine works at the storage
level.


Actually, I work at storage level too now, I modified it.


Oh. I missed that.
I had a look at your plugin, quite some time ago, and did not think  
you would have modified it in such a way.
I should definitely give it a look; how to you figure out where the  
mail comes from?




No, but I'm using spam as an example of how your plugin could be
generalised to work the same as mine with a different configuration. It
seems to me that you only consider use cases that depend on the target
folder while my generalisation was to make it depend on the pair
(source, target).


I did not think it would be possible to use the (source,target) pair  
at the storage level. Now that I understand your proposal a little  
better, I think it looks like a good idea.



Cheers,

Nicolas



Re: [Dovecot] pipe plugin - is anyone interested (or using it)?

2007-12-07 Thread Nicolas Boullis

Quoting Johannes Berg [EMAIL PROTECTED]:




 plugin {
 (...)
   pipe = /var/learn/%u/.spam:spamc -d some.host -L spam
   pipe2 = /var/learn/%u/.ham:spamc -d some.host -L ham
 (...)

And here I define that any message stored to /var/learn/%u/.spam where
%u is the username (that is learn.spam in the user's IMAP namespace) has
to be piped to the spamc -d some.host -L spam command. And the same
for ham.


The above is why I like my antispam plugin much better: you can push
into *any* folder *from* spam to train as ham.


It certainly is a matter of taste, but that also was the reason why I  
did not like your plugin... ;-)


Firstly, if a message is correctly identified as a spam, but I want to  
keep it a copy for some reason, copying outside the spam plugin means  
learning as ham, so I have to copy it again into the spam plugin to  
re-learn it as ham.


Sencondly, I don't know how dspam works, but spamassassin can identify  
a message as HAM or SPAM without learning it. If I want to learn a  
message correctly identified as spam but not auto-learnt, I have again  
to move it out of the spam folder and then back in. The same if a  
message is correctly identified by ham but not auto-learnt, I have to  
move it to the spam folder and then out of it.


Lastly, I'd prefer my user to make some explicit action to learn a  
message rather than have a system that somewhat guesses for them...





I do think, however, that the two plugins could possibly converge.


I don't think they can converge, they work in very different ways,  
since yours work at the IMAP level while mine works at the storage  
level.


Hence, mine can also be triggered by a delivery with dovecot's  
deliver, but when a message is copied or appended, it does not know  
where it comes from (but as far as I am concerned, since I don't like  
triggering when moving a message out of a folder, it does not matter).  
On the other hand, yours only works with IMAP, overriding the COPY  
command.




That
would entail being able to specify pipes with two endpoints, right now
you just have the destination folder. In order to do that, the plugin
would have to be configurable like this, with the pipes tried in the
order they are numbered:

# learn into spam as spam
pipe.1 = *SPAM  |/learn/as --spam
pipe.2 = UNSURESPAM |/learn/as --spam
# forbid into unsure
pipe.3 = *UNSURE-
# learn from unsure or spam folder as ham
pipe.4 = UNSURE*|/learn/as --ham
pipe.5 = SPAM*  |/learn/as --ham


Those only work if you consider messages that are copied from a folder  
to a different one. But how do you deal with messages that are  
appended from another source (such as messages being delivered or  
appended by an IMAP client)?




This would allow writing a simple plugin, having dovecot load it (before
the pipe plugin) and having a function in that plugin called, splitting
the work the antispam plugin would do in that case into two plugins.

I guess that such a plugin is actually more generic than pipe then.


It looks to me that you only consider spam/ham learning as a use for  
such a plugin. I think other uses are possible. For example, I  
remember someone who was willing to implement an outbox.




Do you have the pipe plugin code in git anywhere I can pull from and see
if I can do such modifications?


No, I have never used git. But you have the tarball.


Cheers,

Nicolas



Re: [Dovecot] pipe plugin - is anyone interested (or using it)?

2007-12-07 Thread Johannes Berg

  plugin {
  (...)
pipe = /var/learn/%u/.spam:spamc -d some.host -L spam
pipe2 = /var/learn/%u/.ham:spamc -d some.host -L ham
  (...)
 
 And here I define that any message stored to /var/learn/%u/.spam where
 %u is the username (that is learn.spam in the user's IMAP namespace) has
 to be piped to the spamc -d some.host -L spam command. And the same
 for ham.

The above is why I like my antispam plugin much better: you can push
into *any* folder *from* spam to train as ham.

I do think, however, that the two plugins could possibly converge. That
would entail being able to specify pipes with two endpoints, right now
you just have the destination folder. In order to do that, the plugin
would have to be configurable like this, with the pipes tried in the
order they are numbered:

# learn into spam as spam
pipe.1 = *SPAM |/learn/as --spam
pipe.2 = UNSURESPAM|/learn/as --spam
# forbid into unsure
pipe.3 = *UNSURE   -
# learn from unsure or spam folder as ham
pipe.4 = UNSURE*   |/learn/as --ham
pipe.5 = SPAM* |/learn/as --ham

Maybe for the configuration some command aliases could be defined:

pipe.cmd.learnas = /learn/as --user %u
pipe.1 = *SPAM !learnas --spam

causes an internal expansion to:
pipe.1 = *SPAM |/learn/as --user %u --spam


As you can see, I have prefixed the command with a pipe symbol. This
indicates that a program shall be invoked. I have prefixed the alias
with an exclamation mark. In order to have the libdspam (or similar)
training some people wanted, we could allow a bare specification for
ld-open style:
pipe.1 = *SPAM builtin_learn_as

which would essentially do:
fn = dlsym(RTLD_DEFAULT, builtin_learn_as);
fn(source folder, dest folder, mail struct[, ...?])

This would allow writing a simple plugin, having dovecot load it (before
the pipe plugin) and having a function in that plugin called, splitting
the work the antispam plugin would do in that case into two plugins.

I guess that such a plugin is actually more generic than pipe then.

Do you have the pipe plugin code in git anywhere I can pull from and see
if I can do such modifications?

johannes


signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Is dovecot the right choice for this problem?

2007-12-07 Thread Bill Cole

At 11:56 AM -0600 12/7/07, Darren McLaughlin wrote:

Is dovecot the right choice for this problem?

I have a shared server with verio.  I have one particular client
that sends and receives numerous large emails, and those emails were
causing me to run out of processes on my verio server, and basically
slow things down a great deal due to the shared mail queue.  Verio
suggested Dovecot to reduce server load and allow this one client to
have less problems with sending and receiving email.  Does this
sound logical to anyone in the know?


It does not sound right. Dovecot is not involved in sending mail. It 
never comes anywhere near the mail queue.


It does sound about par for the course for Verio support though. Spot on.
--
Bill Cole
[EMAIL PROTECTED]



Re: [Dovecot] pipe plugin - is anyone interested (or using it)?

2007-12-07 Thread Johannes Berg

 Oh. I missed that.
 I had a look at your plugin, quite some time ago, and did not think  
 you would have modified it in such a way.

http://johannes.sipsolutions.net/Projects/dovecot-antispam

 I should definitely give it a look; how to you figure out where the  
 mail comes from?

TBH, I forgot :) The code can be browsed here:
http://git.sipsolutions.net/?p=dovecot-antispam.git;a=tree

  No, but I'm using spam as an example of how your plugin could be
  generalised to work the same as mine with a different configuration. It
  seems to me that you only consider use cases that depend on the target
  folder while my generalisation was to make it depend on the pair
  (source, target).
 
 I did not think it would be possible to use the (source,target) pair  
 at the storage level. Now that I understand your proposal a little  
 better, I think it looks like a good idea.

:)

johannes


signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] pipe plugin - is anyone interested (or using it)?

2007-12-07 Thread Johannes Berg

 It certainly is a matter of taste, but that also was the reason why I  
 did not like your plugin... ;-)

Aha, but with what I proposed that becomes a matter of configuration,
hence my SPAM* rule in there.

 Lastly, I'd prefer my user to make some explicit action to learn a  
 message rather than have a system that somewhat guesses for them...

You can still have that, I was just expressing how my plugin works in
terms of some rules.

  I do think, however, that the two plugins could possibly converge.
 
 I don't think they can converge, they work in very different ways,  
 since yours work at the IMAP level while mine works at the storage  
 level.

Actually, I work at storage level too now, I modified it.

 Hence, mine can also be triggered by a delivery with dovecot's  
 deliver, but when a message is copied or appended, it does not know  
 where it comes from (but as far as I am concerned, since I don't like  
 triggering when moving a message out of a folder, it does not matter).  

Yeah, if you load it into deliver which I'd consider somewhat stupid to
do with my plugin.

 Those only work if you consider messages that are copied from a folder  
 to a different one. But how do you deal with messages that are  
 appended from another source (such as messages being delivered or  
 appended by an IMAP client)?

Good point. You could treat that as the empty source, like

pipe.3 = SPAM  do something

and have a wildcard that matches all (like .* RE) and one that matches
all not empty (like .+ RE)

 It looks to me that you only consider spam/ham learning as a use for  
 such a plugin. I think other uses are possible. For example, I  
 remember someone who was willing to implement an outbox.

No, but I'm using spam as an example of how your plugin could be
generalised to work the same as mine with a different configuration. It
seems to me that you only consider use cases that depend on the target
folder while my generalisation was to make it depend on the pair
(source, target).

johannes


signature.asc
Description: This is a digitally signed message part