Re: Big Distribution List

2008-09-22 Thread Victor Duchovni
On Mon, Sep 22, 2008 at 09:08:55AM -0300, jakjr wrote:

 Hi Guys,
 
 I have one big distribution list (100K emails). I'm using virtual_alias_maps
 for that like this:
 
 virtual_alias_maps = hash:/etc/postfix/virtual
 
 where virtual:
 [EMAIL PROTECTED]
   [EMAIL PROTECTED],
   .
   [EMAIL PROTECTED]

By default Postfix truncates virtual(5) expansion at 1000 recipients.
For lists this large you MUST not use virtual(5), rather use a :include:
valued local alias, AND set an owner-list alias to make sure that
bounces are NOT send to the sender.

-- 
Viktor.

Disclaimer: off-list followups get on-list replies or get ignored.
Please do not ignore the Reply-To header.

To unsubscribe from the postfix-users list, visit
http://www.postfix.org/lists.html or click the link below:
mailto:[EMAIL PROTECTED]

If my response solves your problem, the best way to thank me is to not
send an it worked, thanks follow-up. If you must respond, please put
It worked, thanks in the Subject so I can delete these quickly.


Re: Big Distribution List

2008-09-22 Thread Jason Pruim


On Sep 22, 2008, at 8:08 AM, jakjr wrote:


Hi Guys,

I have one big distribution list (100K emails). I'm using  
virtual_alias_maps for that like this:


virtual_alias_maps = hash:/etc/postfix/virtual

where virtual:
[EMAIL PROTECTED]
  [EMAIL PROTECTED],
  .
  [EMAIL PROTECTED]

Everything is working fine, but when I send a email to this  
distribution list, the postix cleanup process take 1 hour to finish.


I know this process is responsible for the checks, including expand  
the virtual address, but, is there a way to speed up this process ?



Is there any reason you are not using a mailing list manager program  
such as mailman or ezmlm?


It seems to me, that a list that size would be perfectly suited for a  
full blown mailing list manager..


But that's just me.


--

Jason Pruim
Raoset Inc.
Technology Manager
MQC Specialist
11287 James St
Holland, MI 49424
www.raoset.com
[EMAIL PROTECTED]






Re: Big Distribution List

2008-09-22 Thread Charles Marcus
On 9/22/2008, Victor Duchovni ([EMAIL PROTECTED]) wrote:
 By default Postfix truncates virtual(5) expansion at 1000 recipients.
 For lists this large you MUST not use virtual(5), rather use a :include:
 valued local alias, AND set an owner-list alias to make sure that
 bounces are NOT send to the sender.

Or better, use a real mail list server like mailman...

-- 

Best regards,

Charles


Re: Big Distribution List

2008-09-22 Thread Wietse Venema
Victor Duchovni:
 On Mon, Sep 22, 2008 at 09:08:55AM -0300, jakjr wrote:
 
  Hi Guys,
  
  I have one big distribution list (100K emails). I'm using virtual_alias_maps
  for that like this:
  
  virtual_alias_maps = hash:/etc/postfix/virtual
  
  where virtual:
  [EMAIL PROTECTED]
[EMAIL PROTECTED],
.
[EMAIL PROTECTED]
 
 By default Postfix truncates virtual(5) expansion at 1000 recipients.
 For lists this large you MUST not use virtual(5), rather use a :include:
 valued local alias, AND set an owner-list alias to make sure that
 bounces are NOT send to the sender.

I just did a quick run-time profile of the cleanup daemon's CPU
usage, and it was no surprise that most time was spent manipulating
email addresses. I expected less that the time was spent in a
quadratic algorithm.

Specifically, most time was being spent in tok822_append(), as it
is called by tok822_group(). Function tok822_append() is called
from several places, and I had to inline it to find out which
calls are expensive. The expense is incurred when tok822_append()
appends a list of multiple tokens, which makes the algorithm
quadratic. This could be avoided by passing in a pointer to the
last list element, and keeping that pointer up to date as the
program evolves.

The owner member of an address token is never tested for its
actual value, only for zero or non-zero. Therefore in many cases
the quadratic behavior can be avoided altogether. However, this is
not something I would change while recovering from a seven-hour
time shift.

Wietse