Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-16 Thread Benny Pedersen
On 2022-01-16 04:41, Scott Kitterman wrote: Not keeping the mail in memory for to better support large mails is on my TODO list for dkimpy-milter. fuglu is already using dkimpy, but not dkimpy-milter, would you help fuglu devs on make fuglu support milters ? both is python btw

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Scott Kitterman
On Saturday, January 15, 2022 8:08:51 PM EST Robert Siemer wrote: > > > Conceptually DKIM needs to go over the email twice: once to calculate > > > and sign the checksum and once to write it out with the result of the > > > previous step in the headers.¹ > > > > Prepending a header does not

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Robert Siemer
> > Conceptually DKIM needs to go over the email twice: once to calculate > > and sign the checksum and once to write it out with the result of the > > previous step in the headers.¹ > > Prepending a header does not require rewriting the message body. > Postfix queue files support efficient

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Robert Siemer
> > So far I see that the after-queue content filter mechanism > > (FILTER_README) forces you to write the email to disc again. (And > > for no good reason, unfortunately: pipe should pass a read-only > > file descriptor of the queue file to filter?s stdin. The filter > > can use lseek() on that.)

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Wietse Venema
Robert Siemer: > Hello everyone, > > I need to DKIM sign possibly huge emails (up to 150MB). > > Conceptually DKIM needs to go over the email twice: once to calculate > and sign the checksum and once to write it out with the result of > the previous step in the headers.? > > A DKIM signer can do

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Viktor Dukhovni
On Sat, Jan 15, 2022 at 08:01:05PM +0100, Robert Siemer wrote: > I need to DKIM sign possibly huge emails (up to 150MB). No worries, you can do this with a milter, without storing an extra copy of the complete message. > Conceptually DKIM needs to go over the email twice: once to calculate >

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread John Levine
It appears that Benny Pedersen said: >On 2022-01-15 20:01, Robert Siemer wrote: > >> I need to DKIM sign possibly huge emails (up to 150MB). > >insane agreed >> A DKIM signer can do this by either keeping the message in memory (a >> no-go for me) or write it to a file. > >will a mount point on

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Bob Proulx
Robert Siemer wrote: > Gmail allows 150MB. Ok? And with that they are right. That is not > "insane". Insane is the opposite: to reject an email, because a > single file attachment ended up a little bigger than expected. Total > user experience disaster. I think you have me confused with someone

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Robert Siemer
Gmail allows 150MB. Ok? And with that they are right. That is not “insane”. Insane is the opposite: to reject an email, because a single file attachment ended up a little bigger than expected. Total user experience disaster. So could we concentrate on answering my question or solving the

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Benny Pedersen
On 2022-01-15 20:01, Robert Siemer wrote: I need to DKIM sign possibly huge emails (up to 150MB). insane Conceptually DKIM needs to go over the email twice: once to calculate and sign the checksum and once to write it out with the result of the previous step in the headers.¹ what is your

Re: How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Bob Proulx
Robert Siemer wrote: > I need to DKIM sign possibly huge emails (up to 150MB). I know you say you need this. But even if you had it would it actually be useful to you? DKIM is needed to interchange email with random email servers around the Internet. Because said random servers will reject the

How to filter email (DKIM) without keeping the message in memory and without writing it to disc twice?

2022-01-15 Thread Robert Siemer
Hello everyone, I need to DKIM sign possibly huge emails (up to 150MB). Conceptually DKIM needs to go over the email twice: once to calculate and sign the checksum and once to write it out with the result of the previous step in the headers.¹ A DKIM signer can do this by either keeping the