Re: [Mailman-Users] Scrub_nondigest questions

2014-06-23 Thread Mark Sapiro
On 06/22/2014 05:21 PM, Peter Shute wrote:
 We're considering enabling the scrub_nondigest option for our list. The aim 
 is to allow members to send jpg files to the list (currently filtered) and 
 have mailman include a link to them in messages instead of the actual 
 attachment. I've got a few questions about how this works.
 
 I believe it will store the scrubbed images in the archives. We have 
 archiving turned off. Do we need to turn them on to allow the images to be 
 placed there, or will it happen anyway?


It will happen anyway. Archiving for the list doesn't need to be enabled.


 Once we have images stored in the archives, how easy is it for members to 
 access them when they click on the links in the messages? Will they need a 
 password to see them?


If and only if the list's archive_private setting is private, but since
archiving is Off, if you want scrubbed attachments accessible without
autnentication, just set archive_private to public.


 Will we be able to selectively delete images when our disk space begins to 
 fill up? Or will they all be stored in a single archive file? We're using 
 cpanel, if that matters.


I don't think cPanel is different.

The attachments for a message are stored individually in the directory
archives/private/LISTNAME/attachments/mmdd//. mmdd is
the date and  is a hash of the message, so you can delete
individual files or the  directory for all attachments for a
single message or the mmdd directory for all attachments from a
given day.


 If anyone who's using this option could forward me a message from their list 
 with a linked image so I can check how well it works, that would be greatly 
 appreciated.


Why not just try it yourself on a test list?

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Scrub_nondigest questions

2014-06-23 Thread Peter Shute
 On 23 Jun 2014, at 4:08 pm, Mark Sapiro m...@msapiro.net wrote:
 
 Will we be able to selectively delete images when our disk space begins to 
 fill up? Or will they all be stored in a single archive file? We're using 
 cpanel, if that matters.
 
 I don't think cPanel is different.
 
 The attachments for a message are stored individually in the directory
 archives/private/LISTNAME/attachments/mmdd//. mmdd is
 the date and  is a hash of the message, so you can delete
 individual files or the  directory for all attachments for a
 single message or the mmdd directory for all attachments from a
 given day.

Any idea if we'll have access to that area in cPanel? I'm not the list owner, I 
can't test it for myself.

And does the value of archive_volume_frequency affect where they're stored?

 If anyone who's using this option could forward me a message from their list 
 with a linked image so I can check how well it works, that would be greatly 
 appreciated

Thanks for sending the sample.

Peter Shute
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Scrub_nondigest questions may be attachment-move custom handler

2014-06-23 Thread Peter Shute
I was testing that for you a few weeks ago. I just tried again, and it seems to 
work smoothly now.

Could that be made to automatically resize images? E.g. maximum dimensions 
800x800 pixels.

Peter Shute

Sent from my iPad

 On 23 Jun 2014, at 7:30 pm, Sylvain Viart sylv...@opensource-expert.com 
 wrote:
 
 Hi Peter,
 
 I programmed a custom handler that complete or replace Scrub_nondigest
 handler:
 
 AttachmentMove
 
 
 You can test or try it here:
 http://mailman.opensource-expert.com/mailman/listinfo/attachment-move
 
 Hosting in done in France and could be slow to reach from foreign
 countries.
 This running version is not commited yet, minor i8n changes.
 It's also working in production of a customer with a list of 930
 subscribers since 3 weeks.
 
 The code and the doc : https://github.com/Sylvain303/mailman-AttachmentMove
 
 
 Le 23/06/2014 10:03, Peter Shute a écrit :
 If anyone who's using this option could forward me a message from their 
 list with a linked image so I can check how well it works, that would be 
 greatly appreciated
 
 AttachmentMove  keeps embedded images, they could be moved as well.
 The remote hosting for attachment can be same or a different one that
 the server running mailman.
 
 To reply to your first post:
 
 We're considering enabling the scrub_nondigest option for our list. The aim 
 is to allow members to send jpg files to the list (currently filtered) and 
 have mailman include a link to them in messages instead of the actual 
 attachment.
 
 That is the purpose of AttachmentMove.
 
 I believe it will store the scrubbed images in the archives. We have 
 archiving turned off. Do we need to turn them on to allow the images to be 
 placed there, or will it happen anyway?
 
 Attachment are stored locally and on a remote hosting. The local
 storage (on the mailman server) is not the archive. And it is used to
 avoid duplicate file name when uploaded on the webserver.
 
 Once we have images stored in the archives, how easy is it for members to 
 access them when they click on the links in the messages? Will they need a 
 password to see them?
 
 AttachmentMove, publish the image on a different hosting no password are
 required, the goal was to keeps user away for technical details.
 
 Will we be able to selectively delete images when our disk space begins to 
 fill up? Or will they all be stored in a single archive file? We're using 
 cpanel, if that matters.
 
 Not storage management is coded yet, a cron with the good find -mtime
 could do the trick.
 It's in my idea to handle that too.
 
 If anyone who's using this option could forward me a message from their list 
 with a linked image so I can check how well it works, that would be greatly 
 appreciated.
 
 I sent you an example we have made on the test list.
 
 
 Let me know if that meet your needs.
 
 Regards,
 Sylvain.
 
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Re: [Mailman-Users] Scrub_nondigest questions may be attachment-move custom handler

2014-06-23 Thread Sylvain Viart
Hi Peter,

I programmed a custom handler that complete or replace Scrub_nondigest
handler:

AttachmentMove


You can test or try it here:
http://mailman.opensource-expert.com/mailman/listinfo/attachment-move

Hosting in done in France and could be slow to reach from foreign
countries.
This running version is not commited yet, minor i8n changes.
It's also working in production of a customer with a list of 930
subscribers since 3 weeks.

The code and the doc : https://github.com/Sylvain303/mailman-AttachmentMove


Le 23/06/2014 10:03, Peter Shute a écrit :
 If anyone who's using this option could forward me a message from their list 
 with a linked image so I can check how well it works, that would be greatly 
 appreciated

AttachmentMove  keeps embedded images, they could be moved as well.
The remote hosting for attachment can be same or a different one that
the server running mailman.

To reply to your first post:

 We're considering enabling the scrub_nondigest option for our list. The aim 
 is to allow members to send jpg files to the list (currently filtered) and 
 have mailman include a link to them in messages instead of the actual 
 attachment.

That is the purpose of AttachmentMove.

 I believe it will store the scrubbed images in the archives. We have 
 archiving turned off. Do we need to turn them on to allow the images to be 
 placed there, or will it happen anyway?

Attachment are stored locally and on a remote hosting. The local
storage (on the mailman server) is not the archive. And it is used to
avoid duplicate file name when uploaded on the webserver.

 Once we have images stored in the archives, how easy is it for members to 
 access them when they click on the links in the messages? Will they need a 
 password to see them?

AttachmentMove, publish the image on a different hosting no password are
required, the goal was to keeps user away for technical details.

 Will we be able to selectively delete images when our disk space begins to 
 fill up? Or will they all be stored in a single archive file? We're using 
 cpanel, if that matters.

Not storage management is coded yet, a cron with the good find -mtime
could do the trick.
It's in my idea to handle that too.

 If anyone who's using this option could forward me a message from their list 
 with a linked image so I can check how well it works, that would be greatly 
 appreciated.

I sent you an example we have made on the test list.


Let me know if that meet your needs.

Regards,
Sylvain.

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Re: [Mailman-Users] Scrub_nondigest questions may be attachment-move custom handler

2014-06-23 Thread Sylvain Viart
Hi Peter,

Le 23/06/2014 12:57, Peter Shute a écrit :
 I was testing that for you a few weeks ago. I just tried again, and it seems 
 to work smoothly now.

That's true, thanks. :-)
You did just send a non html mail, right?

AttachmentMove also support html formating.

 Could that be made to automatically resize images? E.g. maximum dimensions 
 800x800 pixels.

Yes it could.

At the stage where the image is detached it can be manipulated,
including stored on some image cloud storage with other feature, like
albums for example. Given that storage as an API that a programmer can
use to store the image remotely.

With linux server there's  plenty of tools for resizing image, with and
without python.

If you don't need the remote simplification of AttachmentMove, you may
also look at ThunderBird cloud storage FileLink extension.

Regards,
Sylvain.
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

[Mailman-Users] Internet Message Format: Identification Fields

2014-06-23 Thread willi uebelherr


Dear friends,

following the RFC 5322 all identification fields are optional. But they 
SHOULD have it. Of course, sometimes we need it.


RFC 5322: Internet Message Format
http://tools.ietf.org/html/rfc5322

We have min 3 fields:
message-id
in-reply-to
references

With that, we can create all ordering of mails based on a thread. I 
think, it would be never a problem to use a new (little changed) 
message-id, because if the listserver send the mail, he changed it. And 
consequently, he create a new message-id (but for himself and for 
tracking it can be a modification of the original message-id).


In the discussion on this list Mark and other people args, this would 
lead to a big confusion for the different mail clients. Is that true? I 
don't have the necessary oversight. But i think, you have it.


The easest way would be a configuratin point for the user to decide, 
that his sended mail get a new message-id, if the listserver changed it 
when he send the mail. And this he always do it.


many greetings, willi
Panama City

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] DMARC handler

2014-06-23 Thread Ron Guerin
On 6/21/2014 8:24 PM, Mark Sapiro wrote:
 On 06/21/2014 04:04 PM, Ron Guerin wrote:
 I'm struggling to find a palatable solution to the configuration of a
 list, and the new Yahoo-style DMARC problem.

 The list has mung on, as well as Reply-To: set to the list.  The end
 result is nowhere does the original sender's address appear in the
 messages, when having them readily visible is the desired behavior.
 
 
 In Mailman 2.1.18-1, the posters address will also be in Reply-To: with
 Reply-To: set to the list. In Mailman 2.1.16 and 2.1.17, this wasn't the
 case (I think only if first_strip_reply_to was Yes).
 
 
 I was wondering about asking someone to make a Mailman handler that
 would re-write the From: address after munging to:

  Jane Doe (j...@example.com) via listname l...@example.net

 My question now is, is there any reason why re-writing it this way would
 be a bad idea?
 
 
 Yes. According to
 http://www.dmarc.org/supplemental/mailman-project-mlm-dmarc-reqs.html:
 
 The inclusion of more than one domain in the RFC5322.From field is
 dangerous.  Recent studies by two major senders show that ~95% of all
 cases in which there is one domain in the RFC5322.From display name
 and different domain in the RFC5322.From address-spec are fraudulent.
  This practice should be discouraged as there are efforts underway to
 increase spam scores within inbound filtering when this is detected.

I've been absorbing a lot of input about this and while the part of me
that just wants to get things done still likes the idea of putting the
address into the comment field, I'm finding the argument persuasive that
as soon as people /expect/ to find a valid address in the comment field,
the cold clammy hands of DMARC will choke that off too.  I don't find
the argument /valid/ mind you, as the comment field is the comment
field, and no MUA (save ones with a very specific bug) are ever going to
treat it as anything but a commment, but I completely believe that
anything that reduces the pain of DMARC will eventually run afoul of DMARC.

Now you tell me that it's actually a useful indicator of spamminess.
That feels like the last nail in the coffin.

 But, on the other hand, that's exactly what Yahoo Groups is doing, so
 take your pick.
 
 If having the poster's address in Reply-To: would be satisfactory, try
 setting first_strip_reply_to to No.

That may be the least objectionable solution that's still
DMARC-friendly, but then I'm probably annoying subscribers who aren't
using DMARC to reject mail their users asked for.

 Changing CookHeaders to munge the from as you suggest is a very simple
 patch. I have attached a 2.1.16/17 version. Note that even with this
 patch, the bug at https://bugs.launchpad.net/mailman/+bug/1304511 is
 not completely fixed. Also note John's objection won't apply as this
 will be formatted as
 
   Jane Doe j...@example.com via listname l...@example.net

I had it in my mind before he mentioned it that I'd have to look into
what triggers quoting of the comment field, but his input reassures me
that it's not likely to cause other problems from a technical
standpoint.  From a social standpoint though, it seems to be an idea
living on borrowed time.

I would really like to do, as someone said earlier, just say Friends
don't let Friends use Yahoo or AOL Mail.  But count me in with those
expecting Gmail to be next.  That's nearly half the subscribers of the
list I've been asking in regard to.

And thanks for sending code again, you're the best!

- Ron

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


[Mailman-Users] Users with utf-8

2014-06-23 Thread just . mailman

I try to add member to maillist.

./add_members -r filename.txt listname

in the file filename.txt it will exist a user like
Lönn l...@gmail.com #  Written as utf-8

When I look at memberlist afterwards at the web will it look like

l...@gmail.com
Lönn# Written the utf-8 as two 
characters

What is the problem and what is the solution

/LeSve





--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Scrub_nondigest questions

2014-06-23 Thread Mark Sapiro
On 06/23/2014 01:03 AM, Peter Shute wrote:
 
 Any idea if we'll have access to that area in cPanel? I'm not the list owner, 
 I can't test it for myself.


It depends. In cPanel all Mailman files including the archives/private/
directory are in /usr/local/cpanel/3rdparty/mailman/. If this is the
list owner's server or VPS, etc, he probably has the required access. If
his is one of multiple hosted domains on a shared server, he almost
certainly doesn't.


 And does the value of archive_volume_frequency affect where they're stored?


No.


 If anyone who's using this option could forward me a message from their 
 list with a linked image so I can check how well it works, that would be 
 greatly appreciated
 
 Thanks for sending the sample.


You're welcome.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Internet Message Format: Identification Fields

2014-06-23 Thread Mark Sapiro
On 06/23/2014 08:59 AM, willi uebelherr wrote:
 
 
 The easest way would be a configuratin point for the user to decide,
 that his sended mail get a new message-id, if the listserver changed it
 when he send the mail. And this he always do it.


We have no plans or interest to change Mailman in this way for reasons
already stated on this list.

Your issue is with Gmail's discard duplicate message feature, which we
don't agree with except perhaps as a Gmail user setting, but Google has
no plan to change this as far as we know.

Your choice is clear to me. If you don't like the way Gmail handles your
list posts, subscribe and post from a non-gmail address.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Users with utf-8

2014-06-23 Thread Mark Sapiro
On 06/23/2014 01:29 PM, just.mail...@lesve.org wrote:
 
 I try to add member to maillist.
 
 ./add_members -r filename.txt listname
 
 in the file filename.txt it will exist a user like
 Lönn l...@gmail.com #  Written as utf-8
 
 When I look at memberlist afterwards at the web will it look like
 
 l...@gmail.com
 Lönn# Written the utf-8 as two 
 characters
 
 What is the problem and what is the solution


The problem is Mailman's character set for the list's preferred_language
is not utf-8, and the input files for add_members need to be encoded in
Mailman's character set for the list's preferred_language.

If you don't know Mailman's character set for the list's preferred
language, see lines 1578 through 1616 at
http://bazaar.launchpad.net/~mailman-coders/mailman/2.1/view/head:/Mailman/Defaults.py.in.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Scrub_nondigest questions

2014-06-23 Thread Peter Shute
 On 24 Jun 2014, at 8:56 am, Mark Sapiro m...@msapiro.net wrote:
 
 On 06/23/2014 01:03 AM, Peter Shute wrote:
 
 Any idea if we'll have access to that area in cPanel? I'm not the list 
 owner, I can't test it for myself.
 
 
 It depends. In cPanel all Mailman files including the archives/private/
 directory are in /usr/local/cpanel/3rdparty/mailman/. If this is the
 list owner's server or VPS, etc, he probably has the required access. If
 his is one of multiple hosted domains on a shared server, he almost
 certainly doesn't.

Ours is hosted. In this situation, what does one normally do? Ask the hosting 
company to delete them?

Peter Shute

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Scrub_nondigest questions

2014-06-23 Thread Mark Sapiro
On 06/23/2014 05:01 PM, Peter Shute wrote:

 It depends. In cPanel all Mailman files including the archives/private/
 directory are in /usr/local/cpanel/3rdparty/mailman/. If this is the
 list owner's server or VPS, etc, he probably has the required access. If
 his is one of multiple hosted domains on a shared server, he almost
 certainly doesn't.
 
 Ours is hosted. In this situation, what does one normally do? Ask the hosting 
 company to delete them?


Why bother? This file system belongs to the host. If it gets too full
(unlikely), it's their problem. If they have some way of charging you
for disk usage attributable to your list, then they should accommodate a
request to remove some.

-- 
Mark Sapiro m...@msapiro.netThe highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Internet Message Format: Identification Fields

2014-06-23 Thread William Bagwell
On Monday 23 June 2014, Mark Sapiro wrote:
 Your choice is clear to me. If you don't like the way Gmail handles your
 list posts, subscribe and post from a non-gmail address.

Mark, off topic for *this* list though you might want to add this to the FAQ?

willi, some web hosting servers will allow customers to post outgoing mail 
with any address you own. Even if it does not match the domain you have 
hosted with them. My ISP (.tds) address has been outsourced to Gmail for 
about five years. When this message returns to me Gmail will not discared it 
as a duplicate since they did not see it out bound. 

Only good solution I have found though it does cost $5 per month for hosting. 
Which I would have anyway just for my web site...
-- 
William
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org