Re: [Mailman-Users] Scrub_nondigest questions
On 06/22/2014 05:21 PM, Peter Shute wrote: We're considering enabling the scrub_nondigest option for our list. The aim is to allow members to send jpg files to the list (currently filtered) and have mailman include a link to them in messages instead of the actual attachment. I've got a few questions about how this works. I believe it will store the scrubbed images in the archives. We have archiving turned off. Do we need to turn them on to allow the images to be placed there, or will it happen anyway? It will happen anyway. Archiving for the list doesn't need to be enabled. Once we have images stored in the archives, how easy is it for members to access them when they click on the links in the messages? Will they need a password to see them? If and only if the list's archive_private setting is private, but since archiving is Off, if you want scrubbed attachments accessible without autnentication, just set archive_private to public. Will we be able to selectively delete images when our disk space begins to fill up? Or will they all be stored in a single archive file? We're using cpanel, if that matters. I don't think cPanel is different. The attachments for a message are stored individually in the directory archives/private/LISTNAME/attachments/mmdd//. mmdd is the date and is a hash of the message, so you can delete individual files or the directory for all attachments for a single message or the mmdd directory for all attachments from a given day. If anyone who's using this option could forward me a message from their list with a linked image so I can check how well it works, that would be greatly appreciated. Why not just try it yourself on a test list? -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Scrub_nondigest questions
On 23 Jun 2014, at 4:08 pm, Mark Sapiro m...@msapiro.net wrote: Will we be able to selectively delete images when our disk space begins to fill up? Or will they all be stored in a single archive file? We're using cpanel, if that matters. I don't think cPanel is different. The attachments for a message are stored individually in the directory archives/private/LISTNAME/attachments/mmdd//. mmdd is the date and is a hash of the message, so you can delete individual files or the directory for all attachments for a single message or the mmdd directory for all attachments from a given day. Any idea if we'll have access to that area in cPanel? I'm not the list owner, I can't test it for myself. And does the value of archive_volume_frequency affect where they're stored? If anyone who's using this option could forward me a message from their list with a linked image so I can check how well it works, that would be greatly appreciated Thanks for sending the sample. Peter Shute -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Scrub_nondigest questions may be attachment-move custom handler
I was testing that for you a few weeks ago. I just tried again, and it seems to work smoothly now. Could that be made to automatically resize images? E.g. maximum dimensions 800x800 pixels. Peter Shute Sent from my iPad On 23 Jun 2014, at 7:30 pm, Sylvain Viart sylv...@opensource-expert.com wrote: Hi Peter, I programmed a custom handler that complete or replace Scrub_nondigest handler: AttachmentMove You can test or try it here: http://mailman.opensource-expert.com/mailman/listinfo/attachment-move Hosting in done in France and could be slow to reach from foreign countries. This running version is not commited yet, minor i8n changes. It's also working in production of a customer with a list of 930 subscribers since 3 weeks. The code and the doc : https://github.com/Sylvain303/mailman-AttachmentMove Le 23/06/2014 10:03, Peter Shute a écrit : If anyone who's using this option could forward me a message from their list with a linked image so I can check how well it works, that would be greatly appreciated AttachmentMove keeps embedded images, they could be moved as well. The remote hosting for attachment can be same or a different one that the server running mailman. To reply to your first post: We're considering enabling the scrub_nondigest option for our list. The aim is to allow members to send jpg files to the list (currently filtered) and have mailman include a link to them in messages instead of the actual attachment. That is the purpose of AttachmentMove. I believe it will store the scrubbed images in the archives. We have archiving turned off. Do we need to turn them on to allow the images to be placed there, or will it happen anyway? Attachment are stored locally and on a remote hosting. The local storage (on the mailman server) is not the archive. And it is used to avoid duplicate file name when uploaded on the webserver. Once we have images stored in the archives, how easy is it for members to access them when they click on the links in the messages? Will they need a password to see them? AttachmentMove, publish the image on a different hosting no password are required, the goal was to keeps user away for technical details. Will we be able to selectively delete images when our disk space begins to fill up? Or will they all be stored in a single archive file? We're using cpanel, if that matters. Not storage management is coded yet, a cron with the good find -mtime could do the trick. It's in my idea to handle that too. If anyone who's using this option could forward me a message from their list with a linked image so I can check how well it works, that would be greatly appreciated. I sent you an example we have made on the test list. Let me know if that meet your needs. Regards, Sylvain. -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Scrub_nondigest questions may be attachment-move custom handler
Hi Peter, I programmed a custom handler that complete or replace Scrub_nondigest handler: AttachmentMove You can test or try it here: http://mailman.opensource-expert.com/mailman/listinfo/attachment-move Hosting in done in France and could be slow to reach from foreign countries. This running version is not commited yet, minor i8n changes. It's also working in production of a customer with a list of 930 subscribers since 3 weeks. The code and the doc : https://github.com/Sylvain303/mailman-AttachmentMove Le 23/06/2014 10:03, Peter Shute a écrit : If anyone who's using this option could forward me a message from their list with a linked image so I can check how well it works, that would be greatly appreciated AttachmentMove keeps embedded images, they could be moved as well. The remote hosting for attachment can be same or a different one that the server running mailman. To reply to your first post: We're considering enabling the scrub_nondigest option for our list. The aim is to allow members to send jpg files to the list (currently filtered) and have mailman include a link to them in messages instead of the actual attachment. That is the purpose of AttachmentMove. I believe it will store the scrubbed images in the archives. We have archiving turned off. Do we need to turn them on to allow the images to be placed there, or will it happen anyway? Attachment are stored locally and on a remote hosting. The local storage (on the mailman server) is not the archive. And it is used to avoid duplicate file name when uploaded on the webserver. Once we have images stored in the archives, how easy is it for members to access them when they click on the links in the messages? Will they need a password to see them? AttachmentMove, publish the image on a different hosting no password are required, the goal was to keeps user away for technical details. Will we be able to selectively delete images when our disk space begins to fill up? Or will they all be stored in a single archive file? We're using cpanel, if that matters. Not storage management is coded yet, a cron with the good find -mtime could do the trick. It's in my idea to handle that too. If anyone who's using this option could forward me a message from their list with a linked image so I can check how well it works, that would be greatly appreciated. I sent you an example we have made on the test list. Let me know if that meet your needs. Regards, Sylvain. -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Scrub_nondigest questions may be attachment-move custom handler
Hi Peter, Le 23/06/2014 12:57, Peter Shute a écrit : I was testing that for you a few weeks ago. I just tried again, and it seems to work smoothly now. That's true, thanks. :-) You did just send a non html mail, right? AttachmentMove also support html formating. Could that be made to automatically resize images? E.g. maximum dimensions 800x800 pixels. Yes it could. At the stage where the image is detached it can be manipulated, including stored on some image cloud storage with other feature, like albums for example. Given that storage as an API that a programmer can use to store the image remotely. With linux server there's plenty of tools for resizing image, with and without python. If you don't need the remote simplification of AttachmentMove, you may also look at ThunderBird cloud storage FileLink extension. Regards, Sylvain. -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Internet Message Format: Identification Fields
Dear friends, following the RFC 5322 all identification fields are optional. But they SHOULD have it. Of course, sometimes we need it. RFC 5322: Internet Message Format http://tools.ietf.org/html/rfc5322 We have min 3 fields: message-id in-reply-to references With that, we can create all ordering of mails based on a thread. I think, it would be never a problem to use a new (little changed) message-id, because if the listserver send the mail, he changed it. And consequently, he create a new message-id (but for himself and for tracking it can be a modification of the original message-id). In the discussion on this list Mark and other people args, this would lead to a big confusion for the different mail clients. Is that true? I don't have the necessary oversight. But i think, you have it. The easest way would be a configuratin point for the user to decide, that his sended mail get a new message-id, if the listserver changed it when he send the mail. And this he always do it. many greetings, willi Panama City -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] DMARC handler
On 6/21/2014 8:24 PM, Mark Sapiro wrote: On 06/21/2014 04:04 PM, Ron Guerin wrote: I'm struggling to find a palatable solution to the configuration of a list, and the new Yahoo-style DMARC problem. The list has mung on, as well as Reply-To: set to the list. The end result is nowhere does the original sender's address appear in the messages, when having them readily visible is the desired behavior. In Mailman 2.1.18-1, the posters address will also be in Reply-To: with Reply-To: set to the list. In Mailman 2.1.16 and 2.1.17, this wasn't the case (I think only if first_strip_reply_to was Yes). I was wondering about asking someone to make a Mailman handler that would re-write the From: address after munging to: Jane Doe (j...@example.com) via listname l...@example.net My question now is, is there any reason why re-writing it this way would be a bad idea? Yes. According to http://www.dmarc.org/supplemental/mailman-project-mlm-dmarc-reqs.html: The inclusion of more than one domain in the RFC5322.From field is dangerous. Recent studies by two major senders show that ~95% of all cases in which there is one domain in the RFC5322.From display name and different domain in the RFC5322.From address-spec are fraudulent. This practice should be discouraged as there are efforts underway to increase spam scores within inbound filtering when this is detected. I've been absorbing a lot of input about this and while the part of me that just wants to get things done still likes the idea of putting the address into the comment field, I'm finding the argument persuasive that as soon as people /expect/ to find a valid address in the comment field, the cold clammy hands of DMARC will choke that off too. I don't find the argument /valid/ mind you, as the comment field is the comment field, and no MUA (save ones with a very specific bug) are ever going to treat it as anything but a commment, but I completely believe that anything that reduces the pain of DMARC will eventually run afoul of DMARC. Now you tell me that it's actually a useful indicator of spamminess. That feels like the last nail in the coffin. But, on the other hand, that's exactly what Yahoo Groups is doing, so take your pick. If having the poster's address in Reply-To: would be satisfactory, try setting first_strip_reply_to to No. That may be the least objectionable solution that's still DMARC-friendly, but then I'm probably annoying subscribers who aren't using DMARC to reject mail their users asked for. Changing CookHeaders to munge the from as you suggest is a very simple patch. I have attached a 2.1.16/17 version. Note that even with this patch, the bug at https://bugs.launchpad.net/mailman/+bug/1304511 is not completely fixed. Also note John's objection won't apply as this will be formatted as Jane Doe j...@example.com via listname l...@example.net I had it in my mind before he mentioned it that I'd have to look into what triggers quoting of the comment field, but his input reassures me that it's not likely to cause other problems from a technical standpoint. From a social standpoint though, it seems to be an idea living on borrowed time. I would really like to do, as someone said earlier, just say Friends don't let Friends use Yahoo or AOL Mail. But count me in with those expecting Gmail to be next. That's nearly half the subscribers of the list I've been asking in regard to. And thanks for sending code again, you're the best! - Ron -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
[Mailman-Users] Users with utf-8
I try to add member to maillist. ./add_members -r filename.txt listname in the file filename.txt it will exist a user like Lönn l...@gmail.com # Written as utf-8 When I look at memberlist afterwards at the web will it look like l...@gmail.com Lönn# Written the utf-8 as two characters What is the problem and what is the solution /LeSve -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Scrub_nondigest questions
On 06/23/2014 01:03 AM, Peter Shute wrote: Any idea if we'll have access to that area in cPanel? I'm not the list owner, I can't test it for myself. It depends. In cPanel all Mailman files including the archives/private/ directory are in /usr/local/cpanel/3rdparty/mailman/. If this is the list owner's server or VPS, etc, he probably has the required access. If his is one of multiple hosted domains on a shared server, he almost certainly doesn't. And does the value of archive_volume_frequency affect where they're stored? No. If anyone who's using this option could forward me a message from their list with a linked image so I can check how well it works, that would be greatly appreciated Thanks for sending the sample. You're welcome. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Internet Message Format: Identification Fields
On 06/23/2014 08:59 AM, willi uebelherr wrote: The easest way would be a configuratin point for the user to decide, that his sended mail get a new message-id, if the listserver changed it when he send the mail. And this he always do it. We have no plans or interest to change Mailman in this way for reasons already stated on this list. Your issue is with Gmail's discard duplicate message feature, which we don't agree with except perhaps as a Gmail user setting, but Google has no plan to change this as far as we know. Your choice is clear to me. If you don't like the way Gmail handles your list posts, subscribe and post from a non-gmail address. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Users with utf-8
On 06/23/2014 01:29 PM, just.mail...@lesve.org wrote: I try to add member to maillist. ./add_members -r filename.txt listname in the file filename.txt it will exist a user like Lönn l...@gmail.com # Written as utf-8 When I look at memberlist afterwards at the web will it look like l...@gmail.com Lönn# Written the utf-8 as two characters What is the problem and what is the solution The problem is Mailman's character set for the list's preferred_language is not utf-8, and the input files for add_members need to be encoded in Mailman's character set for the list's preferred_language. If you don't know Mailman's character set for the list's preferred language, see lines 1578 through 1616 at http://bazaar.launchpad.net/~mailman-coders/mailman/2.1/view/head:/Mailman/Defaults.py.in. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Scrub_nondigest questions
On 24 Jun 2014, at 8:56 am, Mark Sapiro m...@msapiro.net wrote: On 06/23/2014 01:03 AM, Peter Shute wrote: Any idea if we'll have access to that area in cPanel? I'm not the list owner, I can't test it for myself. It depends. In cPanel all Mailman files including the archives/private/ directory are in /usr/local/cpanel/3rdparty/mailman/. If this is the list owner's server or VPS, etc, he probably has the required access. If his is one of multiple hosted domains on a shared server, he almost certainly doesn't. Ours is hosted. In this situation, what does one normally do? Ask the hosting company to delete them? Peter Shute -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Scrub_nondigest questions
On 06/23/2014 05:01 PM, Peter Shute wrote: It depends. In cPanel all Mailman files including the archives/private/ directory are in /usr/local/cpanel/3rdparty/mailman/. If this is the list owner's server or VPS, etc, he probably has the required access. If his is one of multiple hosted domains on a shared server, he almost certainly doesn't. Ours is hosted. In this situation, what does one normally do? Ask the hosting company to delete them? Why bother? This file system belongs to the host. If it gets too full (unlikely), it's their problem. If they have some way of charging you for disk usage attributable to your list, then they should accommodate a request to remove some. -- Mark Sapiro m...@msapiro.netThe highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org
Re: [Mailman-Users] Internet Message Format: Identification Fields
On Monday 23 June 2014, Mark Sapiro wrote: Your choice is clear to me. If you don't like the way Gmail handles your list posts, subscribe and post from a non-gmail address. Mark, off topic for *this* list though you might want to add this to the FAQ? willi, some web hosting servers will allow customers to post outgoing mail with any address you own. Even if it does not match the domain you have hosted with them. My ISP (.tds) address has been outsourced to Gmail for about five years. When this message returns to me Gmail will not discared it as a duplicate since they did not see it out bound. Only good solution I have found though it does cost $5 per month for hosting. Which I would have anyway just for my web site... -- William -- Mailman-Users mailing list Mailman-Users@python.org https://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://wiki.list.org/x/AgA3 Security Policy: http://wiki.list.org/x/QIA9 Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: https://mail.python.org/mailman/options/mailman-users/archive%40jab.org