Re: [Mailman-Users] Internet Message Format: Identification Fields

2014-06-24 Thread Stephen J. Turnbull
Richard Damon writes:

 > The internet protocols disagree on that minor modification create a new 
 > email.

No, they don't.  There's only one RFC that matters, and that's RFC
5322 (or whichever version of that standard that you prefer, but on
this they're basically in agreement).  RFC 5322 says:

In all cases, it is the meaning that the sender of the message
wishes to convey (i.e., whether this is the same message or a
different message) that determines whether or not the
"Message-ID:" field changes, not any particular syntactic
difference that appears (or does not appear) in the message.

Here, "Sender" is ambiguous, it could be the OP or it could be
Mailman.  I think that since Mailman actually accepts the message and
then decides whether or not to reinject it and in what form, probably
Mailman is the sender referred to.

In that sense, if willi really wants to give the message a new
Message-Id, he may do that in conformance to the RFC.  That is a
statement on his part that his administrative needs override the risk
to the users of the list, and that the list "owns" the posts it
transmits.

It's possible to imagine a situation where the risk is quite minimal.
For example an announce list, or a list where only the list is allowed
to appear among the addressees (but in the latter case the list can't
know whether there were Bccs, so the risk is non-zero).

The Mailman developer community considers that the role of Mailman is
to convey the original poster's message to the users, in accordance
with list policy, but that the "message content" should remain
unchanged if the message is distributed at all.  For that reason, most
of us feel strongly that the Mailman program as distributed by the
project should never change the Message-Id.[1]

Mailman could add Resent-Message-Id (and other Resent-* headers) but
in default configuration at least it doesn't.  Still that wouldn't
help to address the GMail MUA design issue.

willi writes:

 > > But, please, let us discuss more about the principles. I don't analyse 
 > > the sources from mailman and thunderbird to know on what points they 
 > > use the message-id for what process. What header-fields use 
 > > thunderbird for thread-ordering? Maybe, on this list read some people 
 > > from the thunderbird developer group or from other mailtools to 
 > > explain the needs.

MUA developers mostly don't hang out here.  As far as I know they all
agree that Mailman does the right thing for them (as list users) and
for their users, so they're not interested in Mailman development.  I
suspect that if Mailman started changing Message-Id, they'd show up in
force. ;-)

As far as I know all modern MUAs such as ThunderBird, Evolution,
GMail, Yahoo! Mail, SquirrelMail, etc use Message-Id, References, and
In-Reply-To for threading.  I am certain that archiving programs (such
as Mailman's Pipermail) and services like GMane and Mail-Archive.com do.

 > > The message-id should be a unique id for a mail. The mail is a
 > > combination of the header and body. This two parts together build
 > > the specific mail. If you change one part, you create a new mail.

No, that's definitely an incorrect reading of RFC 5322.  See above.


Footnotes: 
[1]  Although we may *add* one if somehow one arrives at Mailman
without a Message-Id -- but this is extremely rare, as modern MTAs
almost always add a Message-Id on the way to Mailman.

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Internet Message Format: Identification Fields

2014-06-24 Thread Richard Damon
The internet protocols disagree on that minor modification create a new 
email. For instance, EVERY step of mail deliver is REQUIRED to change 
the headers of the message, so that would say every step should change 
the Message-ID, which distorts some of its use.


The RFC's also say that if a message is received and immediately 
automatically forwarded, that is should retain the same Message-id.


The case where changing the Message-ID like you are proposing will cause 
problems is this:


A message is posted to the list.

A person replies with a reply all, sending a reply directly to the 
original poster, and to the list, and asks the list for a new Message-ID


Copies of that reply now exist with two different Message-Ids

If the original poster now replies to the direct copy they got back to 
the list, the Reference headers will not point to the message it got 
that he replied to, so threading for ALL other members is broken.


The problem being tried to solve is an unusual behavior by a given MUA. 
You don't break a fundamental rule of email to solve that problem, you 
get the MUA to behave the way you want, or change MUA.


On 6/24/14, 9:50 AM, willi uebelherr wrote:


Dear William and Mark and all,

many thanks for your answer. I understand, that never you want to make 
any special action for a specific task for Gmail.


But now, for me it is not a question of the specific "duplicate 
suppression" from google-mail. it is a more general debate about the 
principles of "Internet Message Format".


i have have now many alternatives.
1) the proposal from Richard Damon
2) a second account on gmail
3) a non-gmail account like gmx (i have) or a new riseup account

Many thanks for your proposals.

But, please, let us discuss more about the principles. I don't analyse 
the sources from mailman and thunderbird to know on what points they 
use the message-id for what process. What header-fields use 
thunderbird for thread-ordering? Maybe, on this list read some people 
from the thunderbird developer group or from other mailtools to 
explain the needs.


The message-id should be a unique id for a mail. The mail is a 
combination of the header and body. This two parts together build the 
specific mail. If you change one part, you create a new mail.


Following of that, if mailman change the subject line or append a 
footer, it is a new mail and need a new message-id. Consequently, we 
can say, if the header of a mail is extended on his way from one 
client to the other client, an all chainpoints there are creating a 
new mail. Because they axtend the header with header fields for the 
in/out nodes.


This is the result of the logic of the RFC 5322.

I know, in our time we have a confuse situation. Many things from our 
history overlaped this logic. And the people for one single project 
are not part of the whole project, the mail processing in the 
internet. They work seperated and sometimes against.


We can see, that hotmail create a wrong message-id in relation to RFC 
5322. But is the syntactical structure important? I think no. Only the 
uniqueness, the singularity, is important.


In my thinking i prefer that mailman can be a reference implementation 
for maillist-server. Because in principial, only a Open Source project 
can can fulfill this function. But this makes it necessary to reflect 
our own doing and to discuss the process algorithms on a open and free 
base. Committed only the basic fundamentals.


And what i read from Mark i see, that he act in a personal defense 
against Gmail. And that is not good. I had the same positiob before. 
But now, i changed my thinking. I see, that the argumentation from 
bkennely is correct. And this is independent from, that he work for 
Google Gmail.


mant thanks and many greetings, willi
Panama City


--
Richard Damon

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Internet Message Format: Identification Fields

2014-06-24 Thread willi uebelherr


Dear William and Mark and all,

many thanks for your answer. I understand, that never you want to make 
any special action for a specific task for Gmail.


But now, for me it is not a question of the specific "duplicate 
suppression" from google-mail. it is a more general debate about the 
principles of "Internet Message Format".


i have have now many alternatives.
1) the proposal from Richard Damon
2) a second account on gmail
3) a non-gmail account like gmx (i have) or a new riseup account

Many thanks for your proposals.

But, please, let us discuss more about the principles. I don't analyse 
the sources from mailman and thunderbird to know on what points they use 
the message-id for what process. What header-fields use thunderbird for 
thread-ordering? Maybe, on this list read some people from the 
thunderbird developer group or from other mailtools to explain the needs.


The message-id should be a unique id for a mail. The mail is a 
combination of the header and body. This two parts together build the 
specific mail. If you change one part, you create a new mail.


Following of that, if mailman change the subject line or append a 
footer, it is a new mail and need a new message-id. Consequently, we can 
say, if the header of a mail is extended on his way from one client to 
the other client, an all chainpoints there are creating a new mail. 
Because they axtend the header with header fields for the in/out nodes.


This is the result of the logic of the RFC 5322.

I know, in our time we have a confuse situation. Many things from our 
history overlaped this logic. And the people for one single project are 
not part of the whole project, the mail processing in the internet. They 
work seperated and sometimes against.


We can see, that hotmail create a wrong message-id in relation to RFC 
5322. But is the syntactical structure important? I think no. Only the 
uniqueness, the singularity, is important.


In my thinking i prefer that mailman can be a reference implementation 
for maillist-server. Because in principial, only a Open Source project 
can can fulfill this function. But this makes it necessary to reflect 
our own doing and to discuss the process algorithms on a open and free 
base. Committed only the basic fundamentals.


And what i read from Mark i see, that he act in a personal defense 
against Gmail. And that is not good. I had the same positiob before. But 
now, i changed my thinking. I see, that the argumentation from bkennely 
is correct. And this is independent from, that he work for Google Gmail.


mant thanks and many greetings, willi
Panama City



Am 06/23/2014 07:11 p.m., schrieb William Bagwell:

On Monday 23 June 2014, Mark Sapiro wrote:

Your choice is clear to me. If you don't like the way Gmail handles your
list posts, subscribe and post from a non-gmail address.


Mark, off topic for *this* list though you might want to add this to the FAQ?

willi, some web hosting servers will allow customers to post outgoing mail
with any address you own. Even if it does not match the domain you have
hosted with them. My ISP (.tds) address has been outsourced to Gmail for
about five years. When this message returns to me Gmail will not discared it
as a duplicate since they did not see it out bound.

Only good solution I have found though it does cost $5 per month for hosting.
Which I would have anyway just for my web site...


--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Internet Message Format: Identification Fields

2014-06-23 Thread William Bagwell
On Monday 23 June 2014, Mark Sapiro wrote:
> Your choice is clear to me. If you don't like the way Gmail handles your
> list posts, subscribe and post from a non-gmail address.

Mark, off topic for *this* list though you might want to add this to the FAQ?

willi, some web hosting servers will allow customers to post outgoing mail 
with any address you own. Even if it does not match the domain you have 
hosted with them. My ISP (.tds) address has been outsourced to Gmail for 
about five years. When this message returns to me Gmail will not discared it 
as a duplicate since they did not see it out bound. 

Only good solution I have found though it does cost $5 per month for hosting. 
Which I would have anyway just for my web site...
-- 
William
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


Re: [Mailman-Users] Internet Message Format: Identification Fields

2014-06-23 Thread Mark Sapiro
On 06/23/2014 08:59 AM, willi uebelherr wrote:
> 
> 
> The easest way would be a configuratin point for the user to decide,
> that his sended mail get a new message-id, if the listserver changed it
> when he send the mail. And this he always do it.


We have no plans or interest to change Mailman in this way for reasons
already stated on this list.

Your issue is with Gmail's "discard duplicate message" feature, which we
don't agree with except perhaps as a Gmail user setting, but Google has
no plan to change this as far as we know.

Your choice is clear to me. If you don't like the way Gmail handles your
list posts, subscribe and post from a non-gmail address.

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org


[Mailman-Users] Internet Message Format: Identification Fields

2014-06-23 Thread willi uebelherr


Dear friends,

following the RFC 5322 all identification fields are optional. But they 
SHOULD have it. Of course, sometimes we need it.


RFC 5322: Internet Message Format
http://tools.ietf.org/html/rfc5322

We have min 3 fields:
message-id
in-reply-to
references

With that, we can create all ordering of mails based on a thread. I 
think, it would be never a problem to use a new (little changed) 
message-id, because if the listserver send the mail, he changed it. And 
consequently, he create a new message-id (but for himself and for 
tracking it can be a modification of the original message-id).


In the discussion on this list Mark and other people args, this would 
lead to a big confusion for the different mail clients. Is that true? I 
don't have the necessary oversight. But i think, you have it.


The easest way would be a configuratin point for the user to decide, 
that his sended mail get a new message-id, if the listserver changed it 
when he send the mail. And this he always do it.


many greetings, willi
Panama City

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org