-------- Original Message --------
From: Mark Dale via Mailman-Users [mailto:mailman-users@python.org]
Sent: Friday, March 5, 2021, 00:01 UTC
To: mailman-users@python.org
Subject: [Mailman-Users] Re: Pipermail scrubbing ascii txt to ksh attachment
>
> -------- Original Message --------
> From: Mark Sapiro [mailto:m...@msapiro.net]
> Sent: Thursday, March 4, 2021, 06:04 UTC
> To: mailman-users@python.org
> Subject: [Mailman-Users] Re: Pipermail scrubbing ascii txt to ksh attachment
>
>> On 3/3/21 3:36 PM, Mark Dale via Mailman-Users wrote:
>>> Hi Listers,
>>>
>>> I've got a client's list to which a plain text email notice is sent
>>> everyday.
>>>
>>> Mailman-Version: 2.1.34
>>> Postfix
>>> Debian 10
>>>
>>> The message contents are fairly similar each day and the text message
>>> renders in email clients just fine and the .mbox file reads fine also.
>>>
>>> However, Pipermail renders each archived message as a ".ksh" attachment.
>>>
>>>
>>> *****
>>>
>>> >From noreply at XXX.com Wed Mar 3 12:06:05 2021
>>> From: noreply at XXX.com (noreply at XXX.com)
>>> Date: Wed, 3 Mar 2021 07:06:05 -0500
>>> Subject: [XXX] XXX Published daily - 26097
>>> Message-ID: <202103031206.123C662K015222@XXX>
>>>
>>> An embedded and charset-unspecified text was scrubbed...
>>> Name: not available
>>> URL:
>>> <https://XXX/pipermail/XXX/attachments/20210303/06a36d4b/attachment.ksh>
>>>
>>> *****
>>>
>>> The message header contains:
>>>
>>> Content-Disposition: inline
>>> MIME-Version: 1.0
>>> X-Mailer: MIME::Lite 3.031 (F2.85; T2.17; A2.21; B3.15; Q3.13)
>>> ...
>>> Content-Type: text/plain; charset="us-ascii"
>>> Content-Transfer-Encoding: 7bit
>>>
>>>
>>> Could anyone point me in the right direction to get the archived
>>> messages to display their content as text in the message body instead of
>>> as an attachment?
>>
>> In order to help with this, I need to see the complete MIME structure of
>> the message. I.e. all the Content-Type: headers including the top level
>> and all the boundaries. This information for a message received from the
>> list is what I want to see as that's what Scrubber sees. Or the message
>> from the archives/private/listname.mbox/listname.mbox would do too.
>>
>> Scrubber should not be scrubbing the 'Content-Type: text/plain;
>> charset="us-ascii"' part with the message 'An embedded and
>> charset-unspecified text was scrubbed...'. Something else is going on here.
>>
>> The .ksh extension comes from the Python library
>> mime_types.guess_all_extensions, which returns the list
>>
>> ['.ksh', '.bat', '.h', '.txt', '.pl', '.c', '.asc', '.text', '.pot',
>> '.brf', '.srt']
>>
>> for text/plain and we arbitrarily pick the first one which is .ksh, but
>> we shouldn't be doing that with a text/plain part with a declared charset.
>>
>
> ======================
>
> Thanks Mark. I've copied the message from mbox file and pasted below.
> (the client's info is marked as redacted).
>
> Something I did notice: in the original received email headers I see:
>
> Content-Disposition: inline
> Content-Type: text/plain; charset="us-ascii"
> Content-Transfer-Encoding: 7bit
>
> And in the mbox file below (of the same message), I see:
>
> Content-Disposition: inline
> Content-Type: text/plain
> Content-Transfer-Encoding: quoted-printable
>
>
>
>
>>From noreply@REDACTED Thu Mar 4 12:04:42 2021
> Return-Path: <noreply@REDACTED>
> X-Original-To: REDACTED@lists.REDACTED
> Delivered-To: REDACTED@lists.REDACTED
> Received: from alln-iport-1.REDACTED (alln-iport-1.REDACTED [173.37.142.88])
> by mailmanlists.network (Postfix) with ESMTPS id EDCEB1FFCA
> for <REDACTED@lists.REDACTED>; Thu, 4 Mar 2021 12:04:41 +0000 (UTC)
> X-IPAS-Result: =?us-ascii?q?A0CcAgAZzEBgmJpdJa1iHgEBCxIMghGEL412pSQLAQEBD?=
> =?us-ascii?q?zQEAQGFBIFFAiU5BQ0CAwEBAQMCAwEBAQEFAQEBAgEGBBQBAQEBAQEBAYZDi?=
> =?us-ascii?q?TOCUoMIrWIBAQGCJok2gS2BOYsegiQmHIILgUQDgSiMExoEhVWNUAGREpt7h?=
> =?us-ascii?q?EiGco1JhkWDcp9kC4YsrEqEGoFsIIFZcIM6TxkNVY1jjk0jAQJnAgYKAQEDC?=
> =?us-ascii?q?YwTAQE?=
> X-IronPort-Anti-Spam-Filtered: true
> X-IronPort-AV: E=Sophos;i="5.81,222,1610409600"; d="scan'208";a="656725958"
> Received: from rcdn-core-3.REDACTED ([173.37.93.154])
> by alln-iport-1.REDACTED with ESMTP/TLS/DHE-RSA-SEED-SHA;
> 04 Mar 2021 12:04:41 +0000
> Received: from mail.vrt.REDACTED ([10.83.44.69])
> by rcdn-core-3.REDACTED (8.15.2/8.15.2) with SMTP id 124C4e83021704
> for <REDACTED@lists.REDACTED>; Thu, 4 Mar 2021 12:04:40 GMT
> Message-Id: <202103041204.124C4e83021704@rcdn-core-3.REDACTED>
> Received: from localhost.localdomain (sigmanager.vrt.REDACTED
> [10.7.89.25])
> by mail.vrt.REDACTED (Postfix) with ESMTP id 7E95E424D5
> for <REDACTED@lists.REDACTED>; Thu, 4 Mar 2021 12:04:40 +0000 (UTC)
> Content-Disposition: inline
> Content-Type: text/plain
> MIME-Version: 1.0
> X-Mailer: MIME::Lite 3.031 (F2.85; T2.17; A2.21; B3.15; Q3.13)
> Date: Thu, 4 Mar 2021 07:04:40 -0500
> From: noreply@REDACTED
> To: REDACTED@lists.REDACTED
> Content-Transfer-Encoding: quoted-printable
> X-Outbound-SMTP-Client: 10.83.44.69, [10.83.44.69]
> X-Outbound-Node: rcdn-core-3.REDACTED
> Subject: [REDACTED] Signatures Published daily - 26098
> X-BeenThere: REDACTED@lists.REDACTED
> X-Mailman-Version: 2.1.34
> Precedence: list
> List-Id: REDACTED announcements <REDACTED.lists.REDACTED>
> List-Unsubscribe: <https://lists.REDACTED/mailman/options/REDACTED>,
> <mailto:REDACTED-request@lists.REDACTED?subject=unsubscribe>
> List-Archive: <https://lists.REDACTED/pipermail/REDACTED/>
> List-Post: <mailto:REDACTED@lists.REDACTED>
> List-Help: <mailto:REDACTED-request@lists.REDACTED?subject=help>
> List-Subscribe: <https://lists.REDACTED/mailman/listinfo/REDACTED>,
> <mailto:REDACTED-request@lists.REDACTED?subject=subscribe>
> X-List-Received-Date: Thu, 04 Mar 2021 12:04:42 -0000
>
>
> REDACTED Signature Publishing Notice
>
> Datefile: daily
> Version: 26098
> Publisher: REDACTED
> New Sigs: 269
> Dropped Sigs: 36
> Ignored Sigs: 73
>
>
> ------------------------------------------------------
FWIW, using Thunderbird I posted the contents of the original email to a
test list (on the same server, with the same lists configs) and as
expected the archived message displays correctly as a plaintext email.
The headers this time show as:
=== FROM EMAIL HEADER
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
=== FROM MBOX
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
------------------------------------------------------
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/
