Re: Urls containing "@" screwed up in archived Mails
>The interesting question: is it possible? Are the originating > mails stored so that the visible html can be repaired? A mathematician, a physicist, and an engineer walk into a bar. The mathematician says "The raw mail exists even the old stuff is in offline cold storage. It can be matched by message-id against the HTML files and therefore it is possible. Q.E.D. Next problem, please?" . The physicist says, "I bet some of the decade old raw mail will be hard to find. And regeneration with URL preservation will take some serious hacking. Never been done before, tricky, and will require experimentation. But that's what we live for. Give me a small team of bright people and we can solve this problem in six months." The engineer says "Fredrich, do you have a specific URL in mind that you really want fixed? If so, I'll go spend 30 seconds and fix it by hand." The bartender looks at the three sorry customers and says, "Guys. Guys. Your mailto: links are still broken."
Re: Urls containing "@" screwed up in archived Mails
Hi Christian, *, Christian Lohmaier schrieb: > On Sun, Dec 12, 2010 at 1:03 PM, Friedrich Strohmaier > wrote: [..] >> The initial posting's broken link remains broken: >> http://www.mail-archive.com/discuss%40documentfoundation.org/msg00453.html > I personally did not expect all indexed mails to be regenerated. I would. The interesting question: is it possible? Are the originating mails stored so that the visible html can be repaired? Gruß/regards -- Friedrich Libreoffice-Box http://libreofficebox.org/ LibreOffice and more on CD/DVD images (german version already started) -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Hi *, On Sun, Dec 12, 2010 at 1:03 PM, Friedrich Strohmaier wrote: > Hi Jeff, *, > > Jeff Breidenbach schrieb: > >>> ((?:cid:)?|(?:(?:http://(?:www\.)?)?mail-archive\.com/)?)($AddrExp) > >>Tested and live. Thanks guys. Thanks a lot! > The initial posting's broken link remains broken: > http://www.mail-archive.com/discuss%40documentfoundation.org/msg00453.html I personally did not expect all indexed mails to be regenerated. ciao Christian -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Hi Jeff, *, Jeff Breidenbach schrieb: >> ((?:cid:)?|(?:(?:http://(?:www\.)?)?mail-archive\.com/)?)($AddrExp) >Tested and live. Thanks guys. The initial posting's broken link remains broken: http://www.mail-archive.com/discuss%40documentfoundation.org/msg00453.html Does this mean that's true for all already broken links? Are mails irreversibly crippled while beeing archived? Gruß/regards -- Friedrich Libreoffice-Box http://libreofficebox.org/ LibreOffice and more on CD/DVD images (german version already started) -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
>You could also add the prefix to the method, as alternative to the >already existing cid case. >((?:cid:)?|(?:(?:http://(?:www\.)?)?mail-archive\.com/)?)($AddrExp) Thank you, Christian. Sending this guinea pig to make sure it works as expected. Test data below: [email protected] http://[email protected] mailto:[email protected] http://www.mail-archive.com/[email protected]/msg01358.html http://www.mail-archive.com/[email protected]/ http://www.mail-archive.com/[email protected] http://mail-archive.com/[email protected]/msg01358.html http://mail-archive.com/[email protected]/ http://mail-archive.com/[email protected] http://www.mail-archive.com/[email protected]/msg19258.html http://www.mail-archive.com/[email protected]/ http://www.mail-archive.com/[email protected] http://mail-archive.com/[email protected]/msg19258.html http://mail-archive.com/[email protected]/ http://mail-archive.com/[email protected] http://mail-archive.com/talk-it%40openstreetmap.org -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
> ((?:cid:)?|(?:(?:http://(?:www\.)?)?mail-archive\.com/)?)($AddrExp) Tested and live. Thanks guys.
Re: Urls containing "@" screwed up in archived Mails
Hi Jeff, *, Jeff Breidenbach schrieb: > There are two cases that are very common and handled poorly. One > is an http hyperlink to mail-archive.com as we've been discussing. > The other is a a mailto hyperlink. These are correctly obfuscated, > but end up as a broken link. Better to not have a link than a broken > one. Agreed. > http://www.mail-archive.com/[email protected]/msg01612.html > I'm wary of preserving things that look like email addresses in other > ftp | rsync | http URLs. Mainly because these might be actual email > addresses. > Aside from address harvesting spambot issues, they can generate very > vocal complaints by folks searching for their email address in global > search engines. What case do You expect a private mailadress getting part of one of the URLs pointed out? I don't have any idea where and how this can happen. > I'm happy to patch mhonarc, and impressed by all the energy on this > thread. For me working links are a killer feature to use mail-archive.com as reference in any kind of mail I write. It's less work to go to the mailinglist's generic archive than to rework complaints for broken links. Gruß/regards -- Friedrich Libreoffice-Box http://libreofficebox.org/ LibreOffice and more on CD/DVD images (german version already started) -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Well then - if you want to obfuscate anything that looks like an
email address EXCEPT an email address representing one of the 5000+
lists being archived here, then really the only way to do that is
to have a hash of all the list addresses and check for those in the
section.
if ($ENV{'MAILLIST'} eq $address) {
then becomes
if ( exists( $MailLists{$address} ) ) {
John
On Fri, 10 Dec 2010, Jeff Breidenbach wrote:
> There are two cases that are very common and handled poorly. One
> is an http hyperlink to mail-archive.com as we've been discussing.
> The other is a a mailto hyperlink. These are correctly obfuscated,
> but end up as a broken link. Better to not have a link than a broken one.
>
>
> http://www.mail-archive.com/[email protected]/msg01612.html
>
>
> I'm wary of preserving things that look like email addresses in other
> ftp | rsync | http URLs. Mainly because these might be actual email
> addresses. Aside from address harvesting spambot issues, they
> can generate very vocal complaints by folks searching for their email
> address in global search engines.
>
>
> I'm happy to patch mhonarc, and impressed by all the energy on this
> thread.
>
>
> -Jeff
--
To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
There are two cases that are very common and handled poorly. One is an http hyperlink to mail-archive.com as we've been discussing. The other is a a mailto hyperlink. These are correctly obfuscated, but end up as a broken link. Better to not have a link than a broken one. http://www.mail-archive.com/[email protected]/msg01612.html I'm wary of preserving things that look like email addresses in other ftp | rsync | http URLs. Mainly because these might be actual email addresses. Aside from address harvesting spambot issues, they can generate very vocal complaints by folks searching for their email address in global search engines. I'm happy to patch mhonarc, and impressed by all the energy on this thread. -Jeff
Re: Urls containing "@" screwed up in archived Mails
(12/10/2010 02:31 PM), Friedrich Strohmaier wrote: >> IIRC, the source of this discussion was that a URL that >> uses an @ was getting munged. If this is not desired, >> the author can use %40 in the URL and this will bypass >> the filtering done by M-A. > > Shure, we will succeed to convince all authors of listmails archived in > mail-archive.com to change every link referring to another yet archived > mail that way? I can't believe. Besides, not all instances can be escaped. It has a semantic meaning for URLs, when it occurs before the hostname; it may not be common, but surely once in a while someone posts a URL that includes a username/password combo (presumably one that is okay to appear in public archives)... at least in examples at any rate. -- Micah J. Cowan http://micah.cowan.name/ -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Hi Earl, *, Did You read the mails? Earl Hood schrieb: > On Fri, Dec 10, 2010 at 3:45 PM, Friedrich Strohmaier wrote: >>> Once can avoid the munging on the authoring side be URL escaping >>> the @ character with %40 >> shure harvesters don't know the trick? :o)) > IIRC, the source of this discussion was that a URL that > uses an @ was getting munged. If this is not desired, > the author can use %40 in the URL and this will bypass > the filtering done by M-A. Shure, we will succeed to convince all authors of listmails archived in mail-archive.com to change every link referring to another yet archived mail that way? I can't believe. >>> As for modify mhonarc source code, not sure if the M-A folks >>> want to deal with maintaining a custom version of mhonarc to >>> address this issue. >> Is there any module handling this issue? > There is some API facilities to provide custom filtering. > The mhonarc documentation provides the details. I mailed here for reason of strange way mail-archive.com shows weblinks containing an emailaddress part. Christian did some investigation to provide a patch. I'm far from developing modules for mhonarc. Gruß/regards -- Friedrich Libreoffice-Box http://libreofficebox.org/ LibreOffice and more on CD/DVD images (german version already started) -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Hi Earl, *, Earl Hood schrieb: > On Fri, Dec 10, 2010 at 1:42 PM, Friedrich Strohmaier wrote: >>> You could also add the prefix to the method, as alternative to the >>> already existing cid case. >>> ((?:cid:)?|(?:(?:http://(?:www\.)?)?mail-archive\.com/)?)($AddrExp) >>> This one should work in any case (but I didn't test it) >> This also is my favorite - simply because the only one having >> understood entirely ;o)). >> remains the question whether it makes sense to restrict on >> mail-archive.com because I think any (http:|ftp:|rsync:) URL >> containing an emailadress part should stay untouched. Might be >> interesting whether/how many of these occur in the whole archive. > Doing this will allow others to post email addresses of people to > be targeted by address harvesters. I intended talking from mail adresses as part of an URL. Mailadresses hit by the mhonarc regex will continued to be obfuscated. But I apparently didn't succeed. > Once can avoid the munging on the authoring side be URL escaping > the @ character with %40 shure harvesters don't know the trick? :o)) > As for modify mhonarc source code, not sure if the M-A folks > want to deal with maintaining a custom version of mhonarc to > address this issue. Is there any module handling this issue? I don't think they have to deal with, if they don't want. We are on our own then. > They could disable modifybodyaddresses resource and have > their own pre-filter to protect mail-archive URLs in messages. That's what's happening, if the patch is accepted. Don't get the point of this. Gruß/regards -- Friedrich Libreoffice-Box http://libreofficebox.org/ LibreOffice and more on CD/DVD images (german version already started) -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Hi Christian, *,
Christian Lohmaier schrieb:
[...]
> I had a quick look at MHonArc sources and there are two possible
> points where the behavriour can be tweaked.
> One is the expression that identifies email-addresses in lib/mhinit.pl
[.. cleaning classes, running to a mirror to look whether there remained
some colour in the eyes ;o)) ..]
> the non-grouping is important, as it later is used in lib/mhopt.pl
> (the second point to tackle it) like this:
>## Check if rewriting addresses in bodies
>if ($AddrModifyBodies) {
>$readmail::TextPreFilter = sub {
>my $fields = shift;
>my $data_r = shift;
># do not rewrite cid: URLs.
>#$$data_r =~ s{($AddrExp)}{rewrite_raw_address($1)}geox;
>$$data_r =~ s{
>((?:cid:)?)($AddrExp)
>}{
>($1 eq "") ? rewrite_raw_address($2) : $1.$2;
>}gieox;
>}
>}
> i.e. if you'd use grouping parentheses, the $2 would not match what is
> expected.
> You could also add the prefix to the method, as alternative to the
> already existing cid case.
> ((?:cid:)?|(?:(?:http://(?:www\.)?)?mail-archive\.com/)?)($AddrExp)
> This one should work in any case (but I didn't test it)
This also is my favorite - simply because the only one having understood
entirely ;o)).
remains the question whether it makes sense to restrict on
mail-archive.com because I think any (http:|ftp:|rsync:) URL containing
an emailadress part should stay untouched. Might be interesting
whether/how many of these occur in the whole archive.
Thanks for investigating und thus providing the patch required. :o))
You went to the mirror already? ;o))
Gruß/regards
--
Friedrich
Libreoffice-Box http://libreofficebox.org/
LibreOffice and more on CD/DVD images
(german version already started)
--
To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Hi Friedrich, *; On Fri, Dec 10, 2010 at 3:22 PM, Friedrich Strohmaier wrote: > > long time no see .. ;o)) :-) > Christian Lohmaier schrieb: >>On Fri, Dec 10, 2010 at 12:11 PM, Friedrich Strohmaier > [...] > in this case - I fear isn't the right thing to do or > the "feeding" code has to be adapted to get whole string between > \s(pace) containing $adress. I had a quick look at MHonArc sources and there are two possible points where the behavriour can be tweaked. One is the expression that identifies email-addresses in lib/mhinit.pl ## Regexp for address/msg-id detection (looks like cussing in cartoons) $AddrExp = '[^()<>@,;:\/\s"\'&|]...@[^()<>@,;:\/\s"\'&|]+'; $HAddrExp = '[^()<>@,;:\/\s"\'&|]+(?:@|&\#[xX]0*40;|&64;)[^()<>@,;:\/\s"\'&|]+'; (I guess cussing should read cursing :-)) Fix would be to prefix the expression with a negative match for (?
Re: Urls containing "@" screwed up in archived Mails
Hi Christian, *, long time no see .. ;o)) Christian Lohmaier schrieb: >On Fri, Dec 10, 2010 at 12:11 PM, Friedrich Strohmaier > wrote: >> Jeff Breidenbach schrieb: >> [..] >>> http://www.mhonarc.org/MHonArc/doc/resources/addressmodifycode.html >>> [..] >> Did You already stumble over the definition what is considered an >> address, loaded to $orig_address? >Judging from the substitute statement (and also by the comparison >whether it is the list address itself). it just is the >[email protected] part, the email itself, not the >complete URL. >Thus to disable mangling of URLs, you would have to disable that whole >thing/look at the surroundings of that snippet. I assumed something like that.. >> http://www.mail-archive.com/[email protected]/msg00453.html >> to get a first glue how to proceed: >> could You post the $orig_address value of URL >> http://www.mail-archive.com/[email protected]/msg13845.html ? >Very likely [email protected] as max. 4 characters from the start >are preserved, followed by three dots, and what follows the @ >[email protected] → [email protected] in this case - I fear isn't the right thing to do or the "feeding" code has to be adapted to get whole string between \s(pace) containing $adress. Gruß/regards -- Friedrich Libreoffice-Box http://libreofficebox.org/ LibreOffice and more on CD/DVD images (german version already started) -- To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Hi Friedrich, *,
On Fri, Dec 10, 2010 at 12:11 PM, Friedrich Strohmaier
wrote:
> Jeff Breidenbach schrieb:
>
> [..]
>
>> http://www.mhonarc.org/MHonArc/doc/resources/addressmodifycode.html
>
>>
>> $orig_address = $_;
>> $address = lc($orig_address);
>> if ($ENV{'MAILLIST'} eq $address) {
>> # If it's the list address, leave it alone.
>> $final_address = $orig_address;
>> } else {
>> # Otherwise, conceal the address. (Choose ONE option below.)
>> $address =~ s/(.).{0,3}(@.*)/$1\.\.\.$2/; # [email protected]
>> $final_address = $address;
>> }
>> $_ = $final_address;
>>
>
> Did You already stumble over the definition what is considered an
> address, loaded to $orig_address?
Judging from the substitute statement (and also by the comparison
whether it is the list address itself). it just is the
[email protected] part, the email itself, not the
complete URL.
Thus to disable mangling of URLs, you would have to disable that whole
thing/look at the surroundings of that snippet.
> http://www.mail-archive.com/[email protected]/msg00453.html
>
> to get a first glue how to proceed:
> could You post the $orig_address value of URL
> http://www.mail-archive.com/[email protected]/msg13845.html ?
Very likely [email protected] as max. 4 characters from the start
are preserved, followed by three dots, and what follows the @
[email protected] → [email protected]
ciao
Christian
--
To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
Hi Jeff, *,
Jeff Breidenbach schrieb:
[..]
> Your feature request is valid and if you are feeling eager, feel free
> to send in a patch. Otherwise we'll get to it when inspiration
> strikes (and I have to warn you, inspiration can be rather slow to
> strike sometimes...).
I know of :o)).
> http://www.mhonarc.org/MHonArc/doc/resources/addressmodifycode.html
>
> $orig_address = $_;
> $address = lc($orig_address);
> if ($ENV{'MAILLIST'} eq $address) {
># If it's the list address, leave it alone.
>$final_address = $orig_address;
> } else {
># Otherwise, conceal the address. (Choose ONE option below.)
>$address =~ s/(.).{0,3}(@.*)/$1\.\.\.$2/; # [email protected]
>$final_address = $address;
> }
> $_ = $final_address;
>
Did You already stumble over the definition what is considered an
address, loaded to $orig_address?
Didn't find it on the first view.
Let's stic on the example mentioned:
http://www.mail-archive.com/[email protected]/msg00453.html
to get a first glue how to proceed:
could You post the $orig_address value of URL
http://www.mail-archive.com/[email protected]/msg13845.html ?
Gruß/regards
--
Friedrich
Libreoffice-Box http://libreofficebox.org/
LibreOffice and more on CD/DVD images
(german version already started)
--
To unsubscribe, send mail to [email protected].
Re: Urls containing "@" screwed up in archived Mails
The Mail Archive does have to be very aggressive to obfuscate email
addresses, otherwise a lot of people go bonkers. But yes, it is dumb to
break a hyperlink, especially a hyperlink to The Mail Archive. Your feature
request is valid and if you are feeling eager, feel free to send in a patch.
Otherwise we'll get to it when inspiration strikes (and I have to warn you,
inspiration can be rather slow to strike sometimes...).
http://www.mhonarc.org/MHonArc/doc/resources/addressmodifycode.html
$orig_address = $_;
$address = lc($orig_address);
if ($ENV{'MAILLIST'} eq $address) {
# If it's the list address, leave it alone.
$final_address = $orig_address;
} else {
# Otherwise, conceal the address. (Choose ONE option below.)
$address =~ s/(.).{0,3}(@.*)/$1\.\.\.$2/; # [email protected]
$final_address = $address;
}
$_ = $final_address;
Urls containing "@" screwed up in archived Mails
Hi folks, I'm from LibreOffice community and noticed that links in archived mails containing an "@" are screwed up, assuming to hide an emailadress. This isn't a good thing, because especially links pointing to other mail-archive.com Mails are broken. see for example: http://www.mail-archive.com/[email protected]/msg00453.html Is that intended behavior? If not: please fix. If yes: provide good reasons. :o)) Gruß/regards -- Friedrich Libreoffice-Box http://libreofficebox.org/ LibreOffice and more on CD/DVD images (german version already started) -- To unsubscribe, send mail to [email protected].
