[Mailman-Users] OS X Question --- yes I know

[David Dodell]

Hi, I know from past experience that the OS X version of Mailman is met with 
some contempt because of what Apple did with it .. but I have it working well 
for several years on a 10.7.5 Lion Server, and it has been very stable.

However, I want to explore hosting some of the virtual domains I have setup on 
my server.

Hosting multiple virtual domains without any issues, however want to start 
using mailman with some of those virtual domains.
 
I saw this support article at:
 
Mac OS X Server v10.6: Configuring the Mail service so Mailman can support 
virtual domains - Apple Support 
 
but this is for 10.6 ... looks like it "might" work for 10.7 ... 
 
Paths look the same ... anyone have any ideas?
 
If it does work, will mail from that mailing list show originated from the 
virtual, versus "real" domain?
 
Thanks

David
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

[Mailman-Users] UnicodeDecodeError accessing into web admin interface

[Ferriol]

Hi,

I'm trying to access to the web admin interface and I can't
After authentication says "Bug in Mailman version 2.1.13"

I looked to the mailman error and read:
admin(14653): [- Mailman Version: 2.1.13 -]
admin(14653): [- Traceback --]
admin(14653): Traceback (most recent call last):
admin(14653):   File "/var/lib/mailman/scripts/driver", line 112, in
run_main
admin(14653): main()
admin(14653):   File "/var/lib/mailman/Mailman/Cgi/admin.py", line 197,
in main
admin(14653): print doc.Format()
admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 336,
in Format
admin(14653): output.append(Container.Format(self, indent))
admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 265,
in Format
admin(14653): output.append(HTMLFormatObject(item, indent))
admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 51,
in HTMLFormatObject
admin(14653): return item.Format(indent)
admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 422,
in Format
admin(14653): output = output + Container.Format(self, indent+2)
admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 265,
in Format
admin(14653): output.append(HTMLFormatObject(item, indent))
admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 51,
in HTMLFormatObject
admin(14653): return item.Format(indent)
admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 201,
in Format
admin(14653): output = output + self.FormatRow(i, indent + 2)
admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 189,
in FormatRow
admin(14653): output = output + self.FormatCell(row, i, indent + 2)
admin(14653): UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3
in position 71: ordinal not in range(128)

If I tried access directly to the subscribers list, it works:
https://server_name/admin/list_name/members

If I access https://server_name/admin/list_name/ crash
Crashes too in
https://server_name/admin/list_name/nondigest
https://server_name/admin/list_name/topics
All other pages of the web admin interface works

I tried to look the configuration in command line executing:
config_list -o file list_name
But also raises UnicodeDecodeError

I don't know how can I find which configuration value is the problem ?
And when I'll find I don't know how can I fix it...

Please, any Idea ?

Thanks in advance !!!

--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

[Mailman-Users] Mailman docker container (Apache, Postfix on Ubuntu 14.04)

[realcr]

Hi,
It took me about a week to get a working setup of Mailman inside Docker
(Apache, Postfix on Ubuntu 14.04). I learned a lot from reading past
messages on this list and I thought I could contribute back somehow.

The full working setup could be found here:
https://github.com/realcr/mailman_docker

It really works out of the box. You just fill in the configuration files
and you have a working mailman server. (Including the ability to backup and
restore).

I'm pretty new to this, and there must be some things I have overlooked. If
you see them, please tell me. I hope that you will find it useful.

Regards,
real.
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Re: [Mailman-Users] Regexp in accept_these_nonmembers

[Mark Sapiro]

On 11/23/2014 09:15 PM, Olivier Nicole wrote:
> 
> Mark Sapiro  writes:
>>
>> Your regexp should work although it will actually also accept things
>> like 'r...@xbknix.co.th'. Also, '@' is not special and doesn't need to
>> be escaped. I would use '^root@(.*\.)?bknix\.co\.th$'.
> 
> Thank you, I was not sure to what extend I could use the regexp syntax.


Regexps provided to Mailman are all Python flavor regexps and are
usually compiled in IGNORECASE mode. Any legal Python regexp is allowed
and will be matched as in Python's re module
.


> Sorry, I overlooked the "Message has implicit destination" part. Now it
> makes sense.


I guess that means you know how to fix it?

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Re: [Mailman-Users] OS X Question --- yes I know

[Mark Sapiro]

On 11/23/2014 03:54 PM, David Dodell wrote:
>  
> I saw this support article at:
>  
> Mac OS X Server v10.6: Configuring the Mail service so Mailman can support 
> virtual domains - Apple Support 
>  
> but this is for 10.6 ... looks like it "might" work for 10.7 ... 
>  
> Paths look the same ... anyone have any ideas?
>  
> If it does work, will mail from that mailing list show originated from the 
> virtual, versus "real" domain?



See the FAQ at . You are using and Apple
package and referencing an Apple support article. Why are you here?

I suspect the answer lies somewhere on the continuum between "The GNU
Mailman project provides better support for Apple's Mailman package than
Apple does" and "Apple doesn't support Mailman". If that is the case,
perhaps you should consider a FLOSS OS as well.



My concern is I see nothing in the referenced document about putting
add_virtualhost() lines in mm_cfg.py. Thus, either that is a serious
omission in the article, or Apple is doing something in their package
that I know nothing about.

So I have questions starting with?

1) How do you create lists for Apple's Mailman?

2) Does this process allow you to specify the (virtual) host for the list?

If we look at step 9) in the Apple support doc, and use their example
with virtual email domains virtual1.dom and virtual2.dom, and assume for
discussion that the corresponding web domains are www.virtual1.dom and
www.virtual2.dom, you would also put

add_virtualhost('www.virtual1.dom', 'virtual1.dom')
add_virtualhost('www.virtual2.dom', 'virtual2.dom')

in mm_cfg.py.

Then, you could create a list in virtual1.dom with a command like

bin/newlist -urlhost=www.virtual1.dom list_name

and answer the prompts for list admin address and list password.

Or you could use Mailman's create CGI by going to a url like

http://www.virtual1.dom/mailman/create

Here, the list's domain is determined by the domain in the URL. Note
that web host names like www.virtual1.dom are for example only. They
could be anything and they can be the same as the email host names.

There are two caveats. web host names need to be unique, i.e., you can't
use the same (virtual) web host for two virtual email domains, and list
names have to be globally unique, i.e. you can't have the same (case
insensitive) list name in two different domains.

Given all the above, a list in a virtual domain will use the virtual
domain names for everything that Mailman does.

When you ask "will mail from that mailing list show originated from the
virtual, versus "real" domain?", the answer depends what you mean.

The envelope sender and any headers from Mailman will all use the
virtual domain, but some Received: headers will show the domain will
show the domain that Postfix uses to identify itself.

The above advice/answers depend on Apple's package doing things in a
fairly standard way. If that is not the case, then it all may be wrong.

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Re: [Mailman-Users] UnicodeDecodeError accessing into web admin interface

[Mark Sapiro]

On 11/24/2014 04:05 AM, Ferriol wrote:
> 
> I'm trying to access to the web admin interface and I can't
> After authentication says "Bug in Mailman version 2.1.13"
> 
> I looked to the mailman error and read:
> admin(14653): [- Mailman Version: 2.1.13 -]
> admin(14653): [- Traceback --]
> admin(14653): Traceback (most recent call last):
> admin(14653):   File "/var/lib/mailman/scripts/driver", line 112, in
> run_main
> admin(14653): main()
> admin(14653):   File "/var/lib/mailman/Mailman/Cgi/admin.py", line 197,
> in main
> admin(14653): print doc.Format()
> admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 336,
> in Format
> admin(14653): output.append(Container.Format(self, indent))
> admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 265,
> in Format
> admin(14653): output.append(HTMLFormatObject(item, indent))
> admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 51,
> in HTMLFormatObject
> admin(14653): return item.Format(indent)
> admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 422,
> in Format
> admin(14653): output = output + Container.Format(self, indent+2)
> admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 265,
> in Format
> admin(14653): output.append(HTMLFormatObject(item, indent))
> admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 51,
> in HTMLFormatObject
> admin(14653): return item.Format(indent)
> admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 201,
> in Format
> admin(14653): output = output + self.FormatRow(i, indent + 2)
> admin(14653):   File "/var/lib/mailman/Mailman/htmlformat.py", line 189,
> in FormatRow
> admin(14653): output = output + self.FormatCell(row, i, indent + 2)
> admin(14653): UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3
> in position 71: ordinal not in range(128)


This is probably an English language list so it's Mailman character set
is us-ascii, and there is something (?) that has non-ascii, probably
utf-8 because 0xc3 is a utf-8 leadin, encoded text.

Finding exactly what is problematic.

The additional Python and environment information from the above error
log entry may help.


> If I tried access directly to the subscribers list, it works:
> https://server_name/admin/list_name/members
> 
> If I access https://server_name/admin/list_name/ crash
> Crashes too in
> https://server_name/admin/list_name/nondigest
> https://server_name/admin/list_name/topics
> All other pages of the web admin interface works
> 
> I tried to look the configuration in command line executing:
> config_list -o file list_name
> But also raises UnicodeDecodeError


And the full traceback from this may help too.


> I don't know how can I find which configuration value is the problem ?


Nor do I without some additional info.


> And when I'll find I don't know how can I fix it...


You can post one or more error log entries with the complete traceback,
python and environment info, or possibly the traceback from config_list
is even better.

Also, does this occur with all lists or only one?

Here are some suggestions:

If it occurs with only one list, if you send me off list a copy of
/var/lib/mailman/lists/LIST_NAME/config.pck, I'll try to find the problem.

You can change the code in /var/lib/mailman/Mailman/htmlformat.py around
line 189 which currently is

for i in range(len(self.cells[row])):
output = output + self.FormatCell(row, i, indent + 2)


and make it

output = unicode(output, errors='replace')
for i in range(len(self.cells[row])):
output = output + unicode(
self.FormatCell(row, i, indent + 2), errors='replace')
output = output.encode(errors='replace')

This should avoid the UnicodeDecodeError and instead result in the
non-ascii characters being replaced with '?'

Alternatively, you could replace the above two lines with

from Mailman.Logging.Syslog import syslog
try:
for i in range(len(self.cells[row])):
output = output + self.FormatCell(row, i, indent + 2)
except UnicodeDecodeError:
syslog('error', 'UnicodeDecodeError: %s', output)

which should result in the problem bit being omitted from the page, and
Mailman's error log containing the html for the part of the page leading
up to the problem.

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Re: [Mailman-Users] UnicodeDecodeError accessing into web admin interface

[Ferriol]

Hi,

Thanks for you response,

El 24/11/14 a les 21:10, Mark Sapiro ha escrit:
>
> This is probably an English language list so it's Mailman character set
> is us-ascii, and there is something (?) that has non-ascii, probably
> utf-8 because 0xc3 is a utf-8 leadin, encoded text.
>
> Finding exactly what is problematic.
>
> The additional Python and environment information from the above error
> log entry may help.
This is not an English list but uses a latin alphabet is in Catalan that
uses tittles and is latin_1 encoding

Some full log entries below
>
> And the full traceback from this may help too.
$  config_list -o config listname
Traceback (most recent call last):
  File "/usr/sbin/config_list", line 362, in 
main()
  File "/usr/sbin/config_list", line 355, in main
do_output(listname, outfile)
  File "/usr/sbin/config_list", line 128, in do_output
do_list_categories(mlist, k, None, outfp)
  File "/usr/sbin/config_list", line 198, in do_list_categories
outfp.write(NL.join(lines).replace('"', '\\"'))
UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in
position 9: ordinal not in range(128)
> Also, does this occur with all lists or only one?
In 4 lists. In one on General options, topics and non-digest options,
other one general options and non-digest options and the other two only
in general options. May be has the same information in some value...
> output = unicode(output, errors='replace')
> for i in range(len(self.cells[row])):
> output = output + unicode(
> self.FormatCell(row, i, indent + 2), errors='replace')
> output = output.encode(errors='replace')
>
I tried this and doesn't work, this is the log entry:

Nov 24 22:59:19 2014 admin(27848):

admin(27848): [- Mailman Version: 2.1.13 -]
admin(27848): [- Traceback --]
admin(27848): Traceback (most recent call last):
admin(27848):   File "/var/lib/mailman/scripts/driver", line 112, in
run_main
admin(27848): main()
admin(27848):   File "/var/lib/mailman/Mailman/Cgi/listinfo.py", line
62, in main
admin(27848): list_listinfo(mlist, language)
admin(27848):   File "/var/lib/mailman/Mailman/Cgi/listinfo.py", line
161, in list_listinfo
admin(27848): replacements = mlist.GetStandardReplacements(lang)
admin(27848):   File "/var/lib/mailman/Mailman/HTMLFormatter.py", line
383, in GetStandardReplacements
admin(27848): '' : self.GetMailmanFooter(),
admin(27848):   File "/var/lib/mailman/Mailman/HTMLFormatter.py", line
61, in GetMailmanFooter
admin(27848): '', MailmanLogo(.Format()
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 268,
in Format
admin(27848): output.append(HTMLFormatObject(item, indent))
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 51,
in HTMLFormatObject
admin(27848): return item.Format(indent)
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 362,
in Format
admin(27848): output = output + Container.Format(self, indent)
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 268,
in Format
admin(27848): output.append(HTMLFormatObject(item, indent))
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 51,
in HTMLFormatObject
admin(27848): return item.Format(indent)
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 268,
in Format
admin(27848): output.append(HTMLFormatObject(item, indent))
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 51,
in HTMLFormatObject
admin(27848): return item.Format(indent)
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 204,
in Format
admin(27848): output = output + self.FormatRow(i, indent + 2)
admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 192,
in FormatRow
admin(27848): output = output.encode(errors='replace')
admin(27848): TypeError: encode() takes no keyword arguments
admin(27848): [- Python Information -]
admin(27848): sys.version =   2.6.6 (r266:84292, Dec 27 2010, 00:02:40)
[GCC 4.4.5]
admin(27848): sys.executable  =   /usr/bin/python
admin(27848): sys.prefix  =   /usr
admin(27848): sys.exec_prefix =   /usr
admin(27848): sys.path=   /usr
admin(27848): sys.platform=   linux2
admin(27848): [- Environment Variables -]
admin(27848): SERVER_SOFTWARE: Apache/2.2.16 (Debian)
admin(27848): SCRIPT_NAME: /listinfo
admin(27848): SERVER_SIGNATURE: Apache/2.2.16 (Debian)
Server at servername Port 80
admin(27848):
admin(27848): REQUEST_METHOD: GET
admin(27848): PATH_INFO: /listname
admin(27848): SERVER_PROTOCOL: HTTP/1.0
admin(27848): QUERY_STRING: 
admin(27848): HTTP_X_REAL_IP: XXX.XXX.XXX.XXX
admin(27848): HTTP_USER_AGENT: Mozilla/5.0 (X11; Linux x86_64;
rv:31.0) Gecko/20100101 Firefox/31.0 Iceweasel/31.2.0
admin(27848): HTTP_CONNECTION: close
admin(27848): SERVER_NAME: servername
admin

Re: [Mailman-Users] OS X Question --- yes I know

[Ed Ravin]

On Sun, Nov 23, 2014 at 04:54:09PM -0700, David Dodell wrote:
> Hi, I know from past experience that the OS X version of Mailman is met with 
> some contempt because of what Apple did with it .. but I have it working well 
> for several years on a 10.7.5 Lion Server, and it has been very stable.

Note that there's also a version from MacPorts:

$ port list mailman
mailman@2.1.13 mail/mailman

[this is on my Mountain Lion box, your mileage may vary]
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org

Re: [Mailman-Users] UnicodeDecodeError accessing into web admin interface

[Mark Sapiro]

On 11/24/2014 05:15 PM, Ferriol wrote:
> 
> El 24/11/14 a les 21:10, Mark Sapiro ha escrit:
>>
>> This is probably an English language list so it's Mailman character set
>> is us-ascii, and there is something (?) that has non-ascii, probably
>> utf-8 because 0xc3 is a utf-8 leadin, encoded text.
>>
>> Finding exactly what is problematic.
>>
>> The additional Python and environment information from the above error
>> log entry may help.
> This is not an English list but uses a latin alphabet is in Catalan that
> uses tittles and is latin_1 encoding


Is the lists' preferred_language Catalan or English (USA)?

If it is Catalan, the web UI and all the i18n strings should be utf-8
encoded and you shouldn't be seeing this issue.

Or are you saying that the lists preferred_language is English (USA),
but you are entering latin_1 encoded text in the various fields in the
web UI or via config_list?

In any case, we shouldn't be throwing exceptions, even if you are
entering non-ascii in an English list. I'll look into this further.


> Some full log entries below


OK.


>> And the full traceback from this may help too.
> $  config_list -o config listname
> Traceback (most recent call last):
>   File "/usr/sbin/config_list", line 362, in 
> main()
>   File "/usr/sbin/config_list", line 355, in main
> do_output(listname, outfile)
>   File "/usr/sbin/config_list", line 128, in do_output
> do_list_categories(mlist, k, None, outfp)
>   File "/usr/sbin/config_list", line 198, in do_list_categories
> outfp.write(NL.join(lines).replace('"', '\\"'))
> UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in
> position 9: ordinal not in range(128)


Unfortunately, that doesn't help too much, but thanks anyway.


>> Also, does this occur with all lists or only one?
> In 4 lists. In one on General options, topics and non-digest options,
> other one general options and non-digest options and the other two only
> in general options. May be has the same information in some value...
>> output = unicode(output, errors='replace')
>> for i in range(len(self.cells[row])):
>> output = output + unicode(
>> self.FormatCell(row, i, indent + 2), errors='replace')
>> output = output.encode(errors='replace')
>>
> I tried this and doesn't work, this is the log entry:
...
> admin(27848):   File "/var/lib/mailman/Mailman/htmlformat.py", line 192,
> in FormatRow
> admin(27848): output = output.encode(errors='replace')
> admin(27848): TypeError: encode() takes no keyword arguments


Sorry about that. The keyword argument errors='replace' requires Python
2.7. Anyway, you got the information another way.


>> Alternatively, you could replace the above two lines with
>>
>> from Mailman.Logging.Syslog import syslog
>> try:
>> for i in range(len(self.cells[row])):
>> output = output + self.FormatCell(row, i, indent + 2)
>> except UnicodeDecodeError:
>> syslog('error', 'UnicodeDecodeError: %s', output)
>>
>> which should result in the problem bit being omitted from the page, and
>> Mailman's error log containing the html for the part of the page leading
>> up to the problem.
> 
> This works perfect, with this I can find all values with rare characters.


OK. good.


> I'm reseting this values with config_list. I prepare a file with
> value='' p.ex.
> # -*- python -*-
> # -*- coding: utf-8 -*-
> info=''
> welcome_msg=''
> msg_footer=''
> topics=''
> 
> and then I do config_list -i file listname
> 
> 
> Thanks, I solved the problem with your help ! Thanks for your work !


Thanks for the info you provided, and I'm glad you were able to find the
problem strings.

I will look into making Mailman behave more gracefully in cases like this.

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list Mailman-Users@python.org
https://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Unsubscribe: 
https://mail.python.org/mailman/options/mailman-users/archive%40jab.org