[Mailman-Users] Update 14000 list by config_list takes 48 hours

[James Chen]

 

Hi all,

 

We just deployed the Mailman for campus E-mail lists service recently and
are having some difficulties updating the 14000 lists on weekly basis.  The
lists data are extracted from Oracle Database and then spooled into two
files for each list, one file is for list members and the other is for the
configuration of list.  We call config_list.py to inject these two files
into Mailman database, Due to the performance of config_list.py, each inject
takes up to 5~10 seconds to complete  a  average list while longer for large
list. Apparently the bottleneck resides in the process when config_list
update the database in Mailman.

 

 Can someone in this list please advise is there different ways to
speed/tune up the update process?  

Regards

 

 

James Chen  


Information and Technology Division 
The Queensland University of Technology  Brisbane, Australia

 

--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

[Mailman-Users] why i got more than 20 copies...

[spread3test]

   Hello.  i just installed mailman-2.1.5,it works,But I do receive 24 
copies of all moderation messages. In short it seems anything sent by the 
software to me as list moderator comes in 24 copies or not at all.  what's 
wrong with it and how could i solve this problem,thanks.--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

[Mailman-Users] Problem moving 2.0 list to 2.1.5

[Matthew Saltzman]

I am trying to move lists between servers and upgrade from 2.0.x to 2.1.5,
and it's not working.

I was able to recreate the archives with cleanarch and arch.  Then I move
the lists/mylist directory to the new server and run withlist -l -r
fix_url mylist.  Then I see the following problems:

(1) The list does not appear on either the listinfo or admin pages.

(2) I can go to the admin page directly at
my.site.com/mailman/admin/mylist, but if I submit any config changes or go
to any of the other admin pages, Mailman crashes with a "Premature end of
scripts" message.

Did I miss a step someplace?  Anyone else seen this problem when
upgrading?

TIA.

-- 
Matthew Saltzman

Clemson University Math Sciences
mjs AT clemson DOT edu
http://www.math.clemson.edu/~mjs
--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] mailman gets stuck, stops sending messages

[Brad Knowles]

At 11:29 AM -0500 2004-11-17, Steven J. Owens wrote:
  Even with -auxw I get nothing.
	You may need to toss in a second "w".  I know that I need to do 
this on some of the systems I admin.

  Where is mailmanctl normally supposed to be started from?  I
 don't see any reference to mailmanctl in /etc/cron.d/mailman.
It is not started from cron.
  I do see mailmanctl in /etc/init.d/mailman.  Does that mean that
 the mailmanctl process should be started on system startup and should
 remain running until system shutdown?
Correct, it is started on boot and should remain running until shutdown.
  I still want to solve the problem, but meanwhile, would there be
 any negative effect to adding an hourly cron job to restart
 mailmanctl?  Or perhaps to run a script to check that
 /var/lib/mailman/data/master-qrunner.pid is a valid process ID, else
 restart mailmanctl?
The latter might be a good idea, but I think the former could be a bad 
one.
	If possible, I would want that script to gather as much 
information as possible about the mailmanctl process that died or 
does not currently exist (including all left-over children, etc...), 
before doing the actual restart.

	There may be something else going on that would help you solve 
the real problem, if you can figure out what that is.

 17:07:30, [EMAIL PROTECTED]:~> ps -auxw| grep mailmanctl
 bash: pipe error: Too many open files in system
Ouch!
  Could be the system is running out of filehandles and mailman's
 falling over as a result?
	That could certainly cause problems for any process on the 
system, Mailman included.

  Could mailman be consuming a whole lot of filehandles?
	It will consume filehandles while it is opening, closing, and 
otherwise processing messages, or while pipermail is accessing the 
system archive as a response to a user request.  But it should only 
be processing a small number of messages at any one given moment in 
time, and shouldn't be running out of filehandles.

	It sounds to me like there is a more serious problem going on 
here that needs to be located and resolved before Mailman will be 
able to function normally.

--
Brad Knowles, <[EMAIL PROTECTED]>
"Those who would give up essential Liberty, to purchase a little
temporary Safety, deserve neither Liberty nor Safety."
-- Benjamin Franklin (1706-1790), reply of the Pennsylvania
Assembly to the Governor, November 11, 1755
  SAGE member since 1995.  See  for more info.
--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] Can't get mailman on Panther Server working correctly

[Brad Knowles]

At 11:37 PM -0800 2004-11-16, Mark Altenberg wrote:
 I'm having some kind of problem, perhaps with DNS or something, and my
 list serve cannot accept mail from outside it's domain. I'm using Panther
 Server, with it's built in SMTP server and stock MailMan. Any ideas?
	Well, you haven't given us much information.  Please see FAQs 
1.22 and 1.23 in the Mailman FAQ Wizard at 
.

	In addition, our ability to help with MacOS X Server and the 
Apple-customized version of Mailman may be limited.  See also FAQ 
1.21.

--
Brad Knowles, <[EMAIL PROTECTED]>
"Those who would give up essential Liberty, to purchase a little
temporary Safety, deserve neither Liberty nor Safety."
-- Benjamin Franklin (1706-1790), reply of the Pennsylvania
Assembly to the Governor, November 11, 1755
  SAGE member since 1995.  See  for more info.
--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] mailman on OS X 10.3.5 with apache, problems

[Larry Stone]

On Wed, 17 Nov 2004, Jason Miller wrote:

> Can anyone point me to a HOWTO for getting Mailman to work with OS X
> 10.3.5? I've googled and googled and googled, read as much on-line
> information as I can find, and I have little to show for it.

See the instructions I wrote which are linked from the FAQ entry Mark
referenced or just go there directly at


> One bit of info about my problem that I can offer is this:  when I try
> to go to http://localhost/mailman, I get a "Not Found" error even
> though I have
>
> Alias mailman/ "/Applications/mailman/"
>
> in my httpd.conf file.

I suspect that's your problem as my instructions do not have that
directive in them but does have a somewhat different ScriptAlias directive
for /mailman/ and an Alias directive for /pipermail/. For that matter, I
don't see that directive in the afp548.com article you referenced so I
don't know why you think you want that there (but I'm an Apache neophyte -
I just followed the directions I received).

-- Larry Stone
   [EMAIL PROTECTED]


--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] mailman gets stuck, stops sending messages

[Steven J. Owens]

Mark,

On Tue, Nov 16, 2004 at 01:54:17PM -0800, Mark Sapiro wrote:
> >I can't see a mailmanctl daemon with:
> > ps -aux| grep mailmanctl |grep -v grep
> 
> Note that on Red Hat 7.3, with an 80 column screen, I have to do 
>  ps -auxw| grep mailmanctl |grep -v grep
> in order to see anything.

 Even with -auxw I get nothing.

 However, I just sent a message out to a mailing list and it went
through properly. 
 
> There should be a "mailmanctl -s -q start" running that was started by
> /etc/init.d/mailman. It in turn should have started all the qrunner
> processes which should also be running (a total of eight qrunners
> assuming no slicing). If a qrunner stops, mailmanctl should notice and
> restart it, but if mailmanctl stops too then so does everything except
> receipt and queueing of messages.

 Where is mailmanctl normally supposed to be started from?  I
don't see any reference to mailmanctl in /etc/cron.d/mailman.

 I do see mailmanctl in /etc/init.d/mailman.  Does that mean that
the mailmanctl process should be started on system startup and should
remain running until system shutdown?

 I still want to solve the problem, but meanwhile, would there be
any negative effect to adding an hourly cron job to restart
mailmanctl?  Or perhaps to run a script to check that
/var/lib/mailman/data/master-qrunner.pid is a valid process ID, else
restart mailmanctl?
 
> >The only thing I can find in the logs that looks suspicious is:
> >qrunner:
> >--
> >Nov 11 16:19:27 2004 (1060) OutgoingRunner qrunner started.
> >Nov 11 16:19:27 2004 (1061) IncomingRunner qrunner started.
> >Nov 11 18:30:26 2004 (1060) OutgoingRunner qrunner caught SIGTERM.  Stopping.
> >Nov 11 18:30:26 2004 (1060) OutgoingRunner qrunner exiting.
> >Nov 11 18:30:26 2004 (1061) IncomingRunner qrunner caught SIGTERM.  Stopping.
> >Nov 11 18:30:33 2004 (1061) IncomingRunner qrunner exiting.
> >--
> 
> We don't know why the incoming and outgoing runners are  receiving
> SIGTERM, but this will cause the problem because they will quit and
> the master won't restart them. See
> 
>bin/mailmanctl --help

 I've just learned something new... while I was trying to check for
mailmanctl again, I got:

17:07:30, [EMAIL PROTECTED]:~> ps -auxw| grep mailmanctl
bash: pipe error: Too many open files in system 

 Could be the system is running out of filehandles and mailman's
falling over as a result?

 Could mailman be consuming a whole lot of filehandles?

-- 
Steven J. Owens
[EMAIL PROTECTED]

"I'm going to make broad, sweeping generalizations and strong,
 declarative statements, because otherwise I'll be here all night and
 this document will be four times longer and much less fun to read.
 Take it all with a grain of salt." - http://darksleep.com/notablog

--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] Can't get mailman on Panther Server workingcorrectly

[Mark Sapiro]

Mark Altenberg wrote:

>I'm having some kind of problem, perhaps with DNS or something, and my list 
>serve cannot accept mail from outside it's domain. I'm using Panther Server, 
>with it's built in SMTP server and stock MailMan. Any ideas?
>

Apple's Panther Server Mailman is non-standard and foreign to most
people on this list. You may do better seeking help from Apple
resources.

That said, can you connect from outside to port 25 in your domain with
a telnet client? If not, there may be a firewall or other device
blocking port 25 access or your MTA (SMTP server) may not be
listening. Neither of these is a Mailman issue.

--
Mark Sapiro <[EMAIL PROTECTED]>   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] Problems with diacritical characters

[Mark Sapiro]

Ralph Utbult wrote:

>Im trying to add an info-text in the footer. Since I live in Sweden, I use our 
>diacritical (or umlaut) characters (åÅäÄöÖ). Python signals that I use 
>non-ASCII characters "\xf6" (yes, I know tihs...). So, do I use HTML-like 
>umlaut-codes or do I "internationalize" Python?
>

I believe if you choose Swedish as the preferred language for the list,
you will be able to add text with the characters you want.

--
Mark Sapiro <[EMAIL PROTECTED]>   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] Mails don't arrive

[Mark Sapiro]

Sven Osterwalder wrote:
> 
>So I assume, the mail was sent. But mailman does nothing.. so no mail
>goes out to the subscribers of testlist.
>When I send any mail i.e. sendmail [EMAIL PROTECTED] it works without
>problems and the user receives the mail.
>Can anyone help me on this?

See FAQ article 3.14.

>Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py

--
Mark Sapiro <[EMAIL PROTECTED]>   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] mailman on OS X 10.3.5 with apache, problems

[Mark Sapiro]

Jason Miller wrote:
>
>Can anyone point me to a HOWTO for getting Mailman to work with OS X 
>10.3.5? I've googled and googled and googled, read as much on-line 
>information as I can find, and I have little to show for it.

See http://www.python.org/cgi-bin/faqw-mm.py?req=show&file=faq01.021.htp

It references the www.afp548.com article you mentioned, but also other
things that might be helpful.

--
Mark Sapiro <[EMAIL PROTECTED]>   The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

[Mailman-Users] mailman on OS X 10.3.5 with apache, problems

[Jason Miller]

Dear listers,
I've been trying to get Mailman up and running on my 10.3.5 boxes, but 
I've had very little luck. I've followed the instructions from the 
README.MACOSX and README.POSTFIX distibuted with the tarball, and I've 
also used the slightly different instructions at 
http://www.afp548.com/Articles/Jaguar/mailman21-upgrade.html. From what 
I can tell without sending a test message through mailman, all the CLI 
stuff seems to work just fine, but I'm unable to get a web interface 
work.

Can anyone point me to a HOWTO for getting Mailman to work with OS X 
10.3.5? I've googled and googled and googled, read as much on-line 
information as I can find, and I have little to show for it.

One bit of info about my problem that I can offer is this:  when I try 
to go to http://localhost/mailman, I get a "Not Found" error even 
though I have

Alias mailman/ "/Applications/mailman/"
in my httpd.conf file.  (I've also had the same alias for /mailman/ and 
I have the exact same problem.)  In my access_log file I get

[Wed Nov 17 09:15:31 2004] [error] [client 127.0.0.1] File does not 
exist: /Library/WebServer/Documents/mailman

when I look for http://localhost/mailman.
Thanks in advance for whatever guidance list members can offer.

Jason E. Miller, Ph.D.
Associate Professor of Mathematics
Truman State University
Kirksville, MO
http://pyrite.truman.edu/millerj/
660.785.7430
--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

Re: [Mailman-Users] Member and password database

[PeteBell]

On 17 Nov 2004, at 14:39, PeteBell wrote:
Further to my problems with this (kindly addressed by Brad, Mark & Jim, 
the other thing which occurs to me is that at the moment a member of a 
list is asked to log in when either changing his/her option settings, 
seeing the members list (if set up to be visible to members only), or 
to see the archive (if members only).

If I could find a way that a member could log in, thereby downloading 
the session-long cookie, but NOT being taken to either of the above 
mailman-generated pages, I still wouldn't need to get involved with 
having my own mailman installation.

Do you know if this would be possible to do?
Cheers
Pete Bell, UK
--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

[Mailman-Users] Mails don't arrive

[Sven Osterwalder]

Hello,
I've setup postfix 2.1.3 and mailman 2.1.4.
To connect both I use a script found on the web:
 
 
postfix-to-mailman-2.1.py
 
The script seems to work, because when I mailed to the list without the
script involved
(sendmail [EMAIL PROTECTED]
 ) I got a timeout. Now I get:
 
Nov 17 11:40:17 webserver postfix/pickup[12293]: E8FE16BD38: uid=0
from= 
Nov 17 11:40:17 webserver postfix/cleanup[12675]: E8FE16BD38:
message-id=<[EMAIL PROTECTED]> 
Nov 17 11:40:17 webserver postfix/qmgr[12294]: E8FE16BD38:
from=<[EMAIL PROTECTED]>, size=298, nrcpt=1 (queue active) 
Nov 17 11:40:18 webserver postfix/pipe[12696]: E8FE16BD38:
to=<[EMAIL PROTECTED]>, relay=mailman, delay=1, status=sent
(mail.mydomain.ch) 
Nov 17 11:40:18 webserver postfix/qmgr[12294]: E8FE16BD38: removed
 
So I assume, the mail was sent. But mailman does nothing.. so no mail
goes out to the subscribers of testlist.
When I send any mail i.e. sendmail [EMAIL PROTECTED] it works without
problems and the user receives the mail.
Can anyone help me on this?
 
Thanks and with kindly regards
 
Sven Osterwalder
--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/

[Mailman-Users] Problems with diacritical characters

[Ralph Utbult]

Im trying to add an info-text in the footer. Since I live in Sweden, I use our 
diacritical (or umlaut) characters (åÅäÄöÖ). Python signals that I use 
non-ASCII characters "\xf6" (yes, I know tihs...). So, do I use HTML-like 
umlaut-codes or do I "internationalize" Python?

Regards

Ralph Utbult
Systemansvarig
ABF Göteborg

Besöksadress: Södra Allégatan 1, 4:e vån, Göteborg
Postadress: Olof Palmes Plats, 413 04  Göteborg

Telefon: 031-7743176
Mobil:   0706-743176
Fax: 031-7743105
E-post:  [EMAIL PROTECTED]
ICQ: 108998663


Min e-post skyddas av SPAMfighter
630 spam har blivit blockerade hittills.
Hämta gratis på www.spamfighter.com idag!
--
Mailman-Users mailing list
[EMAIL PROTECTED]
http://mail.python.org/mailman/listinfo/mailman-users
Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py
Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/