Re: POP3 and SMTP server for an ISP

2001-02-23 Thread Roger Abrahamsson


Hello again.

I've been closely following this thread, and I was wondering what sort of
system that would be recommendable for 50.000+ users? No local access and
no home directories is wanted, but pure mass hosting. Maildirs I assume is
essential.
I've tried some programs, but they fail horribly when the system gets
big. I have been wondering about file system limitations too. Say you have
5000 users in each subtree and they have between 100 and 30.000 emails in
their folders. (The large figure is an example of a smartass like me. lol)
Preferrable all user authentication is done in MySQL or other SQL server.

Any recommendations, ideas or so??


/Roger Abrahamsson

-
Roger Abrahamsson, Sys/Net Admin, Obbit AB
Radhusespl.17D, S-90328 Umea, Sweden
-


--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




RADIUS accounting and block accounts

2001-02-23 Thread Jeremy Lunn

I am about to finally set up portslave to authenticate with RADIUS (so
that it can be replaced by a NAS).  Anyway the RADIUS authentication
will backend to an LDAP database, but I was just wondering if it would
be possible to backend the RADIUS accounting to a PostgreSQL database?
Can anyone recommend a radius server that would support this (but it
will be used exclusively for accounting, unless it supports LDAP and has
a good license).

This leads to the next question, I would like to be able to
automatically disable accounts and disconnect them if they've used up
more than allocated hours.  So say they have a 20 hour block acount,
when it gets up to 20 hours I would like to d/c them and disable logins
untill the next month.  Is this possible at all?  Or is it going to
require a bit of hacking and a few perl scripts?

Thanks,

-- 
Jeremy Lunn
Melbourne, Australia


--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




Re: POP3 and SMTP server for an ISP

2001-02-23 Thread Gavin Hamill

 their folders. (The large figure is an example of a smartass like me. lol)
 Preferrable all user authentication is done in MySQL or other SQL server.
 Any recommendations, ideas or so??

I use Iain Patterson's (www.iain.cx/unix/qmail)'s MySQL patches for qmail,
and I absolutely love them :) I run our virtual hosting setup under it
with great success...

I cna't say how scalable they are because we're only a small firm, but I
don't see why they shouldn't be able to cope with huge loads given
qmail's tiny footprint.

I can also help out with installation / .debs if need be - and the author
is a nice bloke who I write to regularly...

Regards, 

Gavin.



--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




Re: POP3 and SMTP server for an ISP

2001-02-23 Thread Russell Coker

On Friday 23 February 2001 10:02, Roger Abrahamsson wrote:
 I've been closely following this thread, and I was wondering what sort of
 system that would be recommendable for 50.000+ users? No local access and
 no home directories is wanted, but pure mass hosting. Maildirs I assume is
 essential.
 I've tried some programs, but they fail horribly when the system gets
 big. I have been wondering about file system limitations too. Say you have
 5000 users in each subtree and they have between 100 and 30.000 emails in
 their folders. (The large figure is an example of a smartass like me. lol)
 Preferrable all user authentication is done in MySQL or other SQL server.

If you use Ext2 then you need multiple file systems, otherwise fsck times 
will be ridiculous.
ReiserFS will perform best for this and journalling avoids fsck times, but 
the fsck program isn't as capable as we would like yet.

Ext3 only works on 2.2.x kernels and is quite beta.

Postfix should work if you use something like maildrop for delivery.  
Apparently you can hack wrapper scripts to check LDAP or SQL for user 
details.  I'm investigating this myself now.

With 50K users if they have an average mailbox size of 5M you'll need 250G of 
storage.  You may gain from having multiple file systems on different 
hardware devices.  EG you could have two RAID-10 arrays each containing 4*72G 
drives for 144G of mirrored storage each (total 300G should be enough).  Then 
if you have to FSCK them you can do it in parallel.  Also having two separate 
file systems should speed up delivery on SMP machines (haven't tested this 
theory though).

-- 
http://www.coker.com.au/bonnie++/ Bonnie++ hard drive benchmark
http://www.coker.com.au/postal/   Postal SMTP/POP benchmark
http://www.coker.com.au/projects.html Projects I am working on
http://www.coker.com.au/~russell/ My home page


--
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




Re: POP3 and SMTP server for an ISP

2001-02-23 Thread Michelle Konzack

Hello,

I have the same problem.
I like to use postgresSQL for my user database (mail-acounts, 
virtualhosts, dns,...) but now I have problems to handel around 
1000 Clients with 10 Pop3 each or multi-drop-box.

Can anyone link me to resources to do that ???

Many thanks in advance

Michelle

Michelle's Internet-Service
FunkLAN-Providerin
Alte Zoll Strasse 17
77694 Kehl am Rhein
Germany


Am 10:02 23.02.2001 +0100 haben Roger Abrahamsson geschrieben:


Hello again.

I've been closely following this thread, and I was wondering what sort of
system that would be recommendable for 50.000+ users? No local access and
no home directories is wanted, but pure mass hosting. Maildirs I assume is
essential.
I've tried some programs, but they fail horribly when the system gets
big. I have been wondering about file system limitations too. Say you have
5000 users in each subtree and they have between 100 and 30.000 emails in
their folders. (The large figure is an example of a smartass like me. lol)
Preferrable all user authentication is done in MySQL or other SQL server.

Any recommendations, ideas or so??


/Roger Abrahamsson

-
Roger Abrahamsson, Sys/Net Admin, Obbit AB
Radhusespl.17D, S-90328 Umea, Sweden
-


 ##  Get the Power of Debian/GNU-Linux  ##


--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




htaccess success!

2001-02-23 Thread Martin WHEELER

Thanks to all who helped me solve this problem.

It eventually transpired that I had not one, but FOUR almost identical 
docroot Directory directives in my configuration file(s) -- two
containing  AllowOverride None; one containing  AllowOverride All; and
one containing  AllowOverride Authconfig.  Obviously, I kept editing the
wrong one. :|

How they got there I have no idea.  But I suspect a bit of 'mischievous'
editing somewhere along the line, by person or persons unknown, with the
aim of nullifying the authentication. 

It actually took me longer to track this down than it should,
across the files concerned.  Which begs the question: when is
Debian finally going to go towards a single httpd.conf file?

(Wouldn't stop this problem; but would help in tracking down multiple
and conflicting directives.)
-- 
Martin Wheeler   -StarTEXT - Glastonbury - BA6 9PH - England
[1] [EMAIL PROTECTED]   http://www.startext.co.uk/

 - Share your knowledge. It's one way to achieve immortality. -



--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




forwarding mail to internal mail server

2001-02-23 Thread Jeremy L. Gaddis

What's the "preferred" method of forwarding all incoming mail
from the gateway to an internal mail server?  I have one box
(Debian Woody, sendmail 8.9.3) currently mounting /var/mail
from the internal mail server (also a Debian Woody box, running
8.9.3).  This seems to work okay, but I'm just waiting for something
to break.

I've thought about setting up port forwarding so that anyone connecting
to port 25 on the masquerading box is transparently forwarded to the
internal mail server.  That, however, is something I'd like to avoid.

I'm open to any suggestions anyone may have.  I've thought about
using virtusertable on the gateway box to rewrite the addresses so as
to be delivered to the internal mail server, but I'm not sure about this.

Thanks.

-jg
--
Jeremy L. Gaddis [EMAIL PROTECTED]


--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




forwarding mail to internal mail server

2001-02-23 Thread Bulent Murtezaoglu

[...]
JLG I'm open to any suggestions anyone may have.  I've thought
JLG about using virtusertable on the gateway box to rewrite the
JLG addresses so as to be delivered to the internal mail server,
JLG but I'm not sure about this.

Use a mailertable that sends everything for your domain[s] to the
internal server.  The bat book covers this, but so should the sendmail
docs.  I'll point out one usual pitfall though: if you use a mailetable
to route the inbound mail from a gateway host you should not have the 
routed domain[s] in the gateway sendmail's class w.

cheers,

BM




--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




Re: forwarding mail to internal mail server

2001-02-23 Thread Jeremy L. Gaddis

At 2/23/01 06:38 PM -0500, Bulent Murtezaoglu wrote:
[...]
JLG I'm open to any suggestions anyone may have.  I've thought
JLG about using virtusertable on the gateway box to rewrite the
JLG addresses so as to be delivered to the internal mail server,
JLG but I'm not sure about this.

Use a mailertable that sends everything for your domain[s] to the
internal server.  The bat book covers this, but so should the sendmail
docs.  I'll point out one usual pitfall though: if you use a mailetable
to route the inbound mail from a gateway host you should not have the 
routed domain[s] in the gateway sendmail's class w.

After finding the appropriate section in the bat book, I managed to get
this working really nice.  In .mc, you'd use "define(`MAIL_HUB',`remotehost')dnl",
or modify DH in sendmail.cf.  I managed to get this working across my
whole network in a matter of an hour or so.

I'm really glad I found this, this keeps me from having to worry about NFS mounts
and machines hanging when the NFS server goes down for a reboot/maintenance/
what have you.

I haven't took down sendmail on the mail server yet to see what happens when it's
down (e.g. if the gateway box queues mail/etc.), but I'm about to.

Anyways, got it working.  Thanks for the pointer.

-jg

--
Jeremy L. Gaddis [EMAIL PROTECTED]


--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




Re: RADIUS accounting and block accounts

2001-02-23 Thread Alan Harper

On Fri, Feb 23, 2001 at 09:15:47PM +1100, Jeremy Lunn wrote:
 I am about to finally set up portslave to authenticate with RADIUS (so
 that it can be replaced by a NAS).  Anyway the RADIUS authentication
 will backend to an LDAP database, but I was just wondering if it would
 be possible to backend the RADIUS accounting to a PostgreSQL database?
 Can anyone recommend a radius server that would support this (but it
 will be used exclusively for accounting, unless it supports LDAP and has
 a good license).
 
 This leads to the next question, I would like to be able to
 automatically disable accounts and disconnect them if they've used up
 more than allocated hours.  So say they have a 20 hour block acount,
 when it gets up to 20 hours I would like to d/c them and disable logins
 untill the next month.  Is this possible at all?  Or is it going to
 require a bit of hacking and a few perl scripts?
 
I aren't sure about Postgresql, but I know there is a patch to enable the Cistron 
Radiusd to log to a MySQL database. There is a link on the cistron radius website (I 
don't have the link handy, but a quick search on freshmeat will find it)

Cheers,
Alan


--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




merging apache config files [was: Re: htaccess success!]

2001-02-23 Thread Marcin Owsiany

On Fri, Feb 23, 2001 at 09:38:23PM +, Martin WHEELER wrote:
 
 It actually took me longer to track this down than it should,
 across the files concerned.  Which begs the question: when is
 Debian finally going to go towards a single httpd.conf file?
 
 (Wouldn't stop this problem; but would help in tracking down multiple
 and conflicting directives.)

I don't think so. Each directive belongs to one file. Browsing
through a 3 kb access.conf is certainly easier than browsing
through a huge, combined, 20 kb httpd.conf

Marcin
-- 
Marcin Owsiany [EMAIL PROTECTED]
http://student.uci.agh.edu.pl/~porridge/
GnuPG: 1024D/60F41216  FE67 DA2D 0ACA FC5E 3F75  D6F6 3A0D 8AA0 60F4 1216


--  
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]




Re: POP3 and SMTP server for an ISP

2001-02-23 Thread Gavin Hamill
 their folders. (The large figure is an example of a smartass like me. lol)
 Preferrable all user authentication is done in MySQL or other SQL server.
 Any recommendations, ideas or so??

I use Iain Patterson's (www.iain.cx/unix/qmail)'s MySQL patches for qmail,
and I absolutely love them :) I run our virtual hosting setup under it
with great success...

I cna't say how scalable they are because we're only a small firm, but I
don't see why they shouldn't be able to cope with huge loads given
qmail's tiny footprint.

I can also help out with installation / .debs if need be - and the author
is a nice bloke who I write to regularly...

Regards, 

Gavin.





Re: POP3 and SMTP server for an ISP

2001-02-23 Thread Russell Coker
On Friday 23 February 2001 10:02, Roger Abrahamsson wrote:
 I've been closely following this thread, and I was wondering what sort of
 system that would be recommendable for 50.000+ users? No local access and
 no home directories is wanted, but pure mass hosting. Maildirs I assume is
 essential.
 I've tried some programs, but they fail horribly when the system gets
 big. I have been wondering about file system limitations too. Say you have
 5000 users in each subtree and they have between 100 and 30.000 emails in
 their folders. (The large figure is an example of a smartass like me. lol)
 Preferrable all user authentication is done in MySQL or other SQL server.

If you use Ext2 then you need multiple file systems, otherwise fsck times 
will be ridiculous.
ReiserFS will perform best for this and journalling avoids fsck times, but 
the fsck program isn't as capable as we would like yet.

Ext3 only works on 2.2.x kernels and is quite beta.

Postfix should work if you use something like maildrop for delivery.  
Apparently you can hack wrapper scripts to check LDAP or SQL for user 
details.  I'm investigating this myself now.

With 50K users if they have an average mailbox size of 5M you'll need 250G of 
storage.  You may gain from having multiple file systems on different 
hardware devices.  EG you could have two RAID-10 arrays each containing 4*72G 
drives for 144G of mirrored storage each (total 300G should be enough).  Then 
if you have to FSCK them you can do it in parallel.  Also having two separate 
file systems should speed up delivery on SMP machines (haven't tested this 
theory though).

-- 
http://www.coker.com.au/bonnie++/ Bonnie++ hard drive benchmark
http://www.coker.com.au/postal/   Postal SMTP/POP benchmark
http://www.coker.com.au/projects.html Projects I am working on
http://www.coker.com.au/~russell/ My home page




Re: POP3 and SMTP server for an ISP

2001-02-23 Thread Michelle Konzack
Hello,

I have the same problem.
I like to use postgresSQL for my user database (mail-acounts, 
virtualhosts, dns,...) but now I have problems to handel around 
1000 Clients with 10 Pop3 each or multi-drop-box.

Can anyone link me to resources to do that ???

Many thanks in advance

Michelle

Michelle's Internet-Service
FunkLAN-Providerin
Alte Zoll Strasse 17
77694 Kehl am Rhein
Germany


Am 10:02 23.02.2001 +0100 haben Roger Abrahamsson geschrieben:


Hello again.

I've been closely following this thread, and I was wondering what sort of
system that would be recommendable for 50.000+ users? No local access and
no home directories is wanted, but pure mass hosting. Maildirs I assume is
essential.
I've tried some programs, but they fail horribly when the system gets
big. I have been wondering about file system limitations too. Say you have
5000 users in each subtree and they have between 100 and 30.000 emails in
their folders. (The large figure is an example of a smartass like me. lol)
Preferrable all user authentication is done in MySQL or other SQL server.

Any recommendations, ideas or so??


/Roger Abrahamsson

-
Roger Abrahamsson, Sys/Net Admin, Obbit AB
Radhusespl.17D, S-90328 Umea, Sweden
-


 ##  Get the Power of Debian/GNU-Linux  ##




htaccess success!

2001-02-23 Thread Martin WHEELER
Thanks to all who helped me solve this problem.

It eventually transpired that I had not one, but FOUR almost identical 
docroot Directory directives in my configuration file(s) -- two
containing  AllowOverride None; one containing  AllowOverride All; and
one containing  AllowOverride Authconfig.  Obviously, I kept editing the
wrong one. :|

How they got there I have no idea.  But I suspect a bit of 'mischievous'
editing somewhere along the line, by person or persons unknown, with the
aim of nullifying the authentication. 

It actually took me longer to track this down than it should,
across the files concerned.  Which begs the question: when is
Debian finally going to go towards a single httpd.conf file?

(Wouldn't stop this problem; but would help in tracking down multiple
and conflicting directives.)
-- 
Martin Wheeler   -StarTEXT - Glastonbury - BA6 9PH - England
[1] [EMAIL PROTECTED]   http://www.startext.co.uk/

 - Share your knowledge. It's one way to achieve immortality. -





forwarding mail to internal mail server

2001-02-23 Thread Jeremy L. Gaddis
What's the preferred method of forwarding all incoming mail
from the gateway to an internal mail server?  I have one box
(Debian Woody, sendmail 8.9.3) currently mounting /var/mail
from the internal mail server (also a Debian Woody box, running
8.9.3).  This seems to work okay, but I'm just waiting for something
to break.

I've thought about setting up port forwarding so that anyone connecting
to port 25 on the masquerading box is transparently forwarded to the
internal mail server.  That, however, is something I'd like to avoid.

I'm open to any suggestions anyone may have.  I've thought about
using virtusertable on the gateway box to rewrite the addresses so as
to be delivered to the internal mail server, but I'm not sure about this.

Thanks.

-jg
--
Jeremy L. Gaddis [EMAIL PROTECTED]




forwarding mail to internal mail server

2001-02-23 Thread Bulent Murtezaoglu
[...]
JLG I'm open to any suggestions anyone may have.  I've thought
JLG about using virtusertable on the gateway box to rewrite the
JLG addresses so as to be delivered to the internal mail server,
JLG but I'm not sure about this.

Use a mailertable that sends everything for your domain[s] to the
internal server.  The bat book covers this, but so should the sendmail
docs.  I'll point out one usual pitfall though: if you use a mailetable
to route the inbound mail from a gateway host you should not have the 
routed domain[s] in the gateway sendmail's class w.

cheers,

BM






Re: forwarding mail to internal mail server

2001-02-23 Thread Jeremy L. Gaddis
At 2/23/01 06:38 PM -0500, Bulent Murtezaoglu wrote:
[...]
JLG I'm open to any suggestions anyone may have.  I've thought
JLG about using virtusertable on the gateway box to rewrite the
JLG addresses so as to be delivered to the internal mail server,
JLG but I'm not sure about this.

Use a mailertable that sends everything for your domain[s] to the
internal server.  The bat book covers this, but so should the sendmail
docs.  I'll point out one usual pitfall though: if you use a mailetable
to route the inbound mail from a gateway host you should not have the 
routed domain[s] in the gateway sendmail's class w.

After finding the appropriate section in the bat book, I managed to get
this working really nice.  In .mc, you'd use 
define(`MAIL_HUB',`remotehost')dnl,
or modify DH in sendmail.cf.  I managed to get this working across my
whole network in a matter of an hour or so.

I'm really glad I found this, this keeps me from having to worry about NFS 
mounts
and machines hanging when the NFS server goes down for a reboot/maintenance/
what have you.

I haven't took down sendmail on the mail server yet to see what happens when 
it's
down (e.g. if the gateway box queues mail/etc.), but I'm about to.

Anyways, got it working.  Thanks for the pointer.

-jg

--
Jeremy L. Gaddis [EMAIL PROTECTED]




Re: RADIUS accounting and block accounts

2001-02-23 Thread Alan Harper
On Fri, Feb 23, 2001 at 09:15:47PM +1100, Jeremy Lunn wrote:
 I am about to finally set up portslave to authenticate with RADIUS (so
 that it can be replaced by a NAS).  Anyway the RADIUS authentication
 will backend to an LDAP database, but I was just wondering if it would
 be possible to backend the RADIUS accounting to a PostgreSQL database?
 Can anyone recommend a radius server that would support this (but it
 will be used exclusively for accounting, unless it supports LDAP and has
 a good license).
 
 This leads to the next question, I would like to be able to
 automatically disable accounts and disconnect them if they've used up
 more than allocated hours.  So say they have a 20 hour block acount,
 when it gets up to 20 hours I would like to d/c them and disable logins
 untill the next month.  Is this possible at all?  Or is it going to
 require a bit of hacking and a few perl scripts?
 
I aren't sure about Postgresql, but I know there is a patch to enable the 
Cistron Radiusd to log to a MySQL database. There is a link on the cistron 
radius website (I don't have the link handy, but a quick search on freshmeat 
will find it)

Cheers,
Alan