filesystem full after many mmap/munmap cycles

2008-04-05 Thread Mark Bucciarelli
Hi,

I'm running FreeBSD 7.0 RC1 on AMD 64, dual Opteron with h/w raid1 (scsi).

I have an app server that uses mmap a lot.  After running a long batch
(four hours, 5,100+ transactions), I got the message filesystem full
(/usr--ufs, local, soft-updates).  df -i says plenty of space.

I restarted the batch process, and watched app server process
carefully with fstat -p, and it looks to be behaving responsibly.  The
open file list is short, and when I looked up the file names by inum,
they were correct.

Each transaction does a mmap/munap cycle with a (big ?) file (79M),
then copies another smaller file, using mmap to do the copy.  fwrite
failed on the copy operation; FreeBSD said no space.  (When fwrite
failed, I called abort, so I have a core and can see where it
happened.)

pid 29990 (r.fcgi), uid 1001 inumber 359181 on /usr: filesystem full
pid 29990 (r.fcgi), uid 1001: exited on signal 11

Filesystem  1K-blocksUsed   Avail Capacity iused  ifree %iused  Mounted on
/dev/da0s1g   6297070 3380066 241324058%  183869 640449   22%   /usr

Is there some file system delay (maybe something related to
softupdates) that could accumulate in some way that would cause the
file system full message?

Please CC me, as I'm not a subscriber.

Thanks,

m
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


[LONG] vmstat: What I/O is blocked and how to fix it?

2005-12-13 Thread Mark Bucciarelli
On two occasions recently, vmstat has showed me that a 
number of processes are blocked due to I/O.  At the same 
time, the number of disk transactions per second reported is 
a small fraction of the disk's capability.

I am thinking some kind of VM config will help, but based on what 
I have read, it is almost always best to let the default kernel 
behavior do its thing.  

Setup: 

Dual PIII 1.0 GHz (256MB L1 and L2 cache)
3GB RAM 
custom kernel (SMP + PF)
5.4-RELEASE
one intel fxp0 network interface used (second unused)


Case 1: (da0 36GB SCSI)

The first case is simple: running spamd-setup to load 
the huge Composite Blacklist into spamd.  The only other 
things running are sshd and spamd itself.

When I run vmstat (vmstat -w 1 -c 10 output attached), 
it shows ten processes blocked due to I/O, 1 runnable 
and a total of four disk transactions during this 
particular ten-second interval.  

Accoring to postmark [1] da0 is capable of 250 
transactions per second.

Interrupts look fine (200 of the 300/sec is the clock, 
right?).

No swapping.  No network traffic to speak of.

High CPU usage.

Paging looks really high to me.  I have plenty of RAM 
and swap--so why is it so high?  

Is there a kernel param I can tweak to improve 
performance? 

Note:   While this was running, I tried running vmstat 
-m and got the kmem_map too small error.  (I 
read the FAQ entry and haven't yet rebuilt the 
kernel using VM_KMEM_SIZE_MAX.)

Should I make VM_KMEM_SIZE_MAX 400MB as mentioned in the FAQ?

Any other kernel settings to switch from defaults when I 
build the kernel?


Case 2: (mirror/gm0, da0 + da1 300GB SCSI)

This case is more complex and more important.  This box 
was heavily loaded, running SpamAssassin + ClamAv in one 
jail, Courier-MTA + MySql in another, and dspamd + pf in 
the jail host.  

It was processing about one incoming email per second, 
and had 20,000 entries in the spamd greylist and 4,000 
in the whitelist.  The black list was not loaded.

Courier-authlib was using MySQL to figure out where to 
deliver the mail to for each of 20,000 virtual users.

Courier-MTA was calling the ClamAV daemon via TCP/IP 
from a courier filter and calling SpamAssassin via 
TCP/IP from maildrop.

Spamd (as in OpenBSD, not Apache) and courier were 
hitting the disk hard--I watched top in m mode [2] and 
over a five minute period these two apps had about 
pretty much 50% each of the WRITES.

The only thing that jumps out at me is that when things 
finally do get written to disk, the context switches go 
really high.

Is this a VM issue of some sort?  The disk transactions 
per second are really low; this 300GB SCSI can do 
730/sec according to postmark (well, this was testing on 
a single disk not with the RAID1 gmirror).


Thanks for any tips.

m

[1] /usr/ports/benchmarks/postmark 

[2] Where can I find docs on what the columns mean in top's 
m mode?
 procs  memorypage  disks faults   cpu
 r  b w avmfreflt  re  pi  pofr  sr da0 da1   in   sy  cs us sy 
id
 1 10 0  190424 1653924  1065   0   0   0  1337   0   0   0  796 2931 1971 3  8 
89
 1 10 0  190520 1653824 17407   0   0   0 17401   0   0   0  356  111 280 44 56 
 0
 1 10 0  167376 1676992 23264   0   0   0 23264   0   0   0  359  119 301 40 23 
37
 1 10 0  190808 1659240 27728   0   0   0 29152   0   0   0  351  114 297 39 14 
47
 1 10 0  190936 1676864 18992   0   0   0 17544   0   4   0  352  115 286 39 45 
17
 1 10 0  191032 1676808 17586   0   0   0 17586   0   0   0  349  115 291 41 52 
 7
 1 10 0  191160 1658572 28025   0   0   0 29374   0   0   0  347  114 270 42 10 
47
 1 10 0  191320 1676668 24949   0   0   0 23576   0   0   0  346  122 280 36 16 
47
 1 10 0  191384 1652968 17730   0   0   0 17724   0   0   0  350  111 278 41 59 
 0
 1 10 0  191512 1665912 20409   0   0   0 23688   0   0   0  373  113 304 39 40 
21
 procs  memory   page disks faults cpu
 r  b w avm fre  flt  re  pi  po   fr  sr da0 da1   insycs us 
sy id
 0 27 0  345932 2622260  333   0   0   0  318   0   0   0  504  1261   842  8  
3 89
 0 25 0  341644 2622880   78   0   0   0  215   0   0   0  535   195   575  0  
5 95
 0 25 0  341644 26228800   0   0   00   0   0   0  455   159   458  0  
6 94
 0 25 0  341644 26228805   0   0   05   0   5   5  488   165   572  0  
4 96
 1 25 0  343856 2622408  270   0   0   0  126   0   3   4  472   867   706  1  
7 92
 0 28 0  355672 2620588 2356   0   0   0 1701   0  44  44  749  6224  1988 24 
13 63
 1 29 0  357616 2620356 1961   0   0   0 1757   0  44  44  819  7174  2333 46 
15 39
 1 29 0  357620 2620360  809   0   0   0  735   0  25  25  700  2694  1247 65  
8 27
 0 29 0  

Re: courier-authlib-0.58 dumps core at login

2005-12-13 Thread Mark Bucciarelli
On Sun, Dec 11, 2005 at 10:17:16PM -0500, Louis LeBlanc wrote:

 On 12/11/05 09:44 PM, Louis LeBlanc sat at the `puter and typed: These
 passwords do match, but the debug log shows a rejection.

I use MySql for users and recently noted that if maildir, uid and/or gid 
is not set properly the auth failed (even tho passwords matched).

Not sure if this applies to authpamd.

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: hardening FreeBSD for Spamassassin

2005-12-08 Thread Mark Bucciarelli
On Thu, Dec 08, 2005 at 01:56:52AM +0200, Vahric MUHTARYAN wrote:

 And I want to handle 130,000 mail/hour with using 2 or 4 P4 server
 with raid1 and 2 or 4 gb ram .

Try pf + spamd (the FreeBSD port of the OpenBSD app) to cut out as much 
mail as possible before it hits spamassassin.

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


nullfs [was: Need urgent help regarding security]

2005-11-17 Thread Mark Bucciarelli
On Wed, Nov 16, 2005 at 10:16:16PM -0700, Chad Leigh -- Shire.Net LLC
wrote:

 I then create one or more jails that use nullfs to READ ONLY mount
 specific parts of the master hierarchy into the jail.

This is very interesting to me, as I are currently working on a jail
design and nullfs has a number of question marks next to it, mainly due
to the scary man page warning. Here are a few of the questions:

How did you decide it was trustworthy?

Does it result in lower RAM usage? (The program that is run, for
example, Apache, comes from the same spot on the disk across all jails.)

Is it currently maintained? The man page includes a maintainer
solicitation.

Have you had any problems in production?

Have you used it for long?

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Status of 6.0 for production systems

2005-11-16 Thread Mark Bucciarelli
Wow, did this thread veer off-topic!

On Tue, Nov 15, 2005 at 11:50:40PM +, Chris wrote:
 That is indeed a waste but consider that in that year the PC at 150
 watts

This is probably a high estimate, especially for an older, single-cpu 
box.

 has consumed 60 times as much power as the router at 2.5 watts. I make
 that 1314kWh for the PC and 21.9kWh for the router 24/7 for a year.
 Anyone know how much power it takes to manufacture and deliver a small
 router? And maybe other routers last a bit longer.

You can probably get an idea from extrapolating these figures [1]:

RAM:  11.4 kWh and   32   L water for 32 MB chip
CPU:   1.4 kWh and5.9 L water per square-cm silicon wafer
LCD: 553   kWh and 2394   L water for a 15 monitor

A dragonball CPU (2 dies each .343cm x .343 cm) requires 0.3 kWh and 
1.4L.

The impact of producing a CPU seems low to me, especially when compared
to the RAM. Needs to do some more research ... :)

m

[1] Environmnetal Implications of New Wireless Technologies: 
News Delivery and Business Meetings
by Michael W. Toffel, Haas School of Biz, UCal Berkely
and Arpad Horvath, Civil Eng, UCal Berkely
accepted for publication 3/18/2004 in American Chemical Society
http://www.haas.berkeley.edu/responsiblebusiness/documents/wireless_asap.pdf

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Linux computability

2005-10-28 Thread Mark Bucciarelli
On Sun, Oct 23, 2005 at 02:45:42PM +1000, Michael Christie wrote:

 Now Linux programs run in side of the jail.

Thanks for posting what you had success with.

I followed your instructions, but when I try to install the java/jdk14 
port inside the jail, I get the message that I need to mount 
/compat/linux/proc.  

Could it be a difference in the value of security.jail.getfsstatroot?
What is the value of this param on your machine?

Any other ideas?

Details (FreeBSD 5.4):

bash-2.05b# mount | grep linprocfs
linprocfs on /web/jail/myjail/compat/linux/proc (linprocfs, local)
bash-2.05b# jexec 41 /usr/local/bin/bash
bash-2.05b# cd /usr/ports/java/jdk14
bash-2.05b# make install clean
[...]
ERROR: You have to have LINPROCFS mounted before
starting to build of native JDK 1.4.2.

You may do it by following set of commands:

# kldload linprocfs
#
# and
#
# # mount -t linprocfs linprocfs /compat/linux/proc
#
# *** Error code 1
#
# Stop in /usr/ports/java/jdk14.

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Linux computability

2005-10-28 Thread Mark Bucciarelli
On Fri, Oct 28, 2005 at 10:32:24AM -0400, Mark Bucciarelli wrote:
 On Sun, Oct 23, 2005 at 02:45:42PM +1000, Michael Christie wrote:
 
  Now Linux programs run in side of the jail.
 
 Thanks for posting what you had success with.
 
 I followed your instructions, but when I try to install the java/jdk14 
 port inside the jail, I get the message that I need to mount 
 /compat/linux/proc.  
 
 Could it be a difference in the value of security.jail.getfsstatroot?
 What is the value of this param on your machine?

Just for the record, I shut off this restriction and the port started 
compiling inside the jail.  :)

I'd like to turn it back on once jdk builds--can anybody tell me if 
java/jdk14 requires linprocfs?  (I would guess not ...)

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


linux: command not found

2005-10-27 Thread Mark Bucciarelli
I'm trying to load the linux kernel module to install java.

When I type linux, I get a command not found error.

Do I need to install a port or is this an issue with my kernel 
configuration?

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Cannot open /dev/tty for read

2005-10-05 Thread Mark Bucciarelli
I get the error in the subject line when trying to install the www/interchange
port inside a jail. The full output of the make command is below.

I'm using the standard devfs rule set 4 with the following addition:

# devfs -m /web/jail/myjail/dev rule apply add path 'tty' unhide

From inside the jail:

# ls -l /dev/tty
crw-rw-rw-  1 root  wheel5,   1 Oct  5 21:06 /dev/tty

The offending line in Makefile.PL is

my $term;
if($TermRead) {
 here.   $term = new Term::ReadLine 'MakeFile';
  $Prompt_sub = sub {
my($prompt, $default) = @_;
$prompt .= [$default] 
  if defined $default  !$ENV{PERL_RL};
return $term-readline($prompt, $default);
  };
}

If I comment this out and just use Perl instead of Term::Readline, the 
install completes successfully.

Am I doing something wrong with devfs or should I file a problem report 
against this port?

Here's the full output of the make install:  

# make -DCHECK_FOR_IC_USER install clean
===  Installing for interchange-4.8.7
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/SQL/Statement.pm - found
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/mach/Storable.pm - found
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/mach/Safe/Hole.pm - found
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/mach/Digest/MD5.pm - found
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/mach/MIME/Base64.pm - found
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/LWP/Simple.pm - found 
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/URI/URL.pm - found
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/Term/ReadLine/Perl.p - found
===   interchange-4.8.7 depends on file: 
/usr/local/lib/perl5/site_perl/5.8.7/mach/Term/ReadKey.pm - found
===   interchange-4.8.7 depends on file: /usr/local/bin/perl5.8.7 - found
===   Generating temporary packing list
===  Checking if www/interchange already installed
Writing /usr/local/lib/perl5/site_perl/5.8.7/mach/auto/Interchange/.packlist
/usr/local/bin/perl5.8.7 Makefile.PL force nocpaninstall=1 
INTERCHANGE_USER=interch final=/usr/local/interchange
Cannot open /dev/tty for read at Makefile.PL line 64
*** Error code 16

Stop in /usr/ports/www/interchange/work/interchange-4.8.7.
*** Error code 1

Stop in /usr/ports/www/interchange.


Regards,

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: PHP4 PHP5 on same server?

2005-09-27 Thread Mark Bucciarelli
On Tue, Sep 27, 2005 at 11:16:04AM +0200, [EMAIL PROTECTED] wrote:
 Mark Bucciarelli wrote:
 Is it possible install both php4 and php5 on the same server using
 ports?
 
 I'm using fastcgi so two different interpreters should be fine.  (Rename 
 /usr/local/bin/php to /usr/local/bin/php5-fcgi, for example.)
 
 Can I assume the php4 and php5 modules (for example, pear) won't step on
 each other's toes?
 
 I google around but didn't find much on this topic ... :(
 
 m
 
 We have them as mod with two chrooted Apache servers on two different IPs.

Thanks for the reply.

From doing some more research list night, my understanding is that
the php binary is the whole kit and kaboodle, so if I 

- build PHP4 from source and

- configure it to look in a different spot for extensions,

then I should be able to use PHP4 and PHP5 via fastcgi on a per-vhost
basis.

I just won't be able to rely on ports for updates to PHP4.

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Limit client connections ssh

2005-09-27 Thread Mark Bucciarelli
On Tue, Sep 27, 2005 at 02:27:26PM -0500, Efren Bravo wrote:

 I'm using ssh to connect me to fBSD server, how can I limit the client
 connections?, I mean, I only only that the server(ssh) accept incoming
 connections from a specific IP or IPs range?

You can restrict to a subset of your system users by using AllowUsers
(or some such option) in /etc/ssh/sshd_conf.

If you are using key authentication, you can associate IP's with each 
public key in the ~/.ssh/authorized_keys file.

If you allow password authentication, you must use a firewall to 
restrict by IP.

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


PHP4 PHP5 on same server?

2005-09-26 Thread Mark Bucciarelli
Is it possible install both php4 and php5 on the same server using
ports?

I'm using fastcgi so two different interpreters should be fine.  (Rename 
/usr/local/bin/php to /usr/local/bin/php5-fcgi, for example.)

Can I assume the php4 and php5 modules (for example, pear) won't step on
each other's toes?

I google around but didn't find much on this topic ... :(

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Stale dependency question

2005-09-13 Thread Mark Bucciarelli
On a 5.4 box, pkgdb -F is reporting stale PHP dependencies and I'm
not sure of the correct way to fix it. For example (one of nine such
messages):

php5-mysql-5.0.4_2 - php5-5.0.4_2 (lang/php).

We have php5-cgi-5.0.4_2 installed, not php5-5.0.4_2.  So ...

1. Portversion tells me that php5-cgi needs upgrading--will doing a
   portupgrade on php5-cgi fix this stale dependency?

2. Or should I replace the php5 dependency with the php5-cgi when
   running pkgdb -F?

Where can I view a list of a port's dependencies? I tried poking
around the ports directories to figure out the dependencies, but
/usr/ports/databases/php5-mysql just has a Makefile which points to
../../lang/php5 as the MASTERDIR. Likewise, /usr/ports/www/php5-cgi just
has a Makefile that points to lang/php5.

This is inside a jail, with /usr/ports mounted nullfs from the jails
container. In the container, I did a cvsup and portsdb -Uu. Then in the
jail, I do pkgdb -F.

Let's see, the only other thing that might be relevant is that as part
of the original php5-cgi install, I renamed and moved the php binary
to a different place. Then, when pear needed the php binary, we make
a symlink from the moved and renamed binary back to the where pear
expected it.

Regards,

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: preventing a dual-mount of an NFS file system

2005-07-22 Thread Mark Bucciarelli
On Fri, Jul 22, 2005 at 04:59:56PM -0300, Marc G. Fournier wrote:
 
 Just curious if there is an option that can be set (I've checked the man 
 page, and didn't find one) that would prevent a file system from being 
 mounted twise on the same mount point?
 
 For instance, I have /du defined in my /etc/fstab, and want to prevent:
 
 mount /du
 mount /du
 
 from working ... the first should, but the second should fail ...

replace the mount binary with a shell script? 

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: VPN solution

2005-07-20 Thread Mark Bucciarelli
On Tue, Jul 19, 2005 at 11:26:17PM -0400, chris wrote:

 Im looking around for a VPN solution that utilizes IPSEC and ssl. What
 im really lookng for here on the list is suggestions. I need to use
 IPSEC and ssl due to what is being ran at work (running linux).  I
 dont need anything fancy, just somthing that will connect using the
 above security measures. Im currently running 4.x. Any help would be
 appreciated.

Would freenx work for you?

Uses X compression over SSH.  Has native clients for OSX, Windows and
Linux (not sure about a BSD client).

If the server at the office is not running X, you could install X and
ratpoison and pretend it is just screen on steroids.

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: better disk reliability on a desktop machine

2005-07-18 Thread Mark Bucciarelli
On Fri, Jul 15, 2005 at 03:35:55PM -0400, Chuck Swiger wrote:
 As someone else suggested, you can also stick things like config files into 
 version control (like CVS, subversion, etc), and then back that up via the 
 mechanism above.

Be careful about CVS and symbolic links.  They don't mix.  

Maybe not a big issue for FreeBSD startup scripts, but on Linux this was
a lesson I learned the hard way. ;)

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Network Debugging

2005-07-07 Thread Mark Bucciarelli
I'm trying to improve the performance of our rural homebrew wireless
broadband and am hoping some of the folks here can give me a pointer or
two as to what network monitoring tools I should use.

Background:

- my internet access is five wireless and five wired hops downstream
  from a 1/2 T1 (ten Buffalo AirStation G54 routers in all).

- my connection has a lot of jitter--ping's usually vary from 10ms to
  150ms within a two second window

- FWIU, jitter is related to congestion

- I have setup a FreeBSD box to monitor [1] each router along the path
  using smokeping.

The smokeping charts are showing me some interesting stuff.  Here is
some data from the past three hours (I am using the smokeping default of
20 pings sent every five minutes):

   |- Building 1 --|  |--- Bldg 0 --...

   +---+  ++  +---+ 
   | .203  |  | .202   |  | .201  |
   | Router In |- wire -| Router Out |- wireless -| Router In |
   +---+  ++  +---+ 

avg RTT: 7.3ms  12.1ms  7.8ms

 % lost: 2.37%  14.25%  2.64%

max RTT: 20ms   80ms13ms


My FreeBSD box is a four more wireless hops to the left of .203.

A slew of questions ...

What is going on here?

I am confused by the max RTT readings and packet loss stats for .202 and
.201.  How can a router further away from me have better performance?

Over the past 13 hours, the averages are consistent with the three-hour
averages, while the Max RTT discrepancies are even higher:

  .203 / .202 / .201 = 20ms / 145ms / 13ms.

Is .202 congested?  

Is the .202 router bad?

How can I debug this further?  SNMP?

If SNMP, what values should I track/inspect?  
  - # of packets with errors?
  - # of queued packets?
  - ??

Thanks for any pointers,

m

[1] Pentium II 350MHz with 4 Gb drive, underclocked to 100MHz so I can
turn off the power supply fan and make it real quiet.  :)

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: RAID Cards

2005-07-01 Thread Mark Bucciarelli
On Thu, Jun 30, 2005 at 04:34:13PM -0500, Dan Nelson wrote:
 In the last episode (Jun 30), Mark Bucciarelli said:
 
  I don't see the big win in hardware raid.
 
 The three big plusses for hardware raid are: if you get one with
 battery-backed cache (strongly recommended), then the array can cache raid-5
 writes until it gets full stripes, and can hold off doing mirror writes if
 there are pending read requests.  

Ah ... this is certainly a win for an io-bound system.

 Also, if your power goes out or the system spontaneously reboots, you won't
 have to rebuild parity or resync the mirrors (assuming battery-backed
 cache).  

We pay a lot of money to ensure the lights stay on and sacrifice small animals
to avoid spontaneous reboots.

 And finally, hardware raid cards will automatically rebuild onto a hot spare

I know I could do this with Linux software raid, not sure about gmirror.

 if available and you can swap out the dead drive and swap a new spare in
 without having to run a single command.

Another win.  Thanks, your brought up some issues I hadn't thought of.

I expect hardware raid cards will go the way of modems and printers and
offload their processing to the main CPU.  And I guess the choice partly
depends on whose software you trust more--free software from FreeBSD or
proprietary code written in a cathedral.  You can probabaly guess my bias.  ;)

m
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: RAID Cards

2005-06-30 Thread Mark Bucciarelli
On Thu, Jun 30, 2005 at 04:48:18PM -0400, Simon wrote:

 Just because there is no monitoring tool available due to lack of
 support, doesn't mean the card itself is bad. I much prefer hardware
 implementation than software.  True hardware RAID frees up a lot of
 CPU time if you have heavy IO and software just can't keep up if you
 utilize CPU intensive apps.

Why do you say hardware raid frees up a lot of CPU time?  Have you
measured this?

Do you have any servers that are cpu-bound instead of io-bound?

I am having this exact discussion with my business partner at the
moment--he is also a proponent of hardware raid.  I don't see the big
win in hardware raid.

I should probably search the archives, I sure this topic has been
covered in detail before ...

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: How Can I Clean Up Files That Don't Exist?

2005-06-29 Thread Mark Bucciarelli
On Wed, Jun 29, 2005 at 07:45:11AM -0700, Drew Tomlinson wrote:

 Any other ideas?

Any Windows shares involved?

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Software RAID-1 on FreeBSD 5.4

2005-06-29 Thread Mark Bucciarelli
On Wed, Jun 29, 2005 at 09:56:16PM +0200, ptitoliv wrote:

 But I have a last question. My disks are differents. One is a Maxtor
 detected with a 111 GB capacity and the other is a Seagate detected
 with a 114 GB capacity. Will I have problems trying to use RAID with
 this configuration ?

Not with gmirror.  Dunno about ccd.

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Best hardware to mirror IDE drives under FreeBSD?

2005-06-26 Thread Mark Bucciarelli

On Sun, Jun 26, 2005 at 03:28:35PM -0600, Brett Glass wrote:

 Nonetheless, the Web page is intriguing. Will the GEOM RAID subsystem really
 allow the machine to run and/or boot from either drive? 

It worked for me.  I unplugged each drive and rebooted after setting up
gmirror following that howto.

m
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Best hardware to mirror IDE drives under FreeBSD?

2005-06-26 Thread Mark Bucciarelli

On Sun, Jun 26, 2005 at 10:53:47PM +0200, Björn König wrote:

 Even most cheap ATA chipsets have hot-swap capabilities.

I didn't know hot swap was possible with software raid!

How can I tell if the ATA chipset on my system has hot-swap capability?

m
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Managing updates in jails

2005-06-25 Thread Mark Bucciarelli
On Wed, May 18, 2005 at 06:29:42PM +0200, Ruben Bloemgarten wrote:
 What I find a lot easier is to use freebsd-update for the base system
 updates and, after having mount_nullfs'd /usr/ports from the host system
 onto the jailed systems, portsnap and portupgrade. 
 - host system : freebsd-update/portsnap/portupgrade
Jailed system : freebsd-update/portupgrade

Thanks Ruben.

I have a couple follow-up questions.

(1) When do you run cvsup?

I don't understand the relationship between cvsup and portupgrade.  As I
understand things, portupgrade fetches the latest tarball of the given
port.   If this is indeed the case, why does the portupgrade man page have
a tip that says be sure to run portsdb -Uu everytime you cvsup?   This tip
suggests that you should run cvsup as part of the portupgrade routine.

(2) What value do you use for the base parameter in your cvsup file?

Should these bookkeeping files be shared between the jail and the
mothership?

Thanks,

m
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Managing updates in jails

2005-06-25 Thread Mark Bucciarelli
On Sun, Jun 26, 2005 at 12:31:42AM +0100, Alex Zbyslaw wrote:
 Mark Bucciarelli wrote:

I don't understand the relationship between cvsup and portupgrade.

 cvsup is a tool for maintaining a set of checked out files in sync with 
 a remote CVS repository without having to use CVS directly.  In the case 
 of the ports tree, those files are things like the Makefile, package 
 descriptions and patches.  

Ahhh ... light bulb goes off.

Thanks for your detailed post!

m
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Tuning FreBSD with specific applications

2005-06-02 Thread Mark Bucciarelli
On Thu, Jun 02, 2005 at 10:17:13PM +0200, Vittorio De Martino wrote:

 How could I obtain those improvements? What could I do to speed those
 programs under freebsd?

- Edit /etc/make.conf and set the processor and compiler optimizations.

- Rebuild and install system (world and kernel)

- Repost your results here. ;)

The BSD handbook has good docs on the last step of this process.  Coming
from Gentoo, you probably have a good idea what to do in the first step.

There is an example make.conf somewhere on you system you can look at
for other things to set.

If you want to get really detailed, look at the Makefile for R in it's
ports directory.  There may be some notes as to configure options and
performance.

FWIU, every port can have it's own set of configure options, and there
is a way to put conditionals inside make.conf; for example, if in this
ports directory, set this option.  I haven't used that yet, but if you
search the archives here you will find an example.

BTW, don't mess around with the new scheduler.  Just use the old BSD
one.  I did some testing (recompiled gcc) and the old one was faster on
a dual processor system.  From what someone told me on #freebsd, it
works but is not optimized yet.

Also, there are somethings you should do when testing speed.  You can
google to find the references, here's the two items I remember:

- use single user mode (no cron)
- unplug network cable (no broadcast packets)


Have fun!

m

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: vinum: Inappropriate ioctl for device

2005-05-27 Thread Mark Bucciarelli

FreeBSD questions mailing list wrote:

i tried Gvinum too but that doesn't have the setstate nor the ruibld  
parity command and still you can't stop gvinum (gvinum stop doesn't  
work, nor does kldunload geom_vinum.ko)


try gmirror for raid 1.  it worked great for me.

could gmirror and gstripe be used to get raid5?  i think i read a geom 
provider can be used as a consumer ...


___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Small business software for FreeBSD

2005-05-17 Thread Mark Bucciarelli
Damian Gerow wrote:
I've given the ports tree a quick search, and I've poked through
freshmeat.net and Google to no avail.  Does anyone know of any small
business management software -- something that can do quotes, invoicing,
time tracking, etc. -- that runs on FreeBSD?
sql-ledger.  (you have to do time tracking with sales orders.)
Regards,
m
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Managing updates in jails

2005-05-13 Thread Mark Bucciarelli
I'm a recent convert to FreeBSD, mainly because of the jail 
functionality.  I am trying to figure out a good system for keeping 
jails updated and am running against my lack of experience with the 
compile-from-source approach as well as the different startup scripts.

I have pretty much settled on the idea of creating a template or base 
jail, updating that, then creating a tarball that I can extract over any 
other jail I need to update.  I figure I won't have more than six jails 
and the complexity of hardlinks and/or unionfs/nullfs for me is not 
worth the saved disk space.

Currently, I have been making buildworld, make buildkernel, etc on the 
host, then repeating the process inside the template jail.  The host is 
just going to run sshd and ntpd, the template will be apache+mysql+php.

A couple questions:
- is there a correct way to reuse the makekernel and makeworld done on 
the host system for the template jail?  for example, using DESTDIR 
and/or NOREBUILD?  (I tried DESTDIR initially to install vim into the 
template jail, but when I ran vim inside the jail, it wouldn't start b/c 
it was missing a library.  So I back tracked and installed the entire 
ports tree inside the jail and built stuff from there.)  It takes around 
three hours to rebuild everything once, so this will be a limiting 
factor on how fast I can patch the system (unless I invest in another, 
faster machine just for compiling).

- what directories in the template jail do i need to tar when applying 
an upgrade to other jails?  just /usr and some selected pieces of /etc?

- i need to support multiple ip's per jail.  i found a patch that 
applies (pretty much--some wierdness in netinet6) against 5.4, but would 
like to use the existing rc.conf to manage startup.  where would i look 
to modify the jail startup command to pass multiple ips?

- what do people do with the mount command inside a jail--just delete 
it?  are there other commands you take out?

Thanks for any pointers, I think a section on jails would be a good 
addition to the handbook.

Regards,
m
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: backup

2005-05-13 Thread Mark Bucciarelli
Matt Juszczak wrote:
Problem with this is that I have to then create a tar file on the remote 
machine, because if I login with sftp from my remote machine, that 
account wont have access to read all the files it needs to read.
you can:
- create a password-protected ssh cert for root
- load key into ssh-agent on the client
- limit abilities of root ssh connections on server
  using rsync wrapper [1]
- rsync from remote server with cron.
m
[1] http://www.bombich.com/mactips/rsync.html
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: I need further HDD advice before submitting order.

2005-05-11 Thread Mark Bucciarelli
[EMAIL PROTECTED] wrote:
Chuck - I'm going to take your advice on setting up some kind of mirror, 
software RAID or whatever, thanks.
Just having gone through setting up software raid as my first 
post-install FreeBSD task, I can highly recommend gmirror.  It uses the 
new GEOM code (like gvinum) but gmirror has a man page and is feature 
complete.  As of 5.3, gvinum did not have all the commands implemented 
(not sure about it in 5.4).

If you are not using 5.x then sorry for missing the beginning of the thread.
Regards,
Mark
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]