Re: make buildkernel failing on zfs - fixed but now everything is slow

2010-01-24 Thread Colin

Colin wrote:

Thanks for the reply.
I must admit that the ins and outs of paging and interrupts are 
something I don't have much expertise in. I've asked the colo company 
to look into it but I've put the output of those commands into 
pastebin incase anything stands out.

http://www.pastebin.org/81107



I suspect this is an none issue now as everything is OK. My best guess 
is that the RAID array was rebuilding itself as there were a few mpt cam 
events logged overnight and the problem seems to have gone away after that.


Now I'm left with one problem which is a bit different so I'll start it 
on its own topic

Cheers for the help folks.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs - fixed but now everything is slow

2010-01-23 Thread Colin

Jeremy Chadwick wrote:

On Sat, Jan 23, 2010 at 03:27:12PM +, Colin wrote:
  

There's nothing obvious that I can see in any other logfiles, are
there any tools or other things that I can use to figure out why the
system is so sluggish now?



A couple things I can think of:

vmstat -c 30 -w 1
vmstat -i
vmstat -s

  

Thanks for the reply.
I must admit that the ins and outs of paging and interrupts are 
something I don't have much expertise in. I've asked the colo company to 
look into it but I've put the output of those commands into pastebin 
incase anything stands out.

http://www.pastebin.org/81107

You guys have been very helpful these couple of months so I guess I'd 
best go find that donate button. Its the least I can do!


Cheers,
Colin.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs - fixed but now everything is slow

2010-01-23 Thread Jeremy Chadwick
On Sat, Jan 23, 2010 at 03:27:12PM +, Colin wrote:
> There's nothing obvious that I can see in any other logfiles, are
> there any tools or other things that I can use to figure out why the
> system is so sluggish now?

A couple things I can think of:

vmstat -c 30 -w 1
vmstat -i
vmstat -s

-- 
| Jeremy Chadwick   j...@parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.  PGP: 4BD6C0CB |

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs - fixed but now everything is slow

2010-01-23 Thread Colin

Hi again folks.

Thanks to all the suggestions I have gotten the new world/kernel up and 
running finally, unfortunately I seem to be having problems now. The 
entire system is sluggish and unresponsive. Even trying to scroll 
through a vi session jumps and pauses all the time.


Whether it is bringing up an SSH session, something through apache or 
anything else on the system is can take anywhere up to 20 second to 
respond which is not good.


top gives me the impression that its not any kind of runaway process or 
anything like that


last pid: 78629;  load averages:  0.00,  0.03,  0.06  
116 processes: 1 running, 115 sleeping

CPU:  0.6% user,  0.0% nice,  0.6% system,  0.0% interrupt, 98.9% idle
Mem: 787M Active, 2057M Inact, 200M Wired, 101M Cache, 112M Buf, 114M Free
Swap: 8000M Total, 1708K Used, 7998M Free

There's nothing obvious that I can see in any other logfiles, are there 
any tools or other things that I can use to figure out why the system is 
so sluggish now?

Cheers
Colin.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs

2010-01-22 Thread John Baldwin
On Friday 22 January 2010 6:17:08 am Jeremy Chadwick wrote:
> On Fri, Jan 22, 2010 at 09:45:46AM +, N.J. Mann wrote:
> > In message <4b596838.9020...@southportcomputers.co.uk>,
> > Colin (free...@southportcomputers.co.uk) wrote:
> > >
> > [snip]
> > > It goes for a while and then the buildkernel fails with this:
> > > 
> > > cc -O2 -fno-strict-aliasing -pipe -DFREEBSD_NAMECACHE -DBUILDING_ZFS  
> > > -D_KERNEL -DKLD_MODULE -std=c99 -nostdinc  
> > > -I/usr/src/sys/modules/zfs/../../cddl/compat/opensolaris 
> > > -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/commo
> > > n/fs/zfs 
> > > -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/zmod 
> > > -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common 
> > > -I/usr/src/sys/modules/zfs/../.. 
> > > -I/usr/src/sys/modules/zfs/../../cddl/contrib/openso
> > > laris/common/zfs 
> > > -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/common 
> > > -I/usr/src/sys/modules/zfs/../../../include -DHAVE_KERNEL_OPTION_HEADERS 
> > > -include /usr/obj/usr/src/sys/TED/opt_global.h -I. -I@ -I@/contrib/altq 
> > > -finline-l
> > > imit=8000 --param inline-unit-growth=100 --param 
> > > large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/TED 
> > > -mno-align-long-strings -mpreferred-stack-boundary=2  -mno-mmx 
> > > -mno-3dnow -mno-sse -mno-sse2 -mno-sse3 -ffreestanding -
> > > Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes  
> > > -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual  -Wundef 
> > > -Wno-pointer-sign -fformat-extensions -Wno-unknown-pragmas 
> > > -Wno-missing-prototypes -Wno-undef -Wno-strict-pro
> > > totypes -Wno-cast-qual -Wno-parentheses -Wno-redundant-decls 
> > > -Wno-missing-braces -Wno-uninitialized -Wno-unused -Wno-inline 
> > > -Wno-switch -Wno-pointer-arith -c 
> > > /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_z
> > > node.c
> > > *** Error code 1
> > 
> > I think this was a temporary problem that has already been fixed.  Try
> > updating to the latest version and see if that builds okay.
> 
> The FreeBSD tinderbox build system noticed this problem as well, dying
> in the same piece of code.  It's not you.
> 
>  738 01/21 17:04  FreeBSD Tinderbox   (9.0K) [releng_7 tinderbox] failure 
> on amd64/amd64
>  739 01/21 17:44  FreeBSD Tinderbox   (8.7K) [releng_7 tinderbox] failure 
> on i386/i386
> 
> Normally I'd shake my finger at the committer for committing code to
> stable branches without testing, but I hold the committer (jhb) in very
> high regards and he has a very established history of not breaking
> things + doing excellent work.  Mistakes happen, we're all human.  :-)

Kind words aside, in this case the testing wasn't quite adequate.  While I
did run-test it under UFS, I only built a GENERIC kernel w/o modules which is
how I missed ZFS.  Given that the patch touched ZFS I really should have
built the module.

-- 
John Baldwin
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs

2010-01-22 Thread Dmitry Morozovsky
On Fri, 22 Jan 2010, Ruben de Groot wrote:

RdG> > Could you post your /etc/make.conf?
RdG> > That said, I recon you build your kernel in a rather wierd way. Delete
RdG> > /usr/obj/* and run "make cleandir && make cleandir" in /usr/src. Then
RdG> 
RdG> Bit redundant ;)
RdG> cleandir only effects /usr/obj, which you just blew away.

Not exactly: without objdir, cleandir removes built objects from source 
directory (where they may accidentally reside if one type 'make all' without
'make obj' previously)

-- 
Sincerely,
D.Marck [DM5020, MCK-RIPE, DM3-RIPN]
[ FreeBSD committer: ma...@freebsd.org ]

*** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- ma...@rinet.ru ***

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs

2010-01-22 Thread Jeremy Chadwick
On Fri, Jan 22, 2010 at 09:45:46AM +, N.J. Mann wrote:
> In message <4b596838.9020...@southportcomputers.co.uk>,
>   Colin (free...@southportcomputers.co.uk) wrote:
> >
> [snip]
> > It goes for a while and then the buildkernel fails with this:
> > 
> > cc -O2 -fno-strict-aliasing -pipe -DFREEBSD_NAMECACHE -DBUILDING_ZFS  
> > -D_KERNEL -DKLD_MODULE -std=c99 -nostdinc  
> > -I/usr/src/sys/modules/zfs/../../cddl/compat/opensolaris 
> > -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/commo
> > n/fs/zfs 
> > -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/zmod 
> > -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common 
> > -I/usr/src/sys/modules/zfs/../.. 
> > -I/usr/src/sys/modules/zfs/../../cddl/contrib/openso
> > laris/common/zfs 
> > -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/common 
> > -I/usr/src/sys/modules/zfs/../../../include -DHAVE_KERNEL_OPTION_HEADERS 
> > -include /usr/obj/usr/src/sys/TED/opt_global.h -I. -I@ -I@/contrib/altq 
> > -finline-l
> > imit=8000 --param inline-unit-growth=100 --param 
> > large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/TED 
> > -mno-align-long-strings -mpreferred-stack-boundary=2  -mno-mmx 
> > -mno-3dnow -mno-sse -mno-sse2 -mno-sse3 -ffreestanding -
> > Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes  
> > -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual  -Wundef 
> > -Wno-pointer-sign -fformat-extensions -Wno-unknown-pragmas 
> > -Wno-missing-prototypes -Wno-undef -Wno-strict-pro
> > totypes -Wno-cast-qual -Wno-parentheses -Wno-redundant-decls 
> > -Wno-missing-braces -Wno-uninitialized -Wno-unused -Wno-inline 
> > -Wno-switch -Wno-pointer-arith -c 
> > /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_z
> > node.c
> > *** Error code 1
> 
> I think this was a temporary problem that has already been fixed.  Try
> updating to the latest version and see if that builds okay.

The FreeBSD tinderbox build system noticed this problem as well, dying
in the same piece of code.  It's not you.

 738 01/21 17:04  FreeBSD Tinderbox   (9.0K) [releng_7 tinderbox] failure 
on amd64/amd64
 739 01/21 17:44  FreeBSD Tinderbox   (8.7K) [releng_7 tinderbox] failure 
on i386/i386

Normally I'd shake my finger at the committer for committing code to
stable branches without testing, but I hold the committer (jhb) in very
high regards and he has a very established history of not breaking
things + doing excellent work.  Mistakes happen, we're all human.  :-)

-- 
| Jeremy Chadwick   j...@parodius.com |
| Parodius Networking   http://www.parodius.com/ |
| UNIX Systems Administrator  Mountain View, CA, USA |
| Making life hard for others since 1977.  PGP: 4BD6C0CB |

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs

2010-01-22 Thread Ruben de Groot
On Fri, Jan 22, 2010 at 10:40:17AM +0100, Christer Solskogen typed:
> On Fri, Jan 22, 2010 at 9:56 AM, Colin  
> wrote:
> 
> > Anyone got any pointers?
> 
> Could you post your /etc/make.conf?
> That said, I recon you build your kernel in a rather wierd way. Delete
> /usr/obj/* and run "make cleandir && make cleandir" in /usr/src. Then

Bit redundant ;)
cleandir only effects /usr/obj, which you just blew away.

Ruben

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs

2010-01-22 Thread Colin

N.J. Mann wrote:

In message <4b596838.9020...@southportcomputers.co.uk>,
Colin (free...@southportcomputers.co.uk) wrote:
  
[snip]
  

It goes for a while and then the buildkernel fails with this:

cc -O2 -fno-strict-aliasing -pipe -DFREEBSD_NAMECACHE -DBUILDING_ZFS  
-D_KERNEL -DKLD_MODULE -std=c99 -nostdinc  
-I/usr/src/sys/modules/zfs/../../cddl/compat/opensolaris 
-I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/commo
n/fs/zfs 
-I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/zmod 
-I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common 
-I/usr/src/sys/modules/zfs/../.. 
-I/usr/src/sys/modules/zfs/../../cddl/contrib/openso
laris/common/zfs 
-I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/common 
-I/usr/src/sys/modules/zfs/../../../include -DHAVE_KERNEL_OPTION_HEADERS 
-include /usr/obj/usr/src/sys/TED/opt_global.h -I. -I@ -I@/contrib/altq 
-finline-l
imit=8000 --param inline-unit-growth=100 --param 
large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/TED 
-mno-align-long-strings -mpreferred-stack-boundary=2  -mno-mmx 
-mno-3dnow -mno-sse -mno-sse2 -mno-sse3 -ffreestanding -
Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes  
-Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual  -Wundef 
-Wno-pointer-sign -fformat-extensions -Wno-unknown-pragmas 
-Wno-missing-prototypes -Wno-undef -Wno-strict-pro
totypes -Wno-cast-qual -Wno-parentheses -Wno-redundant-decls 
-Wno-missing-braces -Wno-uninitialized -Wno-unused -Wno-inline 
-Wno-switch -Wno-pointer-arith -c 
/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_z

node.c
*** Error code 1



I think this was a temporary problem that has already been fixed.  Try
updating to the latest version and see if that builds okay.


Cheers,
   Nick.
  
Ahh if that is the case then the build I currently have running should 
work seen as I ran a csup less than an hour ago.

Fingers crossed!
Regards,
Colin.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs

2010-01-22 Thread Colin

Christer Solskogen wrote:

On Fri, Jan 22, 2010 at 9:56 AM, Colin  wrote:

  

Anyone got any pointers?



Could you post your /etc/make.conf?
That said, I recon you build your kernel in a rather wierd way. Delete
/usr/obj/* and run "make cleandir && make cleandir" in /usr/src. Then
build your world and kernel like this "make buildworld buildkernel
KERNCONF=TED". If that goes as well, run "make installkernel
KERNCONF=TED", reboot, "make installworld", run mergemaster and reboot
again.


  

Thanks for the reply.
I have deleted /usr/obj in between builds (forgot to mention that) but 
didn't do make cleandir. I think the first way that I did the build when 
I started was similar to what you suggested but I was having problems 
with installworld so after various reading and suggestions dropped back 
to that format which I read was a more paranoid way of doing it.


make.conf as below:

SUP=/usr/local/bin/cvsup
SUPFLAGS=   -g -L 2
SUPHOST=cvsup.FreeBSD.org
SUPFILE=/root/standard-supfile
PORTSSUPFILE=   /root/ports-supfile

#*REMOVE* OPENSSL_OVERWRITE_BASE=NO

# added by use.perl 2009-06-14 11:10:18
#PERL_VERSION=5.8.9
#BATCH=YES
#CRYPT_DES=0
#WITHOUT_ALT_CONFIG_PREFIX=YES

#CFLAGS= -O -pipe
NO_FORTRAN= true
NO_OBJC=true
NO_X=   true
NO_GAMES=true
NO_PROFILE=  true

BATCH=YES
WITHOUT_X11=YES
SKIP_DNS_CHECK=YES
CRYPT_DES=0
WITH_PORT_REPLACES_BASE_BIND8=YES
WITH_PORT_REPLACES_BASE_BIND9=YES
WITHOUT_ALT_CONFIG_PREFIX=YES
WITH_OPENSSL_PORT=YES
X11BASE=${LOCALBASE}

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs

2010-01-22 Thread N.J. Mann
In message <4b596838.9020...@southportcomputers.co.uk>,
Colin (free...@southportcomputers.co.uk) wrote:
>
[snip]
> It goes for a while and then the buildkernel fails with this:
> 
> cc -O2 -fno-strict-aliasing -pipe -DFREEBSD_NAMECACHE -DBUILDING_ZFS  
> -D_KERNEL -DKLD_MODULE -std=c99 -nostdinc  
> -I/usr/src/sys/modules/zfs/../../cddl/compat/opensolaris 
> -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/commo
> n/fs/zfs 
> -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/zmod 
> -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common 
> -I/usr/src/sys/modules/zfs/../.. 
> -I/usr/src/sys/modules/zfs/../../cddl/contrib/openso
> laris/common/zfs 
> -I/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/common 
> -I/usr/src/sys/modules/zfs/../../../include -DHAVE_KERNEL_OPTION_HEADERS 
> -include /usr/obj/usr/src/sys/TED/opt_global.h -I. -I@ -I@/contrib/altq 
> -finline-l
> imit=8000 --param inline-unit-growth=100 --param 
> large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/TED 
> -mno-align-long-strings -mpreferred-stack-boundary=2  -mno-mmx 
> -mno-3dnow -mno-sse -mno-sse2 -mno-sse3 -ffreestanding -
> Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes  
> -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual  -Wundef 
> -Wno-pointer-sign -fformat-extensions -Wno-unknown-pragmas 
> -Wno-missing-prototypes -Wno-undef -Wno-strict-pro
> totypes -Wno-cast-qual -Wno-parentheses -Wno-redundant-decls 
> -Wno-missing-braces -Wno-uninitialized -Wno-unused -Wno-inline 
> -Wno-switch -Wno-pointer-arith -c 
> /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_z
> node.c
> *** Error code 1

I think this was a temporary problem that has already been fixed.  Try
updating to the latest version and see if that builds okay.


Cheers,
   Nick.
-- 

___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"


Re: make buildkernel failing on zfs

2010-01-22 Thread Christer Solskogen
On Fri, Jan 22, 2010 at 9:56 AM, Colin  wrote:

> Anyone got any pointers?

Could you post your /etc/make.conf?
That said, I recon you build your kernel in a rather wierd way. Delete
/usr/obj/* and run "make cleandir && make cleandir" in /usr/src. Then
build your world and kernel like this "make buildworld buildkernel
KERNCONF=TED". If that goes as well, run "make installkernel
KERNCONF=TED", reboot, "make installworld", run mergemaster and reboot
again.


-- 
chs
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"