Re: atop

2010-06-30 Thread Tim Gardner
On 06/30/2010 12:55 PM, John Johansen wrote:
> The server team has requested that the kernel team evaluate the inclusion
> of atop into the kernel as it allows for better task accounting.
>
> The kernel patches apply cleanly and have been built and have been lightly
> tested on the Maverick kernel.  With some discussion of the patches at
> https://lists.ubuntu.com/archives/kernel-team/2010-June/011307.html
>
> The remaining question is whether the atop patches should be included.
> There are a few concerns:
>
> PATCH 2 modifies the process-accounting record, into a layout that is
> incompatible with BSD v3 accounting.  I have looked around for what
> requires BSD v3 accounting and found a few accounting projects like gnus
> acct and elsa (http://elsa.sourceforge.net/),  But several other projects
> like htop (requires /proc), iotop, latencytop do not seem to be using it
> (though I didn't dive into the code to verify that).
>
> It is possible to apply just the first patch and obtain some of the atop
> functionality.
>
> The other immediate concerns with the patches are: potential performance
> regressions (none noticed in light testing), and just the general
> hesitance to accept patches that are out of tree/not going upstream.
>
> At this time I am unsure of the atop's projects planning for upstreaming
> I have contacted them but at this time do not have a reply.  With a
> quick search the last submission to LKML I can find is from 2008
> http://marc.info/?l=linux-kernel&m=120716470803492&w=2
> http://marc.info/?l=linux-kernel&m=120716470803498&w=2
> http://marc.info/?l=linux-kernel&m=120716470803497&w=2
>
>

You are correct in that I am reluctant to drag in unmaintained crack 
into core kernel structures.

I still find 'better task accounting' to be insufficient justification. 
What specifically makes for better task accounting? Why is atop better 
then other methods? As far as I can tell the current patches still 
suffer from the deficiencies mentioned by Andrew Morton in
http://marc.info/?l=linux-kernel&m=120716470803492&w=2

Gimme an example of a problem that atop will help solve for which no 
other method will suffice.

rtg
-- 
Tim Gardner tim.gard...@canonical.com

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


atop

2010-06-30 Thread John Johansen
The server team has requested that the kernel team evaluate the inclusion
of atop into the kernel as it allows for better task accounting.

The kernel patches apply cleanly and have been built and have been lightly
tested on the Maverick kernel.  With some discussion of the patches at
https://lists.ubuntu.com/archives/kernel-team/2010-June/011307.html

The remaining question is whether the atop patches should be included.
There are a few concerns:

PATCH 2 modifies the process-accounting record, into a layout that is
incompatible with BSD v3 accounting.  I have looked around for what
requires BSD v3 accounting and found a few accounting projects like gnus
acct and elsa (http://elsa.sourceforge.net/),  But several other projects
like htop (requires /proc), iotop, latencytop do not seem to be using it
(though I didn't dive into the code to verify that).

It is possible to apply just the first patch and obtain some of the atop
functionality.

The other immediate concerns with the patches are: potential performance
regressions (none noticed in light testing), and just the general
hesitance to accept patches that are out of tree/not going upstream.

At this time I am unsure of the atop's projects planning for upstreaming
I have contacted them but at this time do not have a reply.  With a
quick search the last submission to LKML I can find is from 2008
http://marc.info/?l=linux-kernel&m=120716470803492&w=2
http://marc.info/?l=linux-kernel&m=120716470803498&w=2
http://marc.info/?l=linux-kernel&m=120716470803497&w=2


-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


Re: Ubuntu Server: Kernel Configuration Considerations

2010-06-30 Thread Dan Sheffner
you are using a preseed.cfg file right?

You want to have this in there:

# The kernel image (meta) package to be installed; "none" can be used if no
# kernel is to be installed.
#d-i base-installer/kernel/image linux-generic
d-i base-installer/kernel/override-image string linux-server

That is what picks which kernel is should be running I believe.

I have documented allot of the PXE boot stuff here:
https://www.digisoftinc.org/wiki/index.php/Ubuntu_preseed.cfg_installs_off_PXE_Boot

As far as fixing it on each machine that is beyond my expertise but I
believe you would have to get the ubuntu server kernel...compile it
and then add it to your grub list.
Sorry if you are looking for a direct fix for each server.


On Wed, Jun 30, 2010 at 8:32 AM, Kaushal Shriyan
wrote:

> On Wed, Jun 30, 2010 at 6:49 PM, Dan Sheffner  wrote:
> > I think you want:
> >
> > d-i base-installer/kernel/override-image string linux-server
> >
> Hi Dan
>
> d-i base-installer/kernel/override-image string linux-server ?
>
> is that a command. I didnot understand it.
>
> Please help me understand
>
> Thanks and Regards
>
> Kaushal
>
> --
> ubuntu-server mailing list
> ubuntu-server@lists.ubuntu.com
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
> More info: https://wiki.ubuntu.com/ServerTeam
>
-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam

Re: Ubuntu Server: Kernel Configuration Considerations

2010-06-30 Thread Kaushal Shriyan
On Wed, Jun 30, 2010 at 6:49 PM, Dan Sheffner  wrote:
> I think you want:
>
> d-i base-installer/kernel/override-image string linux-server
>
Hi Dan

d-i base-installer/kernel/override-image string linux-server ?

is that a command. I didnot understand it.

Please help me understand

Thanks and Regards

Kaushal

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


Re: vmbuilder with tmpfs

2010-06-30 Thread Dan Sheffner
is there a way I can get that patch?  or test it?  I tried to get it from
the proposed repo with no luck.

On Wed, Jun 30, 2010 at 2:02 AM, Thierry Carrez
wrote:

> Dan Sheffner wrote:
> > Is anyone using the --tmpfs command with vmbuilder?  I'm using ubuntu
> > 10.04 64 bit and I get:
> >
> >  vmbuilder: error: no such option: --tmpfs
> >
> > and it clearly in the docs here:
> >
> > https://help.ubuntu.com/10.04/serverguide/C/jeos-and-vmbuilder.html
>
> See:
> https://bugs.launchpad.net/ubuntu/+source/vm-builder/+bug/536940
>
> --
> Thierry Carrez
> Ubuntu server team
>
> --
> ubuntu-server mailing list
> ubuntu-server@lists.ubuntu.com
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
> More info: https://wiki.ubuntu.com/ServerTeam
>
-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam

Re: Ubuntu Server: Kernel Configuration Considerations

2010-06-30 Thread Dan Sheffner
I think you want:

d-i base-installer/kernel/override-image string linux-server

what do you have in your file for that?



On Wed, Jun 30, 2010 at 8:14 AM, Kaushal Shriyan
wrote:

> Hi,
>
> The issue is that we have built ubuntu using kickstart/tftp/pxe image
> on all the 300 servers. The issue is with the pxe server. We found out
> that the running Kernel on all the ubuntu hosts are 2.6.24-16-generic
> and not 2.6.24-16-server.
>
> Please suggest me whats the best way to set it to correctly to
> 2.6.24-16-server on all the hosts running ubuntu 8.04 server(Hardy)
>
> Thanks and Regards
>
> Kaushal
>
> --
> ubuntu-server mailing list
> ubuntu-server@lists.ubuntu.com
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
> More info: https://wiki.ubuntu.com/ServerTeam
>
-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam

Ubuntu Server: Kernel Configuration Considerations

2010-06-30 Thread Kaushal Shriyan
Hi,

The issue is that we have built ubuntu using kickstart/tftp/pxe image
on all the 300 servers. The issue is with the pxe server. We found out
that the running Kernel on all the ubuntu hosts are 2.6.24-16-generic
and not 2.6.24-16-server.

Please suggest me whats the best way to set it to correctly to
2.6.24-16-server on all the hosts running ubuntu 8.04 server(Hardy)

Thanks and Regards

Kaushal

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


Re: high iowait

2010-06-30 Thread Benjamin Griese
For documentation purpose please just post your found solution.

Thanks! :)

On Wed, Jun 30, 2010 at 14:17, Kaushal Shriyan wrote:

> On Wed, Jun 30, 2010 at 2:24 PM, Dirk Deimeke  wrote:
> > Answering Kaushal Shriyan 
> > (Wed, 30 Jun 2010 14:03:19 +0530):
> >
> >> I have installed iotop already on my server. The issue is that i need
> >> to closely watch it regularly, is there a way i get notified when
> >> there is a high IO activity using iotop. I searched the web and saw
> >> sar utility too. Hence the question.
> >
> > Community is "give and take". I never see a message from your side,
> > that an advise helped you and I can't even find any experiences you
> > make with the tools suggested. Why?
> >
> > Paul suggested to use Munin.
> >
> >> Please suggest further.
> >
> > Give and take ...
> >
> > Cheers
> >
> > Dirk
>
> Hi Dirk,
>
> Did some web search again and made it worked this time. Thanks for all
> the help. And appreciate all the help and suggestions. Its a good
> learning experience.
>
> Thanks Sander,Paul
>
> Apologies again.
>
> Thanks and Regards
>
> Kaushal
>
> --
> ubuntu-server mailing list
> ubuntu-server@lists.ubuntu.com
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
> More info: https://wiki.ubuntu.com/ServerTeam
>



-- 
To be or not to be -- Shakespeare | To do is to be -- Nietzsche | To be is
to do -- Sartre | Do be do be do -- Sinatra
-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam

Re: high iowait

2010-06-30 Thread Kaushal Shriyan
On Wed, Jun 30, 2010 at 2:24 PM, Dirk Deimeke  wrote:
> Answering Kaushal Shriyan 
> (Wed, 30 Jun 2010 14:03:19 +0530):
>
>> I have installed iotop already on my server. The issue is that i need
>> to closely watch it regularly, is there a way i get notified when
>> there is a high IO activity using iotop. I searched the web and saw
>> sar utility too. Hence the question.
>
> Community is "give and take". I never see a message from your side,
> that an advise helped you and I can't even find any experiences you
> make with the tools suggested. Why?
>
> Paul suggested to use Munin.
>
>> Please suggest further.
>
> Give and take ...
>
> Cheers
>
> Dirk

Hi Dirk,

Did some web search again and made it worked this time. Thanks for all
the help. And appreciate all the help and suggestions. Its a good
learning experience.

Thanks Sander,Paul

Apologies again.

Thanks and Regards

Kaushal

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


Re: high iowait

2010-06-30 Thread Dirk Deimeke
Answering Kaushal Shriyan 
(Wed, 30 Jun 2010 14:03:19 +0530):

> I have installed iotop already on my server. The issue is that i need
> to closely watch it regularly, is there a way i get notified when
> there is a high IO activity using iotop. I searched the web and saw
> sar utility too. Hence the question.

Community is "give and take". I never see a message from your side,  
that an advise helped you and I can't even find any experiences you  
make with the tools suggested. Why?

Paul suggested to use Munin.

> Please suggest further.

Give and take ...

Cheers

Dirk

P.S.: Please reply only to the maling list.

-- 
Kontakt: http://d5e.org/contact
Blog:http://dirk.deimeke.net/
Podcast: http://deimhart.net/

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


Re: high iowait

2010-06-30 Thread Kaushal Shriyan
On Wed, Jun 30, 2010 at 1:55 PM, Dirk Deimeke  wrote:
> Answering Kaushal Shriyan 
> (Wed, 30 Jun 2010 13:45:04 +0530):
>
>>> Use iotop, shows exactly which is doing what and if it uses mostly reads
>>> or writes.
>>> Sander
>
>> Please suggest
>
> Is there any reason for you not to follow Sanders advice?
>
> Dirk
>
> --
> Kontakt: http://d5e.org/contact
> Blog:    http://dirk.deimeke.net/
> Podcast: http://deimhart.net/
>
> --
> ubuntu-server mailing list
> ubuntu-server@lists.ubuntu.com
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
> More info: https://wiki.ubuntu.com/ServerTeam
>

Hi Dirk,

I have installed iotop already on my server. The issue is that i need
to closely watch it regularly, is there a way i get notified when
there is a high IO activity using iotop. I searched the web and saw
sar utility too. Hence the question.

Please suggest further.

Thanks

Kaushal

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


Re: high iowait

2010-06-30 Thread Dirk Deimeke
Answering Kaushal Shriyan 
(Wed, 30 Jun 2010 13:45:04 +0530):

>> Use iotop, shows exactly which is doing what and if it uses mostly reads
>> or writes.
>> Sander

> Please suggest

Is there any reason for you not to follow Sanders advice?

Dirk

-- 
Kontakt: http://d5e.org/contact
Blog:http://dirk.deimeke.net/
Podcast: http://deimhart.net/

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


Re: high iowait

2010-06-30 Thread Kaushal Shriyan
On Wed, Jun 30, 2010 at 12:07 PM, Sander van Vugt  wrote:
> Use iotop, shows exactly which is doing what and if it uses mostly reads
> or writes.
>
> Sander
>
>
> On Wed, 2010-06-30 at 10:40 +0530, Kaushal Shriyan wrote:
>> Hi
>>
>> Is there a way to know what causes high iowait on ubuntu server. I see
>> high %wa intermittently on hardy 8.04 server. I have tomcat server
>> running on it.
>> Can it be alerted via email if for specific reason it occurs.
>>
>> Please suggest/guide further.
>>
>> Thanks
>>
>> Kaushal
>>
>
>
>

Hi Sander,

I have been following
http://www.cyberciti.biz/tips/identifying-linux-bottlenecks-sar-graphs-with-ksar.html
basically i have logrotate application which runs at 1:00 am and i
need to gather reports using sar

*/10 * * * * root /usr/lib64/sa/sa1 1 1
53 23 * * * root /usr/lib64/sa/sa2 -A

not sure i understand that
basically i need to send sar report it to a specific team
Please suggest

Thanks and Regards

Kaushal

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam


Re: vmbuilder with tmpfs

2010-06-30 Thread Thierry Carrez
Dan Sheffner wrote:
> Is anyone using the --tmpfs command with vmbuilder?  I'm using ubuntu
> 10.04 64 bit and I get:
> 
>  vmbuilder: error: no such option: --tmpfs
> 
> and it clearly in the docs here:
> 
> https://help.ubuntu.com/10.04/serverguide/C/jeos-and-vmbuilder.html

See:
https://bugs.launchpad.net/ubuntu/+source/vm-builder/+bug/536940

-- 
Thierry Carrez
Ubuntu server team

-- 
ubuntu-server mailing list
ubuntu-server@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server
More info: https://wiki.ubuntu.com/ServerTeam