Re: The cpu preemption between MPI and Hadoop programs on Same Cluster

2009-03-05 Thread Aaron Kimball
Song, you should be able to use 'nice' to reprioritize the MPI task
below that of your Hadoop jobs.
- Aaron

On Thu, Mar 5, 2009 at 8:26 PM, 柳松  wrote:
>
> Dear all:
> I run my hadoop program with another MPI program on the same cluster. 
> here is the result of "top".
>  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
> 11750 qianglv   25   0  233m  99m 6100 R 99.7  2.5 116:05.59 rosetta.mpich
> 18094 cip   17   0 3136m  68m  15m S  0.5  1.7   0:12.69 java
> 18244 cip   17   0 3142m  80m  15m S  0.2  2.0   0:17.61 java
> 18367 cip   18   0 2169m  88m  15m S  0.1  2.3   0:17.46 java
> 18012 cip   18   0 3141m  77m  15m S  0.1  2.0   0:14.49 java
> 18584 cip   21   0 m  46m  15m S  0.1  1.2   0:05.12 java
>
> My Hadoop program can only get no more than 1 percent cpu time slide in 
> total, compared with the rosetta.mpich program's 99.7%.
>
> I'm sure my program is in progress since the log files told me, they are 
> running normally.
>
> Someone told me, it's the nature of Java program, low cpu priority, 
> especially compared with C program.
>
> Is that true?
>
> Regards
> Song Liu in Suzhou University.


The cpu preemption between MPI and Hadoop programs on Same Cluster

2009-03-05 Thread 柳松
Dear all:
    I run my hadoop program with another MPI program on the same cluster. here 
is the result of "top". 
  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
11750 qianglv   25   0  233m  99m 6100 R 99.7  2.5 116:05.59 rosetta.mpich  
18094 cip   17   0 3136m  68m  15m S  0.5  1.7   0:12.69 java   
18244 cip   17   0 3142m  80m  15m S  0.2  2.0   0:17.61 java   
18367 cip   18   0 2169m  88m  15m S  0.1  2.3   0:17.46 java   
18012 cip   18   0 3141m  77m  15m S  0.1  2.0   0:14.49 java   
18584 cip   21   0 m  46m  15m S  0.1  1.2   0:05.12 java  

My Hadoop program can only get no more than 1 percent cpu time slide in total, 
compared with the rosetta.mpich program's 99.7%.

I'm sure my program is in progress since the log files told me, they are 
running normally.

Someone told me, it's the nature of Java program, low cpu priority, especially 
compared with C program.

Is that true?

Regards
Song Liu in Suzhou University.