Re: 答复: how to increase CPU utilization to increase compute performance

[Vladislav Pyatkov]

Hi,

If you want to estimate a reason you need to use profile and after make a
conclusion.

You should to check your application (using flight recorder[1] for example)
and make a investigation where are threads stopping. How long do threads
spend time in parking state? What is reason of this?

[1]:
https://apacheignite.readme.io/docs/jvm-and-system-tuning#section-detailed-garbage-collection-stats

On Wed, Jan 18, 2017 at 1:42 PM, Shawn Du  wrote:

> This is the configuration. All just default.
>
>
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
> localhost:47500..47509
>
> 
>
> 
>
> 
>
> 
>
> 
>
> 
>
>
>
> When running the job, both IO and CPU load are very low.
>
> Now I am testing split less jobs. Also tune the publicThreadPoolSize.  It
> seems that splitting less jobs has positive effect.
>
> Tune the publicThreadPoolSize high has negative effect.  Please confirm
> and give suggestions.
>
>
>
> Thanks
>
> Shawn
>
>
>
> *发件人:* Artem Schitow [mailto:artem.schi...@gmail.com]
> *发送时间:* 2017年1月18日 18:08
> *收件人:* user@ignite.apache.org
> *主题:* Re: how to increase CPU utilization to increase compute performance
>
>
>
> Hi, Shawn!
>
>
>
> Can you please attach you Ignite configuration? What are your disk I/O
> load and CPU load when you’re running the job?
>
>
> —
>
> Artem Schitow
>
> artem.schi...@gmail.com
>
>
>
>
>
>
>
> On 18 Jan 2017, at 13:02, Shawn Du  wrote:
>
>
>
> Hi,
>
>
>
> I have a task to compute on ignite. My Service has 8 cores. I split the
> task into more than 1K jobs and merge the result.
>
> From client see, the task run more than 3 seconds, and sometimes more than
> 10 seconds. The ignite server load is very slow.
>
> I wonder to know how to increase the CPU utilization to increase the
> performance?
>
>
>
> Thanks
>
> Shawn
>
>
>



-- 
Vladislav Pyatkov

答复: how to increase CPU utilization to increase compute performance

[Shawn Du]

This is the configuration. All just default.

 













localhost:47500..47509













 

When running the job, both IO and CPU load are very low. 

Now I am testing split less jobs. Also tune the publicThreadPoolSize.  It seems 
that splitting less jobs has positive effect.

Tune the publicThreadPoolSize high has negative effect.  Please confirm and 
give suggestions.

 

Thanks

Shawn

 

发件人: Artem Schitow [mailto:artem.schi...@gmail.com] 
发送时间: 2017年1月18日 18:08
收件人: user@ignite.apache.org
主题: Re: how to increase CPU utilization to increase compute performance

 

Hi, Shawn!

 

Can you please attach you Ignite configuration? What are your disk I/O load and 
CPU load when you’re running the job?


—

Artem Schitow

artem.schi...@gmail.com  

 

 

 

On 18 Jan 2017, at 13:02, Shawn Du mailto:shawn...@neulion.com.cn> > wrote:

 

Hi, 

 

I have a task to compute on ignite. My Service has 8 cores. I split the task 
into more than 1K jobs and merge the result.

>From client see, the task run more than 3 seconds, and sometimes more than 10 
>seconds. The ignite server load is very slow.

I wonder to know how to increase the CPU utilization to increase the 
performance?

 

Thanks

Shawn