Re: Carbon over-use cluster resources

2020-04-20 Thread Manhua Jiang
Hi Vishal, what you said "1 core launching 2 thread" could be the view from system level, right? In yarn mode, what application got is vCore, so carbon should not take that as a physical core. On 2020/04/16 16:15:23, Kumar Vishal wrote: > Hi Manhua, > In addition to what Ajantha said. All the

Re: Carbon over-use cluster resources

2020-04-20 Thread Manhua Jiang
Hi Ajantha, If we think of this problem in the opposite, carbon may waste resources if user do not set the properties correctly. What about the case when concurrent loading? So first of all, we need to figure out where and how many the executor services is used. If keeping logic of one node o