[jira] [Resolved] (YARN-951) Add hard minimum resource capabilities for container launching

[ https://issues.apache.org/jira/browse/YARN-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved YARN-951. - Resolution: Won't Fix > Add hard minimum resource capabilities for container launching > --

Resource manager benchmark

Is there any convenient ways or APIs to emulate the container requests from many application masters to test the resource assignment performance of Resource Manager? Anyone can give some examples or point some convenient ways? Thanks -- *Regards,* *Zhaojie*

[jira] [Created] (YARN-1436) ZKRMStateStore should have separate configuration for retry period.

Omkar Vinit Joshi created YARN-1436: --- Summary: ZKRMStateStore should have separate configuration for retry period. Key: YARN-1436 URL: https://issues.apache.org/jira/browse/YARN-1436 Project: Hadoop

Success: YARN-1314 PreCommit Build #2513

Jira: https://issues.apache.org/jira/browse/YARN-1314 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2513/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Re: Yarn resource request

But I think there is some problems. For example, the FIFO scheduler, the big memory request of a job may starve as the small memory requests of other jobs can always be fulfilled. Is it right? 2013/11/22 Bikas Saha > Yes. > > -Original Message- > From: 牛兆捷 [mailto:nzjem...@gmail.com] >

Failed: YARN-1314 PreCommit Build #2512

Jira: https://issues.apache.org/jira/browse/YARN-1314 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2512/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Failed: YARN-1266 PreCommit Build #2511

Jira: https://issues.apache.org/jira/browse/YARN-1266 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2511/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

[jira] [Created] (YARN-1435) Custom script cannot be run because it lacks of executable bit at container level

Tassapol Athiapinya created YARN-1435: - Summary: Custom script cannot be run because it lacks of executable bit at container level Key: YARN-1435 URL: https://issues.apache.org/jira/browse/YARN-1435

Success: YARN-1416 PreCommit Build #2510

Jira: https://issues.apache.org/jira/browse/YARN-1416 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2510/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

API to determine max limits (vcores, vram, &c from the client?)

Is there any way to determine the max resources you can ask for from an RM queue before you actually create the AM? I know the AM gets that data once it's been created, but without knowing those limits client side, you can't tune the requirements of the AM itself If not, I'm going to file a JIRA t

Re: Is there a list of YARN exit codes? A class or interface

thanks, the exit codes look like the ones I want On 21 November 2013 16:53, Zhijie Shen wrote: > You may want to look at ContainerExecutor#ExitCode and ContainerExitStatus. > - Zhijie > > > On Thu, Nov 21, 2013 at 3:58 AM, Steve Loughran >wrote: > > > I've just been tracking down YARN containe

[jira] [Created] (YARN-1434) Single Job can affect fairshare of others

Carlo Curino created YARN-1434: -- Summary: Single Job can affect fairshare of others Key: YARN-1434 URL: https://issues.apache.org/jira/browse/YARN-1434 Project: Hadoop YARN Issue Type: Bug

Success: YARN-1416 PreCommit Build #2509

Jira: https://issues.apache.org/jira/browse/YARN-1416 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2509/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

[jira] [Created] (YARN-1432) Reduce phase is failing with shuffle error in kerberos enabled cluster

Ramgopal N created YARN-1432: Summary: Reduce phase is failing with shuffle error in kerberos enabled cluster Key: YARN-1432 URL: https://issues.apache.org/jira/browse/YARN-1432 Project: Hadoop YARN

Failed: YARN-1416 PreCommit Build #2508

Jira: https://issues.apache.org/jira/browse/YARN-1416 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2508/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

[jira] [Created] (YARN-1433) ContainerManagementProtocolProxy doesn't have the retry policy

Zhijie Shen created YARN-1433: - Summary: ContainerManagementProtocolProxy doesn't have the retry policy Key: YARN-1433 URL: https://issues.apache.org/jira/browse/YARN-1433 Project: Hadoop YARN I

Re: API to determine max limits (vcores, vram, &c from the client?)

ah, make sense. (I didn't run into that as I'm mostly using unmanaged AMs) On Thu, Nov 21, 2013 at 8:46 AM, Steve Loughran wrote: > I want to know the limits I can use when creating an AM, such as ask for > one with the max allowable RAM. I can do that for any container the AM asks > for, but n

Re: API to determine max limits (vcores, vram, &c from the client?)

Steve, what kind of tuning do you need to do based on the max resources that would affect the creation/configuration of the Yarn client itself? Thanks. On Thu, Nov 21, 2013 at 6:06 AM, Steve Loughran wrote: > Is there any way to determine the max resources you can ask for from an RM > queue bef

Re: API to determine max limits (vcores, vram, &c from the client?)

I want to know the limits I can use when creating an AM, such as ask for one with the max allowable RAM. I can do that for any container the AM asks for, but not for the initial AM/app request On 21 November 2013 14:37, Alejandro Abdelnur wrote: > Steve, what kind of tuning do you need to do ba

RE: Yarn resource request

Yes. -Original Message- From: 牛兆捷 [mailto:nzjem...@gmail.com] Sent: Thursday, November 21, 2013 12:54 AM To: yarn-dev@hadoop.apache.org Subject: Re: Yarn resource request Then, if one application master request for two different size container with different priority, the resource manager

Re: Is there a list of YARN exit codes? A class or interface

You may want to look at ContainerExecutor#ExitCode and ContainerExitStatus. - Zhijie On Thu, Nov 21, 2013 at 3:58 AM, Steve Loughran wrote: > I've just been tracking down YARN container code 143, "container out of > requested RAM", which makes me think: is there a class listing all standard > YA

Is there a list of YARN exit codes? A class or interface

I've just been tracking down YARN container code 143, "container out of requested RAM", which makes me think: is there a class listing all standard YARN exit codes that I can look at for this, and if not, should we write one? Any pointers? -steve -- CONFIDENTIALITY NOTICE NOTICE: This message i

Re: Yarn resource request

I'm trying to track which servers aren't running a copy of my container (HBase RS, Accumulo Tablet), yet were running them recently -so I keep a list of recently used servers, write that to disk after changes, on startup reread the latest re-readable version and rebuild that list. I want to know w

Re: Yarn resource request

On receive node update event, scheduler will assign resources of this node to containers, isn't it? Why you say we can not know which one is satisfied? I do not know what your code do? Testing resource request of response of resource manager? How to run it? 2013/11/21 Steve Loughran > On 21 N

Failed: YARN-967 PreCommit Build #2507

Jira: https://issues.apache.org/jira/browse/YARN-967 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2507/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncate

Build failed in Jenkins: Hadoop-Yarn-trunk #398

See Changes: [jing9] HDFS-5532. Enable the webhdfs by default to support new HDFS web UI. Contributed by Vinay. [vinodkv] YARN-1303. Reverted the wrong patch committed earlier and committing the correct patch now. In one go. [vinod

Hadoop-Yarn-trunk - Build # 398 - Failure

See https://builds.apache.org/job/Hadoop-Yarn-trunk/398/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 15190 lines...] Tests in error: TestUnmanagedAMLaunche

Re: Yarn resource request

On 21 November 2013 09:04, 牛兆捷 wrote: > Another question. > > For two request with the same priority, which one will be chosen? > No way to know. An equally interesting question is : how do you know which one has been satisfied, and which one is oustanding? I spent some time trying to do some o

Re: Yarn resource request

Another question. For two request with the same priority, which one will be chosen? 2013/11/21 Bikas Saha > That’s a known limitation of the current implementation of schedulers in > YARN. The API allows different requests of different sizes within the same > priority but the implementations o

Re: Yarn resource request

Then, if one application master request for two different size container with different priority, the resource manager will reserve the resource for the higher priority container even the requirement of smaller container can be met. 2013/11/21 Bikas Saha > That’s a known limitation of the curre

Failed: YARN-1426 PreCommit Build #2505

Jira: https://issues.apache.org/jira/browse/YARN-1426 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2505/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat

Success: YARN-1320 PreCommit Build #2506

Jira: https://issues.apache.org/jira/browse/YARN-1320 Build: https://builds.apache.org/job/PreCommit-YARN-Build/2506/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncat