[jira] [Commented] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616287#comment-14616287 ] Siqi Li commented on YARN-3891: --- Yes, I think this is related to MAPREDUCE-6302. So if headr

[jira] [Commented] (YARN-3869) Add app name to RM audit log

2015-07-06 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616282#comment-14616282 ] nijel commented on YARN-3869: - hi i started working on this. One observation is in some cases t

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616274#comment-14616274 ] Hudson commented on YARN-3837: -- FAILURE: Integrated in Hadoop-trunk-Commit #8121 (See [https:

[jira] [Updated] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-06 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3837: Hadoop Flags: Reviewed +1 for the latest patch, will commit it shortly. > javadocs of TimelineAuthentication

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616249#comment-14616249 ] Hadoop QA commented on YARN-3837: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3891: --- Component/s: fairscheduler > Apps are starved for resource due to default FairSharePolicy in Fa

[jira] [Commented] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616243#comment-14616243 ] Karthik Kambatla commented on YARN-3891: In these cases, MR should preempt reducers

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616220#comment-14616220 ] Varun Saxena commented on YARN-3047: [~sjlee0] bq. The current code works, but it's pot

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616218#comment-14616218 ] Varun Saxena commented on YARN-3051: Thanks [~zjshen] for the commit. Thanks [~zjshen],

[jira] [Updated] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3888: --- Attachment: 0002-YARN-3888.patch Attaching patch after fixing checkstyle issue > ApplicationMa

[jira] [Updated] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3837: --- Attachment: 0003-YARN-3837.patch Thnks [~devaraj.k]. Please check the latest patch have update

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-06 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616170#comment-14616170 ] Devaraj K commented on YARN-3837: - [~bibinchundatt], I agree that it is not related to the

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616120#comment-14616120 ] Ming Ma commented on YARN-3445: --- Thanks Junping. Can you please check if it really needs to t

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616036#comment-14616036 ] Hadoop QA commented on YARN-3445: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616031#comment-14616031 ] Zhijie Shen commented on YARN-3047: --- YARN-3051 has been committed. Would you please updat

[jira] [Updated] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3047: -- Labels: (was: BB2015-05-TBR) > [Data Serving] Set up ATS reader with basic request serving structure an

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615941#comment-14615941 ] Sangjin Lee commented on YARN-3051: --- +1 from me. Thanks! > [Storage abstraction] Create

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615930#comment-14615930 ] Zhijie Shen commented on YARN-3051: --- Will commit the patch late today if no more comments

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615923#comment-14615923 ] Sangjin Lee commented on YARN-3047: --- Thanks for the quick update! Can we go all the way

[jira] [Updated] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3891: -- Description: Based on FairSharePolicy, FSLeafQueue will try to schedule an app that has the lowest resource cons

[jira] [Updated] (YARN-3891) Apps are starved for resource due to default fair share scheduling policy in Fair Scheduler

2015-07-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3891: -- Description: Based on FairSharePolicy, FSLeafQueue > Apps are starved for resource due to default fair share sch

[jira] [Updated] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-3891: -- Summary: Apps are starved for resource due to default FairSharePolicy in Fair Scheduler (was: Apps are starved f

[jira] [Created] (YARN-3891) Apps are starved for resource due to default fair share scheduling policy in Fair Scheduler

2015-07-06 Thread Siqi Li (JIRA)
Siqi Li created YARN-3891: - Summary: Apps are starved for resource due to default fair share scheduling policy in Fair Scheduler Key: YARN-3891 URL: https://issues.apache.org/jira/browse/YARN-3891 Project: Ha

[jira] [Commented] (YARN-3121) FairScheduler preemption metrics

2015-07-06 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615882#comment-14615882 ] Anubhav Dhoot commented on YARN-3121: - Took a look at YARN-3293. All the metrics there

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615875#comment-14615875 ] Hadoop QA commented on YARN-3047: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (YARN-3890) FairScheduler should show the scheduler health metrics similar to ones added in CapacityScheduler

2015-07-06 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-3890: --- Summary: FairScheduler should show the scheduler health metrics similar to ones added in CapacityScheduler Key: YARN-3890 URL: https://issues.apache.org/jira/browse/YARN-3890

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615839#comment-14615839 ] Zhijie Shen commented on YARN-3051: --- Okay, then it seems to be fine. I didn't notice it's

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615825#comment-14615825 ] Varun Saxena commented on YARN-3051: Is this approach fine or you prefer having a singl

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615818#comment-14615818 ] Varun Saxena commented on YARN-3051: bq. Overwriting the row of appId? Appending one mo

[jira] [Updated] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3047: --- Attachment: YARN-3047-YARN-2928.11.patch Updated patch. Launching {{HttpServer2}} with 0 port and getti

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615792#comment-14615792 ] Zhijie Shen commented on YARN-3051: --- bq. The current FS implementation had cluster as par

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615776#comment-14615776 ] Varun Saxena commented on YARN-3051: [~zjshen], bq. we have chosen clusterId + appId to

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-06 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: YARN-1643.2.patch Attach patch for {{ContainersMonitorImpl}} for review. Currently the {{Contain

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615747#comment-14615747 ] Zhijie Shen commented on YARN-3051: --- Hi Varun, thanks for updating the patch. I have only

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615743#comment-14615743 ] Varun Saxena commented on YARN-3047: Thanks [~sjlee0] bq. Why not set TIMELINE_READER_W

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615741#comment-14615741 ] Hadoop QA commented on YARN-3051: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615729#comment-14615729 ] Sangjin Lee commented on YARN-3047: --- Thanks [~varun_saxena] for the latest patch. (TestT

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615714#comment-14615714 ] Jian He commented on YARN-3878: --- bq. I don't convince that it is a right way to modify the s

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3051: --- Attachment: YARN-3051-YARN-2928.08.patch Updated a new patch > [Storage abstraction] Create backing st

[jira] [Commented] (YARN-3644) Node manager shuts down if unable to connect with RM

2015-07-06 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615631#comment-14615631 ] Naganarasimha G R commented on YARN-3644: - Thanks [~raju.bairishetti] for working o

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615517#comment-14615517 ] Hadoop QA commented on YARN-3445: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615390#comment-14615390 ] Varun Saxena commented on YARN-3051: Oh we have an Apache Lib for it. Will use it. Than

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615387#comment-14615387 ] Zhijie Shen commented on YARN-3051: --- How about we using common csv lib to handle the look

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615374#comment-14615374 ] Karthik Kambatla commented on YARN-2194: [~vvasudev] - do you want to do the honors

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615372#comment-14615372 ] Karthik Kambatla commented on YARN-2194: bq. yes, you need the "native" profile to

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615363#comment-14615363 ] Varun Saxena commented on YARN-3051: bq. Do info values have to be converted into stri

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615354#comment-14615354 ] Sangjin Lee commented on YARN-3051: --- Thanks [~varun_saxena] for providing a quick update!

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615295#comment-14615295 ] Varun Saxena commented on YARN-3051: [~zjshen], [~sjlee0], kindly review. > [Storage a

[jira] [Updated] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3445: - Attachment: YARN-3445-v4.1.patch Fix check-style issue in v4.1 patch. > Cache runningApps in RMNode for ge

[jira] [Commented] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615284#comment-14615284 ] Hadoop QA commented on YARN-3888: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-07-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615275#comment-14615275 ] Junping Du commented on YARN-3045: -- Thanks [~Naganarasimha] for updating the patch! One o

[jira] [Commented] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2015-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615246#comment-14615246 ] Karthik Kambatla commented on YARN-2154: Would be nice to discuss approaches on JIR

[jira] [Commented] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615244#comment-14615244 ] Hadoop QA commented on YARN-2681: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2015-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2154: --- Assignee: Arun Suresh (was: Karthik Kambatla) > FairScheduler: Improve preemption to preempt o

[jira] [Commented] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2015-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615241#comment-14615241 ] Karthik Kambatla commented on YARN-2154: Please go ahead and take it. > FairSched

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615236#comment-14615236 ] Arun Suresh commented on YARN-3453: --- Apologize for the delay. Thanks for the review [~ash

[jira] [Commented] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2015-07-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615228#comment-14615228 ] Arun Suresh commented on YARN-2154: --- This looks like it is required for a complete soluti

[jira] [Created] (YARN-3889) yarn/hadoop scripts do not mention daemon and loglevel options in usage

2015-07-06 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-3889: -- Summary: yarn/hadoop scripts do not mention daemon and loglevel options in usage Key: YARN-3889 URL: https://issues.apache.org/jira/browse/YARN-3889 Project: Hadoop YARN

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615180#comment-14615180 ] Sunil G commented on YARN-3885: --- HI [~ajithshetty] Thanks for reporting this. As you mention

[jira] [Updated] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3888: --- Attachment: 0001-YARN-3888.patch Attaching patch for review . > ApplicationMaster link is brok

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615126#comment-14615126 ] Hadoop QA commented on YARN-3051: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3888: -- Summary: ApplicationMaster link is broken in RM WebUI when appstate is NEW (was: RM WebUI when appstate si NEW

[jira] [Created] (YARN-3888) RM WebUI when appstate si NEW AppMaster link is broken

2015-07-06 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3888: -- Summary: RM WebUI when appstate si NEW AppMaster link is broken Key: YARN-3888 URL: https://issues.apache.org/jira/browse/YARN-3888 Project: Hadoop YARN

[jira] [Resolved] (YARN-3643) Provide a way to store only running applications in the state store

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena resolved YARN-3643. Resolution: Invalid > Provide a way to store only running applications in the state store > -

[jira] [Commented] (YARN-3643) Provide a way to store only running applications in the state store

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615081#comment-14615081 ] Varun Saxena commented on YARN-3643: [~kasha], we have a test {{TestAppManager#testRMAp

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615069#comment-14615069 ] Varun Saxena commented on YARN-2962: [~kasha], The thing we primarily need to decide is

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3051: --- Attachment: YARN-3051-YARN-2928.07.patch > [Storage abstraction] Create backing storage read interface

[jira] [Updated] (YARN-3884) RMContainerImpl transition from RESERVED to KILL apphistory status not updated

2015-07-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3884: --- Attachment: Test Result-Container status.jpg Test Result Snapshot attached > RMContainerImpl t

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2015-07-06 Thread Nam H. Do (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nam H. Do updated YARN-2681: Attachment: YARN-2681.003.patch + Refactor tests: all test data are written to 'hdfs_traffic_control' sub-fo

[jira] [Updated] (YARN-3884) RMContainerImpl transition from RESERVED to KILL apphistory status not updated

2015-07-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3884: --- Summary: RMContainerImpl transition from RESERVED to KILL apphistory status not updated (was:

[jira] [Updated] (YARN-3884) Capacity scheduler for DROP_RESERVATION event container status not updated

2015-07-06 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3884: --- Attachment: 0001-YARN-3884.patch Attaching patch please do review > Capacity scheduler for DR

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614979#comment-14614979 ] Hadoop QA commented on YARN-3445: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614967#comment-14614967 ] Hadoop QA commented on YARN-3873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614966#comment-14614966 ] Hadoop QA commented on YARN-2003: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3445: - Attachment: YARN-3445-v4.patch Update patch in v4 patch according to [~mingma]'s comments above. > Cache r

[jira] [Updated] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-07-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3873: -- Attachment: 0002-YARN-3873.patch Fixing checkstyle issues. > pendingApplications in LeafQueue should also use Or

[jira] [Updated] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 0017-YARN-2003.patch Fixed test failures. > Support for Application priority : Changes in RM and Cap

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614841#comment-14614841 ] Hadoop QA commented on YARN-3873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-07-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3873: -- Attachment: 0001-YARN-3873.patch Updating an initial version. I am using {{OrderingPolicy}} for {{pendingApplica

[jira] [Commented] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614667#comment-14614667 ] Hadoop QA commented on YARN-2003: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo