[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-03 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13698750#comment-13698750 ] Devaraj K commented on YARN-353: The latest patch looks good to me except one nit.

[jira] [Created] (YARN-897) CapacityScheduler wrongly sorted queues

2013-07-03 Thread Djellel Eddine Difallah (JIRA)
Djellel Eddine Difallah created YARN-897: Summary: CapacityScheduler wrongly sorted queues Key: YARN-897 URL: https://issues.apache.org/jira/browse/YARN-897 Project: Hadoop YARN

[jira] [Commented] (YARN-897) CapacityScheduler wrongly sorted queues

2013-07-03 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699204#comment-13699204 ] Carlo Curino commented on YARN-897: --- The childQueues of a ParentQueue are stored in a

[jira] [Updated] (YARN-897) CapacityScheduler wrongly sorted queues

2013-07-03 Thread Djellel Eddine Difallah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Djellel Eddine Difallah updated YARN-897: - Attachment: TestBugParentQueue.java Simple JUnit Test that triggers the bug.

[jira] [Created] (YARN-898) Snapshot support for distcp

2013-07-03 Thread Binglin Chang (JIRA)
Binglin Chang created YARN-898: -- Summary: Snapshot support for distcp Key: YARN-898 URL: https://issues.apache.org/jira/browse/YARN-898 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Resolved] (YARN-898) Snapshot support for distcp

2013-07-03 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang resolved YARN-898. Resolution: Invalid sorry, should be in HADOOP Snapshot support for distcp

[jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text

2013-07-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699270#comment-13699270 ] Zhijie Shen commented on YARN-649: -- bq. Oops, leaving in MediaType.APPLICATION_JSON was a

[jira] [Updated] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-353: - Attachment: YARN-353.4.patch right, thanks for pointing that out. Updated the patch, made some changes along with

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699305#comment-13699305 ] Hadoop QA commented on YARN-353: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-649) Make container logs available over HTTP in plain text

2013-07-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699312#comment-13699312 ] Alejandro Abdelnur commented on YARN-649: - if support JSON/XML, how will you wrap up

[jira] [Commented] (YARN-896) Roll up for long lived YARN

2013-07-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699314#comment-13699314 ] Steve Loughran commented on YARN-896: - Based on our Hoya, HBase on YARN work: * we need

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699325#comment-13699325 ] Vinod Kumar Vavilapalli commented on YARN-727: -- bq. To clarify on my previous

[jira] [Updated] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-727: - Priority: Blocker (was: Major) ClientRMProtocol.getAllApplications should

[jira] [Updated] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-791: - Priority: Blocker (was: Major) Ensure that RM RPC APIs that return nodes are

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699328#comment-13699328 ] Vinod Kumar Vavilapalli commented on YARN-791: -- Marked it as blocker, let's do

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-07-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699336#comment-13699336 ] Alejandro Abdelnur commented on YARN-791: - IMO, we should have consistency in all

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-07-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699346#comment-13699346 ] Sandy Ryza commented on YARN-791: - Chatted with Vinod about this offline. The thinking is

[jira] [Commented] (YARN-897) CapacityScheduler wrongly sorted queues

2013-07-03 Thread Djellel Eddine Difallah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699373#comment-13699373 ] Djellel Eddine Difallah commented on YARN-897: -- We spotted this bug while

[jira] [Created] (YARN-899) Get queue administration ACLs working

2013-07-03 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-899: --- Summary: Get queue administration ACLs working Key: YARN-899 URL: https://issues.apache.org/jira/browse/YARN-899 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-07-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-791: Attachment: YARN-791-7.patch Ensure that RM RPC APIs that return nodes are consistent with /nodes REST

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-07-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699455#comment-13699455 ] Sandy Ryza commented on YARN-791: - Uploaded patch that makes the discussed changes. I had a

[jira] [Commented] (YARN-523) Container localization failures aren't reported from NM to RM

2013-07-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699470#comment-13699470 ] Jian He commented on YARN-523: -- Looked at the code and tried on single node cluster, it turns

[jira] [Updated] (YARN-899) Get queue administration ACLs working

2013-07-03 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated YARN-899: - Target Version/s: 2.1.0-beta Worth considering as a GA blocker since this is a regression vs MR1.

[jira] [Commented] (YARN-675) In YarnClient, pull AM logs on AM container failure

2013-07-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699488#comment-13699488 ] Zhijie Shen commented on YARN-675: -- Checked YarnClient and found one issue: ContainerId is

[jira] [Commented] (YARN-675) In YarnClient, pull AM logs on AM container failure

2013-07-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699497#comment-13699497 ] Sandy Ryza commented on YARN-675: - Would there be an issue with including the AM container

[jira] [Created] (YARN-900) YarnClientApplication uses composition to hold GetNewApplicationResponse instead of having a simpler flattened structure

2013-07-03 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-900: Summary: YarnClientApplication uses composition to hold GetNewApplicationResponse instead of having a simpler flattened structure Key: YARN-900 URL:

[jira] [Commented] (YARN-900) YarnClientApplication uses composition to hold GetNewApplicationResponse instead of having a simpler flattened structure

2013-07-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699533#comment-13699533 ] Karthik Kambatla commented on YARN-900: --- Will this be an incompatible change?

[jira] [Updated] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-03 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-727: --- Attachment: YARN-727.17.patch ClientRMProtocol.getAllApplications should accept ApplicationType as a

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-07-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699534#comment-13699534 ] Hadoop QA commented on YARN-791: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-03 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699535#comment-13699535 ] Xuan Gong commented on YARN-727: 1.Change API from GetAllApplicationsRequest to

[jira] [Commented] (YARN-675) In YarnClient, pull AM logs on AM container failure

2013-07-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699538#comment-13699538 ] Zhijie Shen commented on YARN-675: -- It's feasible to pass ContainerId through

[jira] [Updated] (YARN-369) Handle ( or throw a proper error when receiving) status updates from application masters that have not registered

2013-07-03 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-369: --- Attachment: YARN-369-trunk-3.patch Thanks [~bikash] for the review. I have rebased the patch and

[jira] [Commented] (YARN-369) Handle ( or throw a proper error when receiving) status updates from application masters that have not registered

2013-07-03 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699559#comment-13699559 ] Mayank Bansal commented on YARN-369: Sorry it was [~bikassaha] Thanks

[jira] [Updated] (YARN-813) Document and likewise implement relevant checks/escape functions for what form of input is acceptable for setting up a container launch context i.e. special chars in resour

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-813: - Issue Type: Improvement (was: Bug) Document and likewise implement relevant

[jira] [Updated] (YARN-56) Handle container requests that request more resources than currently available in the cluster

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-56?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-56: Issue Type: Improvement (was: Bug) Handle container requests that request more

[jira] [Updated] (YARN-91) DFIP aka 'NodeManager should handle Disk-Failures In Place'

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-91: Issue Type: Task (was: Bug) DFIP aka 'NodeManager should handle Disk-Failures

[jira] [Updated] (YARN-11) Capacity Scheduler does not support adding sub-queues to the existing queues.

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-11: Issue Type: Improvement (was: Bug) Capacity Scheduler does not support adding

[jira] [Updated] (YARN-34) Split/Cleanup YARN and MAPREDUCE documentation

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-34: Issue Type: Improvement (was: Bug) Split/Cleanup YARN and MAPREDUCE

[jira] [Updated] (YARN-34) Split/Cleanup YARN and MAPREDUCE documentation

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-34: Component/s: documentation Split/Cleanup YARN and MAPREDUCE documentation

[jira] [Updated] (YARN-314) Schedulers should allow resource requests of different sizes at the same priority and location

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-314: - Issue Type: Improvement (was: Bug) Schedulers should allow resource requests

[jira] [Resolved] (YARN-243) Job Client doesn't give progress for Application Master Retries

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-243. -- Resolution: Duplicate Closing as mentioned. Job Client doesn't

[jira] [Updated] (YARN-463) Show explicitly excluded nodes on the UI

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-463: - Issue Type: Improvement (was: Bug) Show explicitly excluded nodes on the UI

[jira] [Updated] (YARN-483) Improve documentation on log aggregation in yarn-default.xml

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-483: - Issue Type: Improvement (was: Bug) Improve documentation on log aggregation

[jira] [Updated] (YARN-533) Pointing to the config property when throwing/logging the config-related exception

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-533: - Issue Type: Improvement (was: Bug) Pointing to the config property when

[jira] [Commented] (YARN-369) Handle ( or throw a proper error when receiving) status updates from application masters that have not registered

2013-07-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699587#comment-13699587 ] Hadoop QA commented on YARN-369: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-531) RM nodes page should show time-since-last-heartbeat instead of absolute last-heartbeat time

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-531: - Issue Type: Improvement (was: Bug) RM nodes page should show

[jira] [Updated] (YARN-414) [Umbrella] Usability issues in YARN

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-414: - Issue Type: Task (was: Bug) [Umbrella] Usability issues in YARN

[jira] [Updated] (YARN-446) Container killed before hprof dumps profile.out

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-446: - Issue Type: Improvement (was: Bug) Container killed before hprof dumps

[jira] [Updated] (YARN-523) Container localization failures aren't reported from NM to RM

2013-07-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-523: - Attachment: YARN-523.patch added a test case to verify the diagnostics is reported Container

[jira] [Updated] (YARN-240) Rename ProcessTree.isSetsidAvailable

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-240: - Issue Type: Improvement (was: Bug) Rename ProcessTree.isSetsidAvailable

[jira] [Updated] (YARN-816) Implement AM recovery for distributed shell

2013-07-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-816: - Issue Type: Improvement (was: Bug) Implement AM recovery for distributed

[jira] [Commented] (YARN-296) Resource Manager throws InvalidStateTransitonException: Invalid event: APP_ACCEPTED at RUNNING for RMAppImpl

2013-07-03 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699595#comment-13699595 ] Mayank Bansal commented on YARN-296: Thanks [~devaraj.k] for the review. Updated and

[jira] [Updated] (YARN-296) Resource Manager throws InvalidStateTransitonException: Invalid event: APP_ACCEPTED at RUNNING for RMAppImpl

2013-07-03 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-296: --- Attachment: YARN-296-trunk-2.patch Resource Manager throws InvalidStateTransitonException:

[jira] [Commented] (YARN-727) ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter

2013-07-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699603#comment-13699603 ] Hadoop QA commented on YARN-727: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-523) Container localization failures aren't reported from NM to RM

2013-07-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699606#comment-13699606 ] Hadoop QA commented on YARN-523: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-296) Resource Manager throws InvalidStateTransitonException: Invalid event: APP_ACCEPTED at RUNNING for RMAppImpl

2013-07-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699616#comment-13699616 ] Hadoop QA commented on YARN-296: {color:green}+1 overall{color}. Here are the results of