[jira] [Created] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2016-12-29 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6041: - Summary: Opportunistic containers : Combined patch for branch-2 Key: YARN-6041 URL: https://issues.apache.org/jira/browse/YARN-6041 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786354#comment-15786354 ] Arun Suresh commented on YARN-5646: --- Committing this to branch-2 > Add documentation and update config

[jira] [Updated] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5646: -- Fix Version/s: 2.9.0 > Add documentation and update config parameter names for scheduling of >

[jira] [Commented] (YARN-5938) Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786356#comment-15786356 ] Arun Suresh commented on YARN-5938: --- Committing this to branch-2 > Refactoring

[jira] [Commented] (YARN-5982) Simplify opportunistic container parameters and metrics

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786352#comment-15786352 ] Arun Suresh commented on YARN-5982: --- Committing this to branch-2 > Simplify opportunistic container

[jira] [Commented] (YARN-5918) Handle Opportunistic scheduling allocate request failure when NM is lost

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786350#comment-15786350 ] Arun Suresh commented on YARN-5918: --- Committing this to branch-2 > Handle Opportunistic scheduling

[jira] [Commented] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786348#comment-15786348 ] Arun Suresh commented on YARN-4597: --- Committing this to branch-2 > Introduce ContainerScheduler and a

[jira] [Updated] (YARN-5982) Simplify opportunistic container parameters and metrics

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5982: -- Fix Version/s: 2.9.0 > Simplify opportunistic container parameters and metrics >

[jira] [Updated] (YARN-5918) Handle Opportunistic scheduling allocate request failure when NM is lost

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5918: -- Fix Version/s: 2.9.0 > Handle Opportunistic scheduling allocate request failure when NM is lost >

[jira] [Updated] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4597: -- Fix Version/s: 2.9.0 > Introduce ContainerScheduler and a SCHEDULED state to NodeManager container >

[jira] [Updated] (YARN-5823) Update NMTokens in case of requests with only opportunistic containers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5823: -- Fix Version/s: 2.9.0 > Update NMTokens in case of requests with only opportunistic containers >

[jira] [Commented] (YARN-5823) Update NMTokens in case of requests with only opportunistic containers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786345#comment-15786345 ] Arun Suresh commented on YARN-5823: --- Committing this to branch-2 > Update NMTokens in case of requests

[jira] [Commented] (YARN-5377) Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786343#comment-15786343 ] Arun Suresh commented on YARN-5377: --- Committing this to branch-2 > Fix

[jira] [Updated] (YARN-5377) Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5377: -- Fix Version/s: 2.9.0 > Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers >

[jira] [Commented] (YARN-2995) Enhance UI to show cluster resource utilization of various container Execution types

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786342#comment-15786342 ] Arun Suresh commented on YARN-2995: --- Committing this to branch-2 > Enhance UI to show cluster resource

[jira] [Updated] (YARN-2995) Enhance UI to show cluster resource utilization of various container Execution types

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2995: -- Fix Version/s: 2.9.0 > Enhance UI to show cluster resource utilization of various container > Execution

[jira] [Commented] (YARN-5799) Fix Opportunistic Allocation to set the correct value of Node Http Address

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786339#comment-15786339 ] Arun Suresh commented on YARN-5799: --- Committing this to branch-2 > Fix Opportunistic Allocation to set

[jira] [Commented] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786337#comment-15786337 ] Arun Suresh commented on YARN-5486: --- Committing this to branch-2. YARN-5688 can be worked on

[jira] [Updated] (YARN-5799) Fix Opportunistic Allocation to set the correct value of Node Http Address

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5799: -- Fix Version/s: 2.9.0 > Fix Opportunistic Allocation to set the correct value of Node Http Address >

[jira] [Updated] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5486: -- Fix Version/s: 2.9.0 > Update OpportunisticContainerAllocatorAMService::allocate method to handle >

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes

2016-12-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Summary: Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and

[jira] [Commented] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781216#comment-15781216 ] Arun Suresh commented on YARN-5938: --- The failed test case runs locally and the checkstyle warning fix

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938.003.patch Fixing some of the checkstyle warnings. The testcase failure is not

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938.002.patch Re-attaching patch.. > Refactoring OpportunisticContainerAllocator use

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: (was: YARN-5938.002.patch) > Refactoring OpportunisticContainerAllocator use

[jira] [Reopened] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-5938: --- Reopening to run against trunk > Refactoring OpportunisticContainerAllocator use SchedulerRequestKey

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: (was: YARN-5938.002.patch.) > Refactoring OpportunisticContainerAllocator use

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938.002.patch > Refactoring OpportunisticContainerAllocator use SchedulerRequestKey

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938.002.patch. Attaching a trunk patch... will check it into trunk after a good

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770883#comment-15770883 ] Arun Suresh commented on YARN-6022: --- So, looks like the original class was created to unify Update

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770843#comment-15770843 ] Arun Suresh commented on YARN-6022: --- Hmmm... not sure why the inheritance is a problem.. But I agree,

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2016-12-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770801#comment-15770801 ] Arun Suresh commented on YARN-6022: --- Agree with [~leftnoteasy], we should also probably mark it as

[jira] [Comment Edited] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768540#comment-15768540 ] Arun Suresh edited comment on YARN-5216 at 12/22/16 12:06 AM: -- bq. I'm not so

[jira] [Comment Edited] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768540#comment-15768540 ] Arun Suresh edited comment on YARN-5216 at 12/22/16 12:06 AM: -- bq. I'm not so

[jira] [Comment Edited] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768540#comment-15768540 ] Arun Suresh edited comment on YARN-5216 at 12/22/16 12:05 AM: -- bq. I'm not so

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15768540#comment-15768540 ] Arun Suresh commented on YARN-5216: --- bq. I'm not so sure about adding anything into the Container

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765229#comment-15765229 ] Arun Suresh commented on YARN-5959: --- Based on offline discussions with [~leftnoteasy], I will rework this

[jira] [Commented] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765095#comment-15765095 ] Arun Suresh commented on YARN-5938: --- Committed to branch YARN-5085 Thanks for the review [~leftnoteasy]

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Summary: Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority (was:

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15764456#comment-15764456 ] Arun Suresh commented on YARN-5216: --- Missed a few comments: # I feel its more apt to rename

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763587#comment-15763587 ] Arun Suresh commented on YARN-5216: --- Thanks for updating the patch [~hrsharma] Couple of comments: # In

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938-YARN-5085.004.patch Updating patch based on [~leftnoteasy]'s suggestions. bq.

[jira] [Commented] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762880#comment-15762880 ] Arun Suresh commented on YARN-5938: --- Thanks for the review [~leftnoteasy] bq.

[jira] [Updated] (YARN-5655) TestContainerManagerSecurity#testNMTokens is asserting

2016-12-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5655: -- Attachment: mvn_test.out My local branch is synched with trunk. Attaching output of: $ mvn test

[jira] [Updated] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2016-12-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5646: -- Target Version/s: 3.0.0-alpha2 (was: 3.0.0-beta1) > Add documentation and update config parameter names

[jira] [Commented] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2016-12-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754894#comment-15754894 ] Arun Suresh commented on YARN-5646: --- The checkstyle warnings can be ignored to retain the style of

[jira] [Commented] (YARN-5655) TestContainerManagerSecurity#testNMTokens is asserting

2016-12-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754878#comment-15754878 ] Arun Suresh commented on YARN-5655: --- [~rkanter], [~templedf], Looks like this still fails at times on

[jira] [Updated] (YARN-5646) Update config parameter names and add documentation for scheduling of OPPORTUNISTIC containers

2016-12-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5646: -- Summary: Update config parameter names and add documentation for scheduling of OPPORTUNISTIC containers

[jira] [Updated] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2016-12-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5646: -- Summary: Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Description: Minor code re-organization to do the following: # The

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746387#comment-15746387 ] Arun Suresh commented on YARN-3866: --- [~leftnoteasy], wondering if updating yarn_service_proto as per

[jira] [Commented] (YARN-5501) Container Pooling in YARN

2016-12-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746147#comment-15746147 ] Arun Suresh commented on YARN-5501: --- Created branch YARN-5501 to work on proof of concept. > Container

[jira] [Updated] (YARN-5972) Support Pausing/Freezing of opportunistic containers

2016-12-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5972: -- Summary: Support Pausing/Freezing of opportunistic containers (was: Add Support for Pausing/Freezing of

[jira] [Updated] (YARN-5085) Add support for change of container ExecutionType

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5085: -- Attachment: YARN-5085.002.patch > Add support for change of container ExecutionType >

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743071#comment-15743071 ] Arun Suresh commented on YARN-5216: --- Just clarifying my position: * The ability to PAUSE a process is

[jira] [Comment Edited] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742711#comment-15742711 ] Arun Suresh edited comment on YARN-5959 at 12/12/16 6:33 PM: - Thanks for

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959.wip.003.patch Thanks for capturing the salient points from our discussion

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: (was: YARN-5938-YARN-5085.003.patch) > Minor refactoring to

[jira] [Updated] (YARN-5085) Add support for change of container ExecutionType

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5085: -- Attachment: (was: YARN-5085.002.patch) > Add support for change of container ExecutionType >

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938-YARN-5085.003.patch Reattaching patch : fixed rebase error > Minor refactoring to

[jira] [Updated] (YARN-5085) Add support for change of container ExecutionType

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5085: -- Attachment: YARN-5085.002.patch Re-attaching again > Add support for change of container ExecutionType

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938-YARN-5085.003.patch Updating patch after rebasing with trunk. > Minor refactoring

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15738612#comment-15738612 ] Arun Suresh commented on YARN-5216: --- bq. Otherwise, to achieve this behavior, we will need to have two

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15738525#comment-15738525 ] Arun Suresh commented on YARN-5216: --- Given the fact that the actual container executor executable binary

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15738072#comment-15738072 ] Arun Suresh commented on YARN-5216: --- Thanks for working on this [~hrsharma] I just kicked jenkins again,

[jira] [Updated] (YARN-5982) Simplify opportunistic container parameters and metrics

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5982: -- Summary: Simplify opportunistic container parameters and metrics (was: Simplifying opportunistic

[jira] [Commented] (YARN-5982) Simplifying opportunistic container parameters and metrics

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736829#comment-15736829 ] Arun Suresh commented on YARN-5982: --- Committing this to trunk shortly. Thanks for working on this

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736065#comment-15736065 ] Arun Suresh commented on YARN-3866: --- Thanks for working on the [~leftnoteasy], In,

[jira] [Comment Edited] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731526#comment-15731526 ] Arun Suresh edited comment on YARN-5292 at 12/9/16 3:46 PM: Hi [~kasha], the

[jira] [Comment Edited] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735648#comment-15735648 ] Arun Suresh edited comment on YARN-5292 at 12/9/16 3:52 PM: Committed to

[jira] [Commented] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735638#comment-15735638 ] Arun Suresh commented on YARN-5292: --- Committing this to branch YARN-5972 shortly. Regarding [~subru]'s

[jira] [Commented] (YARN-5982) Simplifying opportunistic container parameters and metrics

2016-12-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733021#comment-15733021 ] Arun Suresh commented on YARN-5982: --- Thanks for the patch [~kkaranasos] Couple of comments: # You can

[jira] [Commented] (YARN-5085) Add support for change of container ExecutionType

2016-12-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732704#comment-15732704 ] Arun Suresh commented on YARN-5085: --- Thanks for taking a look [~subru].. Yup... we are planning on using

[jira] [Commented] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732570#comment-15732570 ] Arun Suresh commented on YARN-5292: --- Moved the design doc to YARN-5972. [~kasha], [~hrsharma], lets

[jira] [Updated] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5216: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-5972 > Expose configurable preemption

[jira] [Updated] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5216: -- Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-5541) > Expose configurable

[jira] [Updated] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5972: -- Attachment: container-pause-resume.pdf Moved design doc from YARN-5292 here.. > Add Support for

[jira] [Updated] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5292: -- Attachment: (was: yarn-5292.pdf) > NM Container lifecycle and state transitions to support for

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730322#comment-15730322 ] Arun Suresh commented on YARN-3866: --- bq. No. It is already get released in 2.7.3 .. Ah.. sorry.. was

[jira] [Comment Edited] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730171#comment-15730171 ] Arun Suresh edited comment on YARN-3866 at 12/7/16 10:44 PM: - Also thanks for

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730171#comment-15730171 ] Arun Suresh commented on YARN-3866: --- As [~leftnoteasy] mentioned, the {{ApplicationMasterProtocol}} is a

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727348#comment-15727348 ] Arun Suresh commented on YARN-5959: --- [~hrsharma], this patch address only the RM side changes. The

[jira] [Created] (YARN-5978) ContainerScheduler and Container state machine changes to support ExecType update

2016-12-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5978: - Summary: ContainerScheduler and Container state machine changes to support ExecType update Key: YARN-5978 URL: https://issues.apache.org/jira/browse/YARN-5978 Project:

[jira] [Created] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2016-12-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5977: - Summary: ContainerManagementProtocol changes to support change of container ExecutionType Key: YARN-5977 URL: https://issues.apache.org/jira/browse/YARN-5977 Project:

[jira] [Commented] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727336#comment-15727336 ] Arun Suresh commented on YARN-5966: --- [~hrsharma], YARN-5087 addresses changes in the

[jira] [Updated] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5972: -- Reporter: Hitesh Sharma (was: Arun Suresh) > Add Support for Pausing/Freezing of containers >

[jira] [Comment Edited] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726913#comment-15726913 ] Arun Suresh edited comment on YARN-5972 at 12/6/16 10:49 PM: - [~subru], thanks

[jira] [Commented] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726913#comment-15726913 ] Arun Suresh commented on YARN-5972: --- [~subru], thanks for taking a look. w.r.t your

[jira] [Commented] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725848#comment-15725848 ] Arun Suresh commented on YARN-5972: --- As per Subru's request in YARN-5292, I have moved this to an

[jira] [Commented] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725844#comment-15725844 ] Arun Suresh commented on YARN-5972: --- Create YARN-5972 branch for this work > Add Support for

[jira] [Comment Edited] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725844#comment-15725844 ] Arun Suresh edited comment on YARN-5972 at 12/6/16 3:40 PM: Created YARN-5972

[jira] [Updated] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5292: -- Issue Type: Sub-task (was: New Feature) Parent: YARN-5972 > NM Container lifecycle and state

[jira] [Updated] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5972: -- Description: YARN-2877 introduced OPPORTUNISTIC containers, and YARN-5216 proposes to add capability to

[jira] [Created] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5972: - Summary: Add Support for Pausing/Freezing of containers Key: YARN-5972 URL: https://issues.apache.org/jira/browse/YARN-5972 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5292: -- Summary: NM Container lifecycle and state transitions to support for PAUSED container state. (was:

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723652#comment-15723652 ] Arun Suresh commented on YARN-5292: --- Thanks for the update [~hrsharma]. I am +1 for the latest patch.

[jira] [Updated] (YARN-5085) Add support for change of container ExecutionType

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5085: -- Attachment: YARN-5085.001.patch Attaching a combined patch for all the subpatches to kick off Jenkins.

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5966: -- Attachment: YARN-5966.wip.001.patch Attaching initial patch > AMRMClient changes to support

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5966: -- Description: {{AMRMClient}} changes to support change of container ExecutionType > AMRMClient changes

[jira] [Assigned] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5966: - Assignee: Arun Suresh > AMRMClient changes to support ExecutionType update >

<    8   9   10   11   12   13   14   15   16   17   >