[jira] [Updated] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2771: -- Attachment: YARN-2771.2.patch Just realized I've missed one suggestion from Vinod in the description. I t

[jira] [Updated] (YARN-2772) DistributedShell's timeline related options are not clear

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2772: -- Attachment: YARN-2772.2.patch Make one improvement. If failure happens when creating a domain, the client

[jira] [Commented] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190430#comment-14190430 ] Zhijie Shen commented on YARN-2771: --- Constant name changes. No need for test case. > Dis

[jira] [Updated] (YARN-2772) DistributedShell's timeline related options are not clear

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2772: -- Attachment: YARN-2772.1.patch > DistributedShell's timeline related options are not clear > -

[jira] [Commented] (YARN-2772) DistributedShell's timeline related options are not clear

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14189384#comment-14189384 ] Zhijie Shen commented on YARN-2772: --- [~vinodkv], thanks for your proposal. 1. I prefer "

[jira] [Updated] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2771: -- Attachment: YARN-2771.1.patch While I was aware of the bad naming, I decided to follow the pattern of the

[jira] [Updated] (YARN-2766) ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2766: -- Summary: ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers (was

[jira] [Updated] (YARN-2766) [JDK 8] TestApplicationHistoryClientService fails

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2766: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 > [JDK 8] TestApplicationHistoryClientService f

[jira] [Updated] (YARN-2766) [JDK 8] TestApplicationHistoryClientService fails

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2766: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1530) > [JDK 8] TestApplicationHistoryCli

[jira] [Commented] (YARN-2766) [JDK 8] TestApplicationHistoryClientService fails

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14189194#comment-14189194 ] Zhijie Shen commented on YARN-2766: --- I think we need to change ApplicationContext -> Appl

[jira] [Updated] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2770: -- Attachment: YARN-2770.1.patch Created a patch: * Add two timeline client APIs - renew/cancel delegation

[jira] [Commented] (YARN-2769) Timeline server domain not set correctly when using shell_command on Windows

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188796#comment-14188796 ] Zhijie Shen commented on YARN-2769: --- +1. The fix makes sense, and we have the test to cov

[jira] [Commented] (YARN-2766) [JDK 8] TestApplicationHistoryClientService fails

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188656#comment-14188656 ] Zhijie Shen commented on YARN-2766: --- [~rkanter], thanks for reporting the test failure. I

[jira] [Comment Edited] (YARN-2765) Add leveldb-based implementation for RMStateStore

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188595#comment-14188595 ] Zhijie Shen edited comment on YARN-2765 at 10/29/14 5:22 PM: - b

[jira] [Created] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-10-29 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2770: - Summary: Timeline delegation tokens need to be automatically renewed by the RM Key: YARN-2770 URL: https://issues.apache.org/jira/browse/YARN-2770 Project: Hadoop YARN

[jira] [Commented] (YARN-2765) Add leveldb-based implementation for RMStateStore

2014-10-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188595#comment-14188595 ] Zhijie Shen commented on YARN-2765: --- bq. This should work if the leveldb database is on a

[jira] [Updated] (YARN-2747) TestAggregatedLogFormat fails in trunk

2014-10-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2747: -- Issue Type: Test (was: Bug) > TestAggregatedLogFormat fails in trunk > -

[jira] [Commented] (YARN-2747) TestAggregatedLogFormat fails in trunk

2014-10-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188030#comment-14188030 ] Zhijie Shen commented on YARN-2747: --- +1. The reason makes sense, and I've verified the fi

[jira] [Commented] (YARN-2765) Add leveldb-based implementation for RMStateStore

2014-10-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187987#comment-14187987 ] Zhijie Shen commented on YARN-2765: --- [~jlowe], the leveldb should be a good choice over l

[jira] [Commented] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanag

2014-10-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187455#comment-14187455 ] Zhijie Shen commented on YARN-2741: --- +1 LGTM. The test case will verify the drive letter

[jira] [Commented] (YARN-2760) Completely remove word 'experimental' from FairScheduler docs

2014-10-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186328#comment-14186328 ] Zhijie Shen commented on YARN-2760: --- We should have run into the same issue: HADOOP-11240

[jira] [Updated] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

2014-10-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2758: -- Attachment: YARN-2758.1.patch Hook the test cases to the new generic history store on top of the timeline

[jira] [Created] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

2014-10-27 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2758: - Summary: Update TestApplicationHistoryClientService to use the new generic history store Key: YARN-2758 URL: https://issues.apache.org/jira/browse/YARN-2758 Project: Hadoop

[jira] [Commented] (YARN-2747) TestAggregatedLogFormat fails in trunk

2014-10-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14184673#comment-14184673 ] Zhijie Shen commented on YARN-2747: --- Can you check whether TestLogAggregationService is f

[jira] [Created] (YARN-2748) Upload logs in the sub-folders under the local log dir when aggregating logs

2014-10-26 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2748: - Summary: Upload logs in the sub-folders under the local log dir when aggregating logs Key: YARN-2748 URL: https://issues.apache.org/jira/browse/YARN-2748 Project: Hadoop YA

[jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

2014-10-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14184646#comment-14184646 ] Zhijie Shen commented on YARN-2734: --- +1. Will commit the patch > If a sub-folder is enco

[jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

2014-10-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14184604#comment-14184604 ] Zhijie Shen commented on YARN-2734: --- LGTM overall, one nit: Can we not say "Log file: "

[jira] [Updated] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-10-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2591: -- Attachment: YARN-2591.2.patch Throw authorization exception instead. And change the test cases accordingl

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-10-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183489#comment-14183489 ] Zhijie Shen commented on YARN-2703: --- Will commit the patch. > Add logUploadedTime into L

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-10-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183207#comment-14183207 ] Zhijie Shen commented on YARN-2703: --- The latest patch needs to be rebased after YARN-2724

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183167#comment-14183167 ] Zhijie Shen commented on YARN-2724: --- No worry. Thanks for review, Mit! I'll go ahead to c

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-10-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14182474#comment-14182474 ] Zhijie Shen commented on YARN-2703: --- +1 for the patch. Kick jenkins again > Add logUploa

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-10-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14182438#comment-14182438 ] Zhijie Shen commented on YARN-2209: --- +1 tor the last patch. Will commit it. > Replace AM

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14182133#comment-14182133 ] Zhijie Shen commented on YARN-2724: --- [~mitdesai], any comments so far? > If an unreadabl

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-10-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181791#comment-14181791 ] Zhijie Shen commented on YARN-2703: --- [~xgong], thanks for the patch. Some comments about

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181665#comment-14181665 ] Zhijie Shen commented on YARN-2724: --- +1 for the latest patch. Will commit it later today

[jira] [Created] (YARN-2733) Aggregated log file may be corrupted if IOException happens at copying

2014-10-22 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2733: - Summary: Aggregated log file may be corrupted if IOException happens at copying Key: YARN-2733 URL: https://issues.apache.org/jira/browse/YARN-2733 Project: Hadoop YARN

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181028#comment-14181028 ] Zhijie Shen commented on YARN-2724: --- [~xgong], w.r.t to the fix, I think we shouldn't put

[jira] [Commented] (YARN-2732) Fix syntax error in SecureContainer.apt.vm

2014-10-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180882#comment-14180882 ] Zhijie Shen commented on YARN-2732: --- Straightforward apt syntax fix. I've verified it loc

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-10-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180868#comment-14180868 ] Zhijie Shen commented on YARN-2209: --- bq. Given that we already broken compatibility for r

[jira] [Commented] (YARN-2721) Race condition: ZKRMStateStore retry logic may throw NodeExist exception

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179563#comment-14179563 ] Zhijie Shen commented on YARN-2721: --- +1 straightforward change. Let's make the complete s

[jira] [Updated] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2715: -- Attachment: YARN-2715.4.patch Thanks for the comments. I uploaded a new patch which address the two comme

[jira] [Commented] (YARN-2709) Add retry for timeline client getDelegationToken method

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179281#comment-14179281 ] Zhijie Shen commented on YARN-2709: --- +1 for the last patch. Will commit it. > Add retry

[jira] [Comment Edited] (YARN-2709) Add retry for timeline client getDelegationToken method

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179107#comment-14179107 ] Zhijie Shen edited comment on YARN-2709 at 10/21/14 9:10 PM: - A

[jira] [Commented] (YARN-2709) Add retry for timeline client getDelegationToken method

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179107#comment-14179107 ] Zhijie Shen commented on YARN-2709: --- Almost good to me. Some nits: 1. Can you add a comm

[jira] [Commented] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178992#comment-14178992 ] Zhijie Shen commented on YARN-2715: --- Vinod, thanks for the comments. Agree with them, and

[jira] [Updated] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2715: -- Attachment: YARN-2715.3.patch > Proxy user is problem for RPC interface if > yarn.resourcemanager.webapp

[jira] [Updated] (YARN-2279) Add UTs to cover timeline server authentication

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2279: -- Attachment: YARN-2279.1.patch After refactoring the authentication code. The end-to-end test has already

[jira] [Assigned] (YARN-2279) Add UTs to cover timeline server authentication

2014-10-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2279: - Assignee: Zhijie Shen > Add UTs to cover timeline server authentication >

[jira] [Commented] (YARN-2717) containerLogNotFound log shows multiple time for the same container

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177959#comment-14177959 ] Zhijie Shen commented on YARN-2717: --- +1, will commit the patch > containerLogNotFound lo

[jira] [Updated] (YARN-2709) Add retry for timeline client getDelegationToken method

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2709: -- Issue Type: Sub-task (was: Bug) Parent: YARN-1530 > Add retry for timeline client getDelegationT

[jira] [Commented] (YARN-2709) Add retry for timeline client getDelegationToken method

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177898#comment-14177898 ] Zhijie Shen commented on YARN-2709: --- [~gtCarrera], thanks for the patch. Here're some com

[jira] [Updated] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2715: -- Attachment: YARN-2715.2.patch Fix the findbugs warning and the test failure > Proxy user is problem for

[jira] [Updated] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2715: -- Attachment: YARN-2715.1.patch Made a patch with the following changes: 1. Use "yarn.resourcemanager.prox

[jira] [Commented] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177631#comment-14177631 ] Zhijie Shen commented on YARN-2715: --- Vinod, thanks for the comments. It makes sense to me

[jira] [Created] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

2014-10-20 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2715: - Summary: Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set. Key: YARN-2715 URL: https://issues.apache.org/jira/browse/YARN-2715 Pr

[jira] [Commented] (YARN-2582) Log related CLI and Web UI changes for Aggregated Logs in LRS

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177392#comment-14177392 ] Zhijie Shen commented on YARN-2582: --- +1 for the last patch. Will commit it. > Log relate

[jira] [Commented] (YARN-2673) Add retry for timeline client put APIs

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177326#comment-14177326 ] Zhijie Shen commented on YARN-2673: --- +1 will commit the patch > Add retry for timeline c

[jira] [Commented] (YARN-2582) Log related CLI and Web UI changes for Aggregated Logs in LRS

2014-10-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177274#comment-14177274 ] Zhijie Shen commented on YARN-2582: --- Looks good to me overall. Just one nit Make the fol

[jira] [Commented] (YARN-2673) Add retry for timeline client put APIs

2014-10-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14175814#comment-14175814 ] Zhijie Shen commented on YARN-2673: --- 1. Remove RESTful to be neutral in case the channel

[jira] [Updated] (YARN-2676) Timeline authentication filter should add support for proxy user

2014-10-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2676: -- Attachment: YARN-2676.5.patch Fix the a typo the prior patch > Timeline authentication filter should add

[jira] [Updated] (YARN-2676) Timeline authentication filter should add support for proxy user

2014-10-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2676: -- Attachment: YARN-2676.4.patch Vinod, thanks for the comments! I've uploaded a new patch which addresses b

[jira] [Updated] (YARN-2676) Timeline authentication filter should add support for proxy user

2014-10-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2676: -- Attachment: YARN-2676.3.patch Modify the logic of sourcing the proxy user configuration in order to be c

[jira] [Commented] (YARN-2673) Add retry for timeline client put APIs

2014-10-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174783#comment-14174783 ] Zhijie Shen commented on YARN-2673: --- [~gtCarrera], thanks for working on this issue. bq.

[jira] [Updated] (YARN-2673) Add retry for timeline client put APIs

2014-10-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2673: -- Summary: Add retry for timeline client put APIs (was: Add retry for timeline client) > Add retry for ti

[jira] [Updated] (YARN-2676) Timeline authentication filter should add support for proxy user

2014-10-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2676: -- Attachment: YARN-2676.2.patch Added the test case that does the end-to-end verification when kerberos au

[jira] [Resolved] (YARN-2100) Refactor the Timeline Server code for Kerberos + DT authentication

2014-10-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2100. --- Resolution: Duplicate YARN-2676 is going to reuse the common DT auth filter. Close this Jira as the du

[jira] [Commented] (YARN-2676) Timeline authentication filter should add support for proxy user

2014-10-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173101#comment-14173101 ] Zhijie Shen commented on YARN-2676: --- The patch needs to base on the one in HADOOP-11207

[jira] [Updated] (YARN-2676) Timeline authentication filter should add support for proxy user

2014-10-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2676: -- Attachment: YARN-2676.1.patch Upload a working in progress patch: 1. Server side: make TimelineAuthentic

[jira] [Created] (YARN-2697) RMAuthenticationHandler is no longer useful

2014-10-15 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2697: - Summary: RMAuthenticationHandler is no longer useful Key: YARN-2697 URL: https://issues.apache.org/jira/browse/YARN-2697 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-2656) RM web services authentication filter should add support for proxy user

2014-10-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2656: -- Attachment: YARN-2656.5.patch Good catch! Fix the issue in the newest patch. > RM web services authentic

[jira] [Commented] (YARN-2656) RM web services authentication filter should add support for proxy user

2014-10-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171354#comment-14171354 ] Zhijie Shen commented on YARN-2656: --- Kick the jenkins again, as HADOOP-11181 is already c

[jira] [Updated] (YARN-2651) Spin off the LogRollingInterval from LogAggregationContext

2014-10-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2651: -- Description: Remove per-app rolling interval completely and then have nodemanager wake up every so often

[jira] [Updated] (YARN-2651) Spin off the LogRollingInterval from LogAggregationContext

2014-10-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2651: -- Hadoop Flags: Reviewed > Spin off the LogRollingInterval from LogAggregationContext > ---

[jira] [Commented] (YARN-2651) Spin off the LogRollingInterval from LogAggregationContext

2014-10-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169564#comment-14169564 ] Zhijie Shen commented on YARN-2651: --- +1 for the patch. Before commit it, [~xgong], would

[jira] [Updated] (YARN-2656) RM web services authentication filter should add support for proxy user

2014-10-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2656: -- Attachment: YARN-2656.4.patch Update the config name > RM web services authentication filter should add

[jira] [Created] (YARN-2676) Timeline authentication filter should add support for proxy user

2014-10-10 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2676: - Summary: Timeline authentication filter should add support for proxy user Key: YARN-2676 URL: https://issues.apache.org/jira/browse/YARN-2676 Project: Hadoop YARN

[jira] [Commented] (YARN-2656) RM web services authentication filter should add support for proxy user

2014-10-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167130#comment-14167130 ] Zhijie Shen commented on YARN-2656: --- bq. I think we should use "hadoop.proxyusers" instea

[jira] [Updated] (YARN-2583) Modify the LogDeletionService to support Log aggregation for LRS

2014-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2583: -- Attachment: YARN-2583.6.patch +1 for the patch. I made some cosmetic change based on it. I'll commit the

[jira] [Updated] (YARN-2656) RM web services authentication filter should add support for proxy user

2014-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2656: -- Attachment: YARN-2656.3.patch > RM web services authentication filter should add support for proxy user >

[jira] [Commented] (YARN-2656) RM web services authentication filter should add support for proxy user

2014-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166414#comment-14166414 ] Zhijie Shen commented on YARN-2656: --- [~vvasudev], thanks for the patch. It looks good to

[jira] [Updated] (YARN-2673) Add retry for timeline client

2014-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2673: -- Issue Type: Sub-task (was: Bug) Parent: YARN-1530 > Add retry for timeline client >

[jira] [Commented] (YARN-2671) ApplicationSubmissionContext change breaks the existing app submission

2014-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166088#comment-14166088 ] Zhijie Shen commented on YARN-2671: --- +1. Will commit the patch. > ApplicationSubmissionC

[jira] [Updated] (YARN-2671) ApplicationSubmissionContext change breaks the existing app submission

2014-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2671: -- Priority: Blocker (was: Major) > ApplicationSubmissionContext change breaks the existing app submission

[jira] [Created] (YARN-2671) ApplicationSubmissionContext change breaks the existing app submission

2014-10-09 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2671: - Summary: ApplicationSubmissionContext change breaks the existing app submission Key: YARN-2671 URL: https://issues.apache.org/jira/browse/YARN-2671 Project: Hadoop YARN

[jira] [Updated] (YARN-2598) GHS should show N/A instead of null for the inaccessible information

2014-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2598: -- Hadoop Flags: Reviewed > GHS should show N/A instead of null for the inaccessible information > -

[jira] [Commented] (YARN-2656) RM web services authentication filter should add support for proxy user

2014-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164866#comment-14164866 ] Zhijie Shen commented on YARN-2656: --- I did some investigation on the test failure. It see

[jira] [Comment Edited] (YARN-2660) Tarball as local resource type archive fails to localize on Windows

2014-10-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164284#comment-14164284 ] Zhijie Shen edited comment on YARN-2660 at 10/8/14 10:24 PM: - +

[jira] [Commented] (YARN-2660) Tarball as local resource type archive fails to localize on Windows

2014-10-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164284#comment-14164284 ] Zhijie Shen commented on YARN-2660: --- +1. LGTM > Tarball as local resource type archive f

[jira] [Commented] (YARN-2583) Modify the LogDeletionService to support Log aggregation for LRS

2014-10-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163990#comment-14163990 ] Zhijie Shen commented on YARN-2583: --- 1. Let's do it in YARN-2651 (also the config in yarn

[jira] [Commented] (YARN-2582) Log related CLI and Web UI changes for LRS

2014-10-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14163116#comment-14163116 ] Zhijie Shen commented on YARN-2582: --- Thanks for the patch, Xuan! Here're some comments an

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-10-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162820#comment-14162820 ] Zhijie Shen commented on YARN-2517: --- bq. Clearly, async calls need call-back handlers jus

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2014-10-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162816#comment-14162816 ] Zhijie Shen commented on YARN-2423: --- Update the title and description, as it's good to do

[jira] [Updated] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2014-10-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2423: -- Description: TimelineClient provides the Java method to put timeline entities. It's also good to wrap ove

[jira] [Updated] (YARN-2629) Make distributed shell use the domain-based timeline ACLs

2014-10-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2629: -- Attachment: YARN-2629.4.patch > Make distributed shell use the domain-based timeline ACLs > -

[jira] [Commented] (YARN-2629) Make distributed shell use the domain-based timeline ACLs

2014-10-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14162804#comment-14162804 ] Zhijie Shen commented on YARN-2629: --- bq. 1. I noticed that you've changed a few method si

[jira] [Updated] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-10-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2320: -- Attachment: YARN-2320.3.patch Update against the latest trunk > Removing old application history store a

[jira] [Comment Edited] (YARN-2583) Modify the LogDeletionService to support Log aggregation for LRS

2014-10-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161547#comment-14161547 ] Zhijie Shen edited comment on YARN-2583 at 10/7/14 7:26 AM: [~x

[jira] [Commented] (YARN-2583) Modify the LogDeletionService to support Log aggregation for LRS

2014-10-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161547#comment-14161547 ] Zhijie Shen commented on YARN-2583: --- 1. Be more specific: we find a more scalable method

[jira] [Updated] (YARN-2629) Make distributed shell use the domain-based timeline ACLs

2014-10-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2629: -- Attachment: YARN-2629.3.patch Upload a new patch: 1. Fix the test failure 2. Remove two lines of unneces

<    6   7   8   9   10   11   12   13   14   15   >