Incompatible change in Hadoop 2.8.0 (YARN-4126)

Hi, Our Oozie team recently found that YARN-4126 appears to introduce an incompatible change into Hadoop 2.8.0. Namely, it removes delegation tokens from being used in a non-secure cluster. Clients, such as Oozie, that were previously using a del

Re: Incompatible change in Hadoop 2.8.0 (YARN-4126)

o I'm guessing they simply missed seeing YARN-5750 when it was > filed. > > I haven't looked into the details of YARN-4126, but on the surface it > seems appropriate to revert for 2.8 if it broke a major downstream project. > > Jason > > > On Wednesda

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

Thanks Andrew! - Deployed binary artifacts in a pseudo-distributed cluster (MacOS Sierra, Java 1.8.0_91) - Ran pi job - Clicked around the web UIs - Tried log aggregation - Played a bit with HDFS - Tried yarn top +1 (binding) - Robert On Thu, Jul 6, 2017 at 4:21 PM, Hanisha Koneru wrote: >

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

+1 (binding) + Downloaded the binary release + Deployed on a 3 node cluster on CentOS 7.3 + Ran some MR jobs, clicked around the UI, etc + Ran some CLI commands (yarn logs, etc) Good job everyone on Hadoop 3! - Robert On Tue, Dec 12, 2017 at 1:56 PM, Arun Suresh wrote: > +1 (binding) > > - V

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

+1 (binding) - verified signatures and checksums - setup pseudo cluster using Fair Scheduler from binary tarball - ran some of the example jobs, clicked around the UI a bit By the way, ASF recommends using a 4096 bit key for signing, though 2048 is fine for now. https://www.apache.org/dev/release

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

+1 (binding) - Verified md5 - Deployed single node cluster from binary tarball - Ran some sample jobs, a few of the CLI commands, and the web UIs - Ran some Oozie jobs - Robert On Fri, Jan 22, 2016 at 5:53 PM, Rohith Sharma K S wrote: > +1(non binding) > -downloaded package and installed in 3

Re: Hadoop 3.2 Release Plan proposal

Looks like there's two that weren't updated: >> [115] 16:32 : hadoop-common (trunk) :: grep "3.2.0-SNAPSHOT" . -r --include=pom.xml ./hadoop-project/pom.xml: 3.2.0-SNAPSHOT ./pom.xml:3.2.0-SNAPSHOT I've just pushed in an addendum commit to fix those. In the future, please make sure to do a san

Re: Incompatible changes between branch-2.8 and branch-2.9

> > * For YARN-6050, there's a bit here: > https://developers.google.com/protocol-buffers/docs/proto that says > "optional is compatible with repeated", so I think we should be OK there. > - Optional is compatible with repeatable over the wire such that > protobuf won't blow up, but does that a

Re: Different JIRA permissions for HADOOP and HDFS

We've also had a related long-standing issue (or at least I have) where I can't add any more contributors to HADOOP or HDFS because JIRA times out on looking up their username. I'm guessing we have too many contributors for those projects. I bet YARN and MAPREDUCE are close. Is there some way fo

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

+1 (binding) - Downloaded binary tarball - verified signatures - setup pseudo cluster - ran some of the example jobs, clicked around the UI a bit - Robert On Mon, Jul 25, 2016 at 3:28 PM, Jason Lowe wrote: > +1 (binding) > - Verified signatures and digests- Built from source with native supp

Re: [DISCUSS] About the details of JDK-8 support

The only problem with trying to get the JDK 8 trunk builds green (or blue I guess) is that it's like trying to hit a moving target because of how many new commits keep coming in. I was looking at fixing these a while ago, and managed to at least make them compile and fixed (or worked with others t

Re: Looking to a Hadoop 3 release

+1 Happy to help too On Mon, Mar 2, 2015 at 3:57 PM, Yongjun Zhang wrote: > Thanks Andrew for the proposal. > > +1, and I will be happy to help. > > --Yongjun > > > > > On Mon, Mar 2, 2015 at 3:19 PM, Andrew Wang > wrote: > > > Hi devs, > > > > It's been a year and a half since 2.x went GA, an

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

+1 (non-binding) + verified checksum + Deployed binary tarball, ran some examples, clicked around in the Web UIs thanks - Robert On Tue, Apr 14, 2015 at 10:22 AM, Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > +1 (non-binding) > > + verified signature and mds of source and binary tarb

Re: Set minimum version of Hadoop 3 to JDK 8

+ yarn-dev, hdfs-dev, mapred-dev On Tue, Apr 21, 2015 at 3:14 PM, Robert Kanter wrote: > Hi all, > > Moving forward on some of the discussions on Hadoop 3, I've created > HADOOP-11858 to set the minimum version of Hadoop 3 to JDK 8. I just > wanted to let everyone know

Re: Set minimum version of Hadoop 3 to JDK 8

t; to do in any case since it'll still target 1.7. > > I'll note that HADOOP-10530 details the pain Steve went through switching > us to JDK7. Might be some lessons learned about how to do this transition > more smoothly. > > Thanks, > Andrew > > On Tue, Apr 21,

Re: Set minimum version of Hadoop 3 to JDK 8

You're absolutely right Steve. We should get the jobs under control. At the very least, before we move to JDK 8 in Jenkins, we should get the Java8 nightly builds working. I didn't realize we had these, and I had thought all compiling and most test issues with JDK8 were already fixed based on wh

Re: [DISCUSS] Developing features in branches

+1 A good example of both sides of this are the ATSv1 and ATSv2. v1 was not done in a feature branch, and was included piecemeal in Hadoop releases in various states. In the end, it's design doesn't scale and there's a few other problems that aren't going to be fixed; and we're already working o

Re: [VOTE] Release Apache Hadoop 2.6.0

Hi Arun, We were testing the RC and ran into a problem with the recent fixes that were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for HttpFS). Basically, in disabling SSLv3, we also disabled SSLv2Hello, which is required for older clients (e.g. Java 6 with openssl 0.9.8x) so t

[jira] [Resolved] (YARN-3218) Implement ConcatenatableAggregatedLogFormat Reader and Writer

[ https://issues.apache.org/jira/browse/YARN-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-3218. - Resolution: Won't Fix Closing this as "Won't Fix" given we have MAPREDUC

[jira] [Resolved] (YARN-2942) Aggregated Log Files should be combined

[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-2942. - Resolution: Won't Fix Target Version/s: (was: 2.8.0) Closing this as "Won&#x

[jira] [Resolved] (YARN-3219) Modify the NM to write logs using the ConcatenatableAggregatedLogFormat

[ https://issues.apache.org/jira/browse/YARN-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-3219. - Resolution: Won't Fix Closing this as "Won't Fix" given we have MAPREDUCE-64

[jira] [Resolved] (YARN-3729) Modify the yarn CLI to be able to read the ConcatenatableAggregatedLogFormat

[ https://issues.apache.org/jira/browse/YARN-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-3729. - Resolution: Won't Fix Closing this as "Won't Fix" given we have MAPREDUCE-6415

[jira] [Resolved] (YARN-3220) Create a Service in the RM to concatenate aggregated logs

[ https://issues.apache.org/jira/browse/YARN-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-3220. - Resolution: Won't Fix Closing this as "Won't Fix" given we have MAPREDU

[jira] [Resolved] (YARN-3728) Add an rmadmin command to compact concatenated aggregated logs

[ https://issues.apache.org/jira/browse/YARN-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-3728. - Resolution: Won't Fix Closing this as "Won't Fix" given we have MAPREDUCE-641

[jira] [Resolved] (YARN-5750) YARN-4126 broke Oozie on unsecure cluster

[ https://issues.apache.org/jira/browse/YARN-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-5750. - Resolution: Duplicate YARN-4126 has been reverted from branch-2 and 2.8. It's now only

[jira] [Created] (YARN-5837) NPE when getting node status of a decommissioned node after an RM restart

Robert Kanter created YARN-5837: --- Summary: NPE when getting node status of a decommissioned node after an RM restart Key: YARN-5837 URL: https://issues.apache.org/jira/browse/YARN-5837 Project: Hadoop

[jira] [Created] (YARN-6050) AMs can't be scheduled on racks or nodes

Robert Kanter created YARN-6050: --- Summary: AMs can't be scheduled on racks or nodes Key: YARN-6050 URL: https://issues.apache.org/jira/browse/YARN-6050 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6051) Create CS test for YARN-6050

Robert Kanter created YARN-6051: --- Summary: Create CS test for YARN-6050 Key: YARN-6051 URL: https://issues.apache.org/jira/browse/YARN-6051 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-6356) Allow different values of yarn.log-aggregation.retain-seconds for succeeded and failed jobs

Robert Kanter created YARN-6356: --- Summary: Allow different values of yarn.log-aggregation.retain-seconds for succeeded and failed jobs Key: YARN-6356 URL: https://issues.apache.org/jira/browse/YARN-6356

[jira] [Created] (YARN-6359) TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition

Robert Kanter created YARN-6359: --- Summary: TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition Key: YARN-6359 URL: https://issues.apache.org/jira/browse/YARN-6359 Project

[jira] [Created] (YARN-6527) Provide a better out-of-the-box experience for SLS

Robert Kanter created YARN-6527: --- Summary: Provide a better out-of-the-box experience for SLS Key: YARN-6527 URL: https://issues.apache.org/jira/browse/YARN-6527 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-5894) fixed license warning caused by de.ruedigermoeller:fst:jar:2.24

[ https://issues.apache.org/jira/browse/YARN-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-5894. - Resolution: Fixed Fix Version/s: 2.8.1 2.9.0 Sure thing - committed to

[jira] [Created] (YARN-6602) Impersonation does not work if standby RM is contacted first

Robert Kanter created YARN-6602: --- Summary: Impersonation does not work if standby RM is contacted first Key: YARN-6602 URL: https://issues.apache.org/jira/browse/YARN-6602 Project: Hadoop YARN

[jira] [Created] (YARN-6642) TestRMFailover fails rarely due to port conflict

Robert Kanter created YARN-6642: --- Summary: TestRMFailover fails rarely due to port conflict Key: YARN-6642 URL: https://issues.apache.org/jira/browse/YARN-6642 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6643) TestRMFailover fails rarely due to port conflict

Robert Kanter created YARN-6643: --- Summary: TestRMFailover fails rarely due to port conflict Key: YARN-6643 URL: https://issues.apache.org/jira/browse/YARN-6643 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6974) Make CuratorBasedElectorService the default

Robert Kanter created YARN-6974: --- Summary: Make CuratorBasedElectorService the default Key: YARN-6974 URL: https://issues.apache.org/jira/browse/YARN-6974 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-6993) getResourceCalculatorPlugin for the default should not intercept throwable

Robert Kanter created YARN-6993: --- Summary: getResourceCalculatorPlugin for the default should not intercept throwable Key: YARN-6993 URL: https://issues.apache.org/jira/browse/YARN-6993 Project: Hadoop

[jira] [Created] (YARN-7020) TestAMRMProxy#testAMRMProxyTokenRenewal is flakey

Robert Kanter created YARN-7020: --- Summary: TestAMRMProxy#testAMRMProxyTokenRenewal is flakey Key: YARN-7020 URL: https://issues.apache.org/jira/browse/YARN-7020 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-7094) Document that server-side graceful decom is currently not recommended

Robert Kanter created YARN-7094: --- Summary: Document that server-side graceful decom is currently not recommended Key: YARN-7094 URL: https://issues.apache.org/jira/browse/YARN-7094 Project: Hadoop YARN

[jira] [Created] (YARN-7146) Many RM unit tests failing with FairScheduler

Robert Kanter created YARN-7146: --- Summary: Many RM unit tests failing with FairScheduler Key: YARN-7146 URL: https://issues.apache.org/jira/browse/YARN-7146 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-7162) Remove XML excludes file format

Robert Kanter created YARN-7162: --- Summary: Remove XML excludes file format Key: YARN-7162 URL: https://issues.apache.org/jira/browse/YARN-7162 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7262) Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow

Robert Kanter created YARN-7262: --- Summary: Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow Key: YARN-7262 URL: https://issues.apache.org/jira/browse/YARN-7262

[jira] [Created] (YARN-7301) Create stable Scheduler API

Robert Kanter created YARN-7301: --- Summary: Create stable Scheduler API Key: YARN-7301 URL: https://issues.apache.org/jira/browse/YARN-7301 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-7138. - Resolution: Won't Fix Ok. I've created YARN-7301. > Fix incompatible A

[jira] [Created] (YARN-7308) TestApplicationACLs fails with FairScheduler

Robert Kanter created YARN-7308: --- Summary: TestApplicationACLs fails with FairScheduler Key: YARN-7308 URL: https://issues.apache.org/jira/browse/YARN-7308 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7309) TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by Fa

Robert Kanter created YARN-7309: --- Summary: TestClientRMService#testUpdateApplicationPriorityRequest and TestClientRMService#testUpdatePriorityAndKillAppWithZeroClusterResource test functionality not supported by FairScheduler Key

[jira] [Created] (YARN-7310) TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler

Robert Kanter created YARN-7310: --- Summary: TestAMRMProxy#testAMRMProxyE2E fails with FairScheduler Key: YARN-7310 URL: https://issues.apache.org/jira/browse/YARN-7310 Project: Hadoop YARN

[jira] [Created] (YARN-7341) TestRouterWebServiceUtil#testMergeMetrics is flakey

Robert Kanter created YARN-7341: --- Summary: TestRouterWebServiceUtil#testMergeMetrics is flakey Key: YARN-7341 URL: https://issues.apache.org/jira/browse/YARN-7341 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7382) NoSuchElementException in FairScheduler after failover causes RM crash

Robert Kanter created YARN-7382: --- Summary: NoSuchElementException in FairScheduler after failover causes RM crash Key: YARN-7382 URL: https://issues.apache.org/jira/browse/YARN-7382 Project: Hadoop

[jira] [Created] (YARN-7385) TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE

Robert Kanter created YARN-7385: --- Summary: TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE Key: YARN-7385 URL: https://issues.apache.org/jira/browse/YARN-7385

[jira] [Created] (YARN-7389) Make TestResourceManager Scheduler agnostic

Robert Kanter created YARN-7389: --- Summary: Make TestResourceManager Scheduler agnostic Key: YARN-7389 URL: https://issues.apache.org/jira/browse/YARN-7389 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-7458) TestContainerManagerSecurity is still flakey

Robert Kanter created YARN-7458: --- Summary: TestContainerManagerSecurity is still flakey Key: YARN-7458 URL: https://issues.apache.org/jira/browse/YARN-7458 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7645) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers is flakey with FairScheduler

Robert Kanter created YARN-7645: --- Summary: TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers is flakey with FairScheduler Key: YARN-7645 URL: https://issues.apache.org/jira/browse/YARN-7645

[jira] [Created] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

Robert Kanter created YARN-8051: --- Summary: TestRMEmbeddedElector#testCallbackSynchronization is flakey Key: YARN-8051 URL: https://issues.apache.org/jira/browse/YARN-8051 Project: Hadoop YARN

[jira] [Created] (YARN-4408) NodeManager still reports negative running containers

Robert Kanter created YARN-4408: --- Summary: NodeManager still reports negative running containers Key: YARN-4408 URL: https://issues.apache.org/jira/browse/YARN-4408 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-2736) Job.getHistoryUrl returns empty string

[ https://issues.apache.org/jira/browse/YARN-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-2736. - Resolution: Fixed > Job.getHistoryUrl returns empty str

[jira] [Created] (YARN-8310) Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

Robert Kanter created YARN-8310: --- Summary: Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats Key: YARN-8310 URL: https://issues.apache.org/jira/browse/YARN-8310

[jira] [Created] (YARN-8448) AM HTTPS Support

Robert Kanter created YARN-8448: --- Summary: AM HTTPS Support Key: YARN-8448 URL: https://issues.apache.org/jira/browse/YARN-8448 Project: Hadoop YARN Issue Type: Sub-task Reporter

[jira] [Created] (YARN-8449) RM HA for AM HTTPS Support

Robert Kanter created YARN-8449: --- Summary: RM HA for AM HTTPS Support Key: YARN-8449 URL: https://issues.apache.org/jira/browse/YARN-8449 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8582) Documentation for AM HTTPS Support

Robert Kanter created YARN-8582: --- Summary: Documentation for AM HTTPS Support Key: YARN-8582 URL: https://issues.apache.org/jira/browse/YARN-8582 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8857) Upgrade BouncyCastle

Robert Kanter created YARN-8857: --- Summary: Upgrade BouncyCastle Key: YARN-8857 URL: https://issues.apache.org/jira/browse/YARN-8857 Project: Hadoop YARN Issue Type: Improvement Affects

[jira] [Created] (YARN-8922) Fix test-container-executor

Robert Kanter created YARN-8922: --- Summary: Fix test-container-executor Key: YARN-8922 URL: https://issues.apache.org/jira/browse/YARN-8922 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-6586) YARN to facilitate HTTPS in AM web server

[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-6586. - Resolution: Fixed Fix Version/s: 3.3.0 All subtasks are now complete. Thanks for the

[jira] [Created] (YARN-4946) RM should write out Aggregated Log Completion file flag next to logs

Robert Kanter created YARN-4946: --- Summary: RM should write out Aggregated Log Completion file flag next to logs Key: YARN-4946 URL: https://issues.apache.org/jira/browse/YARN-4946 Project: Hadoop YARN

[jira] [Resolved] (YARN-4366) Fix Lint Warnings in YARN Common

[ https://issues.apache.org/jira/browse/YARN-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-4366. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Thanks [~templedf

[jira] [Created] (YARN-5434) Add -client|server argument for graceful decom

Robert Kanter created YARN-5434: --- Summary: Add -client|server argument for graceful decom Key: YARN-5434 URL: https://issues.apache.org/jira/browse/YARN-5434 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

Robert Kanter created YARN-5464: --- Summary: Server-Side NM Graceful Decommissioning with RM HA Key: YARN-5464 URL: https://issues.apache.org/jira/browse/YARN-5464 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5465) Server-Side NM Graceful Decommissioning subsequent call behavior

Robert Kanter created YARN-5465: --- Summary: Server-Side NM Graceful Decommissioning subsequent call behavior Key: YARN-5465 URL: https://issues.apache.org/jira/browse/YARN-5465 Project: Hadoop YARN

[jira] [Created] (YARN-5514) Clarify DecommissionType.FORCEFUL comment

Robert Kanter created YARN-5514: --- Summary: Clarify DecommissionType.FORCEFUL comment Key: YARN-5514 URL: https://issues.apache.org/jira/browse/YARN-5514 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-5515) Compatibility Docs should clarify the policy for what takes precedence when a conflict is found

Robert Kanter created YARN-5515: --- Summary: Compatibility Docs should clarify the policy for what takes precedence when a conflict is found Key: YARN-5515 URL: https://issues.apache.org/jira/browse/YARN-5515

[jira] [Created] (YARN-5566) client-side NM graceful decom doesn't trigger when jobs finish

Robert Kanter created YARN-5566: --- Summary: client-side NM graceful decom doesn't trigger when jobs finish Key: YARN-5566 URL: https://issues.apache.org/jira/browse/YARN-5566 Project: Hadoop

[jira] [Created] (YARN-3728) Add an rmadmin command to compact concatenated aggregated logs

Robert Kanter created YARN-3728: --- Summary: Add an rmadmin command to compact concatenated aggregated logs Key: YARN-3728 URL: https://issues.apache.org/jira/browse/YARN-3728 Project: Hadoop YARN

[jira] [Created] (YARN-3729) Modify the yarn CLI to be able to read the ConcatenatableAggregatedLogFormat

Robert Kanter created YARN-3729: --- Summary: Modify the yarn CLI to be able to read the ConcatenatableAggregatedLogFormat Key: YARN-3729 URL: https://issues.apache.org/jira/browse/YARN-3729 Project

[jira] [Created] (YARN-3812) TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347

Robert Kanter created YARN-3812: --- Summary: TestRollingLevelDBTimelineStore fails in trunk due to HADOOP-11347 Key: YARN-3812 URL: https://issues.apache.org/jira/browse/YARN-3812 Project: Hadoop YARN

[jira] [Created] (YARN-3950) Add unique SHELL_ID environment variable to DistributedShell

Robert Kanter created YARN-3950: --- Summary: Add unique SHELL_ID environment variable to DistributedShell Key: YARN-3950 URL: https://issues.apache.org/jira/browse/YARN-3950 Project: Hadoop YARN

[jira] [Created] (YARN-4019) Add JvmPauseMonitor to ResourceManager and NodeManager

Robert Kanter created YARN-4019: --- Summary: Add JvmPauseMonitor to ResourceManager and NodeManager Key: YARN-4019 URL: https://issues.apache.org/jira/browse/YARN-4019 Project: Hadoop YARN Issue

[jira] [Created] (YARN-4086) Allow Aggregated Log readers to handle HAR files

Robert Kanter created YARN-4086: --- Summary: Allow Aggregated Log readers to handle HAR files Key: YARN-4086 URL: https://issues.apache.org/jira/browse/YARN-4086 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-2942) Aggregated Log Files should be compacted

Robert Kanter created YARN-2942: --- Summary: Aggregated Log Files should be compacted Key: YARN-2942 URL: https://issues.apache.org/jira/browse/YARN-2942 Project: Hadoop YARN Issue Type: New

[jira] [Created] (YARN-3183) Some classes define hashcode() but not equals()

Robert Kanter created YARN-3183: --- Summary: Some classes define hashcode() but not equals() Key: YARN-3183 URL: https://issues.apache.org/jira/browse/YARN-3183 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-3218) Implement CombinedAggregatedLogFormat Reader and Writer

Robert Kanter created YARN-3218: --- Summary: Implement CombinedAggregatedLogFormat Reader and Writer Key: YARN-3218 URL: https://issues.apache.org/jira/browse/YARN-3218 Project: Hadoop YARN

[jira] [Created] (YARN-3219) Use CombinedAggregatedLogFormat Writer to combine aggregated log files

Robert Kanter created YARN-3219: --- Summary: Use CombinedAggregatedLogFormat Writer to combine aggregated log files Key: YARN-3219 URL: https://issues.apache.org/jira/browse/YARN-3219 Project: Hadoop

[jira] [Created] (YARN-3220) JHS should display Combined Aggregated Logs when available

Robert Kanter created YARN-3220: --- Summary: JHS should display Combined Aggregated Logs when available Key: YARN-3220 URL: https://issues.apache.org/jira/browse/YARN-3220 Project: Hadoop YARN

[jira] [Created] (YARN-3400) [JDK 8] Build Failure due to unreported exceptions in RPCUtil

Robert Kanter created YARN-3400: --- Summary: [JDK 8] Build Failure due to unreported exceptions in RPCUtil Key: YARN-3400 URL: https://issues.apache.org/jira/browse/YARN-3400 Project: Hadoop YARN

[jira] [Created] (YARN-3580) [JDK 8] TestClientRMService.testGetLabelsToNodes fails

Robert Kanter created YARN-3580: --- Summary: [JDK 8] TestClientRMService.testGetLabelsToNodes fails Key: YARN-3580 URL: https://issues.apache.org/jira/browse/YARN-3580 Project: Hadoop YARN Issue

[jira] [Created] (YARN-1245) org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart.testRMRestart times out

Robert Kanter created YARN-1245: --- Summary: org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart.testRMRestart times out Key: YARN-1245 URL: https://issues.apache.org/jira/browse/YARN-1245

[jira] [Created] (YARN-1731) ResourceManager should record killed ApplicationMasters for History

Robert Kanter created YARN-1731: --- Summary: ResourceManager should record killed ApplicationMasters for History Key: YARN-1731 URL: https://issues.apache.org/jira/browse/YARN-1731 Project: Hadoop YARN

[jira] [Created] (YARN-1795) Oozie tests are flakey after YARN-713

Robert Kanter created YARN-1795: --- Summary: Oozie tests are flakey after YARN-713 Key: YARN-1795 URL: https://issues.apache.org/jira/browse/YARN-1795 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-1811) Error 500 when clicking the "Application Master" link in the RM UI while a job is running with RM HA

Robert Kanter created YARN-1811: --- Summary: Error 500 when clicking the "Application Master" link in the RM UI while a job is running with RM HA Key: YARN-1811 URL: https://issues.apache.org/jira/browse

[jira] [Created] (YARN-1822) Revisit AM link being broken for RM restart

Robert Kanter created YARN-1822: --- Summary: Revisit AM link being broken for RM restart Key: YARN-1822 URL: https://issues.apache.org/jira/browse/YARN-1822 Project: Hadoop YARN Issue Type: Sub

[jira] [Resolved] (YARN-1822) Revisit AM link being broken for work preserving restart

[ https://issues.apache.org/jira/browse/YARN-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-1822. - Resolution: Invalid YARN-1811 is being done differently, and this is no longer needed > Revi

[jira] [Resolved] (YARN-1795) After YARN-713, using FairScheduler can cause an InvalidToken Exception for NMTokens

[ https://issues.apache.org/jira/browse/YARN-1795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-1795. - Resolution: Duplicate Assignee: Robert Kanter (was: Karthik Kambatla) I tried the patch

[jira] [Created] (YARN-1846) TestRM.testNMTokenSentForNormalContainer assumes CapacityScheduler

Robert Kanter created YARN-1846: --- Summary: TestRM.testNMTokenSentForNormalContainer assumes CapacityScheduler Key: YARN-1846 URL: https://issues.apache.org/jira/browse/YARN-1846 Project: Hadoop YARN

[jira] [Created] (YARN-2015) HTTPS doesn't work properly for daemons (RM, JHS, NM)

Robert Kanter created YARN-2015: --- Summary: HTTPS doesn't work properly for daemons (RM, JHS, NM) Key: YARN-2015 URL: https://issues.apache.org/jira/browse/YARN-2015 Project: Hadoop YARN

[jira] [Resolved] (YARN-2015) HTTPS doesn't work properly for daemons (RM, JHS, NM)

[ https://issues.apache.org/jira/browse/YARN-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved YARN-2015. - Resolution: Invalid Nevermind, this appears to be fixed by YARN-1553 > HTTPS doesn

[jira] [Created] (YARN-2187) FairScheduler should have a way of disabling the max AM share check for launching new AMs

Robert Kanter created YARN-2187: --- Summary: FairScheduler should have a way of disabling the max AM share check for launching new AMs Key: YARN-2187 URL: https://issues.apache.org/jira/browse/YARN-2187

[jira] [Created] (YARN-2199) FairScheduler: Allow max-AM-share to be specified in the root queue

Robert Kanter created YARN-2199: --- Summary: FairScheduler: Allow max-AM-share to be specified in the root queue Key: YARN-2199 URL: https://issues.apache.org/jira/browse/YARN-2199 Project: Hadoop YARN

[jira] [Created] (YARN-2204) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

Robert Kanter created YARN-2204: --- Summary: TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler Key: YARN-2204 URL: https://issues.apache.org/jira/browse/YARN-2204 Project

[jira] [Created] (YARN-2241) Show nicer messages when ZNodes already exist in ZKRMStateStore on startup

Robert Kanter created YARN-2241: --- Summary: Show nicer messages when ZNodes already exist in ZKRMStateStore on startup Key: YARN-2241 URL: https://issues.apache.org/jira/browse/YARN-2241 Project: Hadoop

[jira] [Created] (YARN-2766) [JDK 8] TestApplicationHistoryClientService fails

Robert Kanter created YARN-2766: --- Summary: [JDK 8] TestApplicationHistoryClientService fails Key: YARN-2766 URL: https://issues.apache.org/jira/browse/YARN-2766 Project: Hadoop YARN Issue Type