Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below issue happens when the job user does not have access to the hadoop-yarn-server-nodemanager-.jar present on hadoop classpath of NodeManager machine. Could not find or load main class org.apache.hadoop.yarn.server. nodemanager.containermanager.loca lizer.ContainerLocalizer Make sure the job user has access to hadoop-yarn-server-nodemanager-.jar. On Tue, Aug 20, 2019 at 3:40 PM alex noure wrote: > Hi all, > > When we configure kerberos to submit tasks, only the primary account can > be submitted successfully, and other accounts cannot be submitted. > > Report Could not find or load main class > org.apache.hadoop.yarn.server.nodemanager.containermanager.loca > lizer.ContainerLocalizer > > My question is the same as this > https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue. > > I saw that my cluster environment variables are fine. > > How can I solve this problem? > > >
Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
Hi Prabhu Thank you for your reply. I did the following: chmod 777 hadoop-yarn-server-nodemanager-.jar Restarted NodeManager, resourcemanager Still reporting an error Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer Prabhu Josephraj 于2019年8月20日周二 下午6:18写道： > On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below > issue happens when the job user > does not have access to the hadoop-yarn-server-nodemanager-.jar > present on hadoop classpath of > NodeManager machine. > > Could not find or load main class org.apache.hadoop.yarn.server. > nodemanager.containermanager.loca lizer.ContainerLocalizer > > Make sure the job user has access to > hadoop-yarn-server-nodemanager-.jar. > > On Tue, Aug 20, 2019 at 3:40 PM alex noure wrote: > >> Hi all, >> >> When we configure kerberos to submit tasks, only the primary account can >> be submitted successfully, and other accounts cannot be submitted. >> >> Report Could not find or load main class >> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca >> lizer.ContainerLocalizer >> >> My question is the same as this >> https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue. >> >> I saw that my cluster environment variables are fine. >> >> How can I solve this problem? >> >> >> -- Best
RE: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
Could you try the following 1. Switch to job user , Check “ ls - l ” to check access to jar . Check parent dir permissions too From: alex noure [mailto:hello123...@gmail.com] Sent: 20 August 2019 16:50 To: Prabhu Josephraj Cc: user@hadoop.apache.org; mapreduce-iss...@hadoop.apache.org Subject: Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer Hi Prabhu Thank you for your reply. I did the following: chmod 777 hadoop-yarn-server-nodemanager-.jar Restarted NodeManager, resourcemanager Still reporting an error Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer Prabhu Josephraj mailto:pjos...@cloudera.com>> 于2019年8月20日周二 下午6:18写道： On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below issue happens when the job user does not have access to the hadoop-yarn-server-nodemanager-.jar present on hadoop classpath of NodeManager machine. Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer Make sure the job user has access to hadoop-yarn-server-nodemanager-.jar. On Tue, Aug 20, 2019 at 3:40 PM alex noure mailto:hello123...@gmail.com>> wrote: Hi all, When we configure kerberos to submit tasks, only the primary account can be submitted successfully, and other accounts cannot be submitted. Report Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer My question is the same as this https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue. I saw that my cluster environment variables are fine. How can I solve this problem? -- Best
Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
Hi Prabhu, Bibin Thank you very much for your advice. I have tested it without problems. Thanks Bibinchundatt 于2019年8月20日周二 下午8:56写道： > Could you try the following > > > > 1. Switch to job user , Check “ ls - l jar>” to check access to jar . Check parent dir permissions too > > > > > > *From:* alex noure [mailto:hello123...@gmail.com] > *Sent:* 20 August 2019 16:50 > *To:* Prabhu Josephraj > *Cc:* user@hadoop.apache.org; mapreduce-iss...@hadoop.apache.org > *Subject:* Re: Could not find or load main class > org.apache.hadoop.yarn.server.nodemanager.containermanager.loca > lizer.ContainerLocalizer > > > > Hi Prabhu > Thank you for your reply. > I did the following: > chmod 777 hadoop-yarn-server-nodemanager-.jar > > Restarted NodeManager, resourcemanager > > > > Still reporting an error > Could not find or load main class > org.apache.hadoop.yarn.server.nodemanager.containermanager.loca > lizer.ContainerLocalizer > > > > > > > > Prabhu Josephraj 于2019年8月20日周二 下午6:18写道： > > On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below > issue happens when the job user > > does not have access to the hadoop-yarn-server-nodemanager-.jar > present on hadoop classpath of > > NodeManager machine. > > > > Could not find or load main class > org.apache.hadoop.yarn.server.nodemanager.containermanager.loca > lizer.ContainerLocalizer > > > > Make sure the job user has access to > hadoop-yarn-server-nodemanager-.jar. > > > > On Tue, Aug 20, 2019 at 3:40 PM alex noure wrote: > > Hi all, > > > > When we configure kerberos to submit tasks, only the primary account can > be submitted successfully, and other accounts cannot be submitted. > > > > Report Could not find or load main class > org.apache.hadoop.yarn.server.nodemanager.containermanager.loca > lizer.ContainerLocalizer > > > > My question is the same as this > https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue. > > > > I saw that my cluster environment variables are fine. > > > > How can I solve this problem? > > > > > > > > > -- > > Best > -- Best
