I do not use Kerberos for Hadoop or oozie.. In short, both are not secured.
For this purpose, I have changed the property "oozie.services" in oozie-site.xml file from "org.apache.oozie.service. KerberosHadoopAccessorService" to "org.apache.oozie.service.HadoopAccessorService". But it's strange to see Kerberos message in the log: "Could not initialize class org.apache.hadoop.security.KerberosName" Thanks, On Wed, Oct 10, 2012 at 3:43 AM, Mohammad Islam <[email protected]> wrote: > Is your Hadoop secured? In other words, do you need "kinit" to access to > your hdfs files? > > > > ________________________________ > From: Nabeel Mohamed <[email protected]> > To: [email protected]; Mohammad Islam <[email protected]> > Sent: Wednesday, October 10, 2012 12:34 AM > Subject: Re: Unable to run oozie - Failure to login error.. > > Hi Mohammad, > > Thanks for your reply.. > > Am using oozie-3.0.2 and hadoop 0.20.203.0.. > > I tried again and oozie.log had the below exception. > > 2012-10-10 03:26:29,286 WARN V1JobsServlet:539 - USER[?] GROUP[users] > TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST > http://localhost:11000/oozie/v1/jobs?action=start] error[E0902], E0902: > Exception occured: [java.io.IOException: failure to login] > org.apache.oozie.servlet.XServletException: E0902: Exception occured: > [java.io.IOException: failure to login] > at > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:196) > at > org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:89) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637) > at > org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) > at > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > at > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > at > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > at > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > at > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) > at > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) > at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) > at > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) > at > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) > at java.lang.Thread.run(Thread.java:636) > Caused by: org.apache.oozie.service.AuthorizationException: E0902: > Exception occured: [java.io.IOException: failure to login] > at > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:320) > at > > org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:185) > ... 16 more > Caused by: org.apache.oozie.service.HadoopAccessorException: E0902: > Exception occured: [java.io.IOException: failure to login] > at > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:144) > at > > org.apache.oozie.service.AuthorizationService.authorizeForApp(AuthorizationService.java:285) > ... 17 more > Caused by: java.io.IOException: failure to login > at > > org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:433) > at > > org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395) > at > org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1418) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1319) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226) > at > > org.apache.oozie.service.HadoopAccessorService.createFileSystem(HadoopAccessorService.java:141) > ... 18 more > Caused by: javax.security.auth.login.LoginException: > java.lang.NoClassDefFoundError: Could not initialize class > org.apache.hadoop.security.KerberosName > at org.apache.hadoop.security.User.<init>(User.java:44) > at org.apache.hadoop.security.User.<init>(User.java:39) > at > > org.apache.hadoop.security.UserGroupInformation$HadoopLoginModule.commit(UserGroupInformation.java:111) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > javax.security.auth.login.LoginContext.invoke(LoginContext.java:784) > at > javax.security.auth.login.LoginContext.access$000(LoginContext.java:203) > > oozie-audit.log had the below message: > > 2012-10-10 03:26:29,287 INFO oozieaudit:536 - USER [?], GROUP [users], APP > [null], JOBID [null], OPERATION [start], PARAMETER [null], STATUS [FAILED], > HTTPCODE [401], ERRORCODE [E0902], ERRORMESSAGE [E0902: Exception occured: > [java.io.IOException: failure to login]] > > Thanks, > Nabeel > > On Wed, Oct 10, 2012 at 3:08 AM, Mohammad Islam <[email protected]> > wrote: > > > Hi Nabeel, > > Which Oozie version, are you using. > > Are you using secured Oozie or Hadoop? > > Also please check the oozie.log for more details. The same log directory > > has other files. Please check those files if there is any special log or > > exception. > > > > Regards, > > Mohammad > > > > > > > > ________________________________ > > From: Nabeel Mohamed <[email protected]> > > To: [email protected] > > Sent: Tuesday, October 9, 2012 11:16 PM > > Subject: Unable to run oozie - Failure to login error.. > > > > Hi, > > > > I am getting the below error, when I try to run oozie sample. > > > > $ bin/oozie job -oozie http://localhost:11000/oozie -config > > examples/apps/map-reduce/job.properties -run > > Error: E0902 : E0902: Exception occured: [java.io.IOException: failure to > > login] > > > > I have configured both Hadoop and Oozie using Unix user "oozie". > > > > I have changed the property "oozie.services" in oozie-site.xml file from > > "org.apache.oozie.service.KerberosHadoopAccessorService" > > to "org.apache.oozie.service.HadoopAccessorService". > > > > I have also specified the below in core-site.xml file.. > > > > <!-- OOZIE --> > > <property> > > <name>hadoop.proxyuser.oozie.hosts</name> > > <value>*</value> > > </property> > > <property> > > <name>hadoop.proxyuser.oozie.groups</name> > > <value>*</value> > > </property> > > > > Please let me know if I am missing something.. > > > > Thanks, > > Nabeel > > >
