Now I am running into other issue. For a simple Map Reduce task I get the
following error:
Failing Oozie Launcher, Main class
[org.apache.oozie.action.hadoop.MapReduceMain], main() threw
exception, Exception reading
file:/"/hdfs/mapred/local/taskTracker/hadoop/jobcache/job_201207190945_0007/jobToken"
java.io.IOException: Exception reading
file:/"/hdfs/mapred/local/taskTracker/hadoop/jobcache/job_201207190945_0007/jobToken"
at
org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:136)
at
org.apache.hadoop.mapred.JobClient.readTokensFromFiles(JobClient.java:2042)
at
org.apache.hadoop.mapred.JobClient.populateTokenCache(JobClient.java:2078)
at org.apache.hadoop.mapred.JobClient.access$200(JobClient.java:174)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:863)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1124)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
at
org.apache.oozie.action.hadoop.MapReduceMain.submitJob(MapReduceMain.java:91)
at
org.apache.oozie.action.hadoop.MapReduceMain.run(MapReduceMain.java:57)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:37)
at
org.apache.oozie.action.hadoop.MapReduceMain.main(MapReduceMain.java:40)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:467)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1124)
at org.apache.hadoop.mapred.Child.main(Child.java:265)
Caused by: java.io.FileNotFoundException: File
file:/"/hdfs/mapred/local/taskTracker/hadoop/jobcache/job_201207190945_0007/jobToken"
does not exist.
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:424)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:125)
at
org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:427)
at
org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:130)
... 27 more
It seems like the impersonated user doesn't have the credentials to access
this file...
Any Suggestions?
Boris.
On Thu, Jul 19, 2012 at 8:13 PM, Harsh J <[email protected]> wrote:
> Sorry for not cross-posting onto this list too (didn't notice it was
> cross-posted). I had answered Boris here:
>
> http://mail-archives.apache.org/mod_mbox/incubator-oozie-dev/201207.mbox/%3cca+4sw8ipvz2v-3ss8b0u6puv7opat6jiknqu_uo9z2roycw...@mail.gmail.com%3e
> over the dev lists.
>
> On Thu, Jul 19, 2012 at 10:37 PM, Matt Goeke <[email protected]>
> wrote:
> > Boris,
> >
> > As Harish mentioned, your proxyuser properties
> > (hadoop.proxyuser.<user>.groups and hadoop.proxyuser.<user>.hosts) must
> be
> > in the core-site.xml on the node(s) that your jobtracker and namenode are
> > located.
> >
> > --
> > Matt Goeke
> >
> > On Thu, Jul 19, 2012 at 9:36 AM, Harish Krishnan <
> > [email protected]> wrote:
> >
> >> Hi Boris,
> >>
> >> Try this in your core-site.xml
> >>
> >> <property>
> >> <name>hadoop.proxyuser.hadoop.hosts</name>
> >> <value>*</value>
> >> <description>The superuser can connect only from
> >> localhost to impersonate a user</description>
> >> </property>
> >>
> >>
> >>
> >> Thanks & Regards,
> >> Harish.T.K
> >>
> >>
> >> On Thu, Jul 19, 2012 at 12:01 AM, Boris Shulman <[email protected]>
> >> wrote:
> >>
> >> > I am trying to run Oozie 3.2.0 on Hadoop 1.1.0 build.
> >> >
> >> > *I put the following configuration in the core-site.xml (in both hadpp
> >> and
> >> > oozie conf):*
> >> >
> >> > <property>
> >> > <name>hadoop.proxyuser.hadoop.groups</name>
> >> > <value>supergroup</value>
> >> > <description>Allow the superuser hadoop to impersonate
> any
> >> > members of any group</description>
> >> > </property>
> >> > <property>
> >> > <name>hadoop.proxyuser.hadoop.hosts</name>
> >> > <value>127.0.0.1</value>
> >> > <description>The superuser can connect only from
> >> > localhost to impersonate a user</description>
> >> > </property>
> >> >
> >> >
> >> >
> >> > *Also I added the following in the oozie-site.xml *
> >> >
> >> > <property>
> >> >
> >> <name>oozie.service.ProxyUserService.proxyuser.hadoop.hosts</name>
> >> > <value>*</value>
> >> > <description>
> >> >
> >> > </description>
> >> > </property>
> >> >
> >> > <property>
> >> >
> >> <name>oozie.service.ProxyUserService.proxyuser.hadoop.groups</name>
> >> > <value>*</value>
> >> > <description>
> >> >
> >> > </description>
> >> >
> >> > When I try to submit oozie job I get the following error:
> >> >
> >> > *In the oozie log:*
> >> >
> >> > ... 26 more
> >> > 2012-07-19 09:45:32,861 WARN V1JobsServlet:542 - USER[hadoop]
> GROUP[-]
> >> > TOKEN[-] APP[-] JOB[-] ACTION[-] URL[POST
> >> > http://localhost:11000/oozie/v1/jobs?action=start] error[E0902],
> E0902:
> >> > Exception occured: [org.apache.hadoop.ipc.RemoteException: User:
> hadoop
> >> is
> >> > not allowed to impersonate hadoop]
> >> > org.apache.oozie.servlet.XServletException: E0902: Exception occured:
> >> > [org.apache.hadoop.ipc.RemoteException: User: hadoop is not allowed to
> >> > impersonate hadoop]
> >> > at
> >> >
> >> >
> >>
> org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:199)
> >> > at
> >> org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:92)
> >> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
> >> >
> >> >
> >> >
> >> > *in the NN log:*
> >> >
> >> > 2012-07-19 09:59:10,840 INFO org.apache.hadoop.ipc.Server: IPC Server
> >> > listener on 9000: readAndProcess threw exception
> >> > org.apache.hadoop.security.AccessControlException: Connection from
> >> > 127.0.0.1:56413 for protocol
> >> > org.apache.hadoop.hdfs.protocol.ClientProtocol
> >> > is unauthorized for user hadoop via hadoop. Count of bytes read: 0
> >> >
> >> > org.apache.hadoop.security.AccessControlException: Connection from
> >> > 127.0.0.1:56413 for protocol
> >> > org.apache.hadoop.hdfs.protocol.ClientProtocol
> >> > is unauthorized for user hadoop via hadoop
> >> >
> >> > at
> >> org.apache.hadoop.ipc.Server$Connection.processOneRpc(Server.java:1292)
> >> >
> >> > at
> >> org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1187)
> >> >
> >> > at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:538)
> >> >
> >> > at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:345)
> >> >
> >> > at
> >> >
> >> >
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> >> >
> >> > at
> >> >
> >> >
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> >> >
> >> > at java.lang.Thread.run(Thread.java:662)
> >> >
> >> >
> >> > What do I miss here?
> >> >
> >> > Regards,\
> >> > Boris.
> >> >
> >>
>
>
>
> --
> Harsh J
>
