Re: Unable to submit Samza job into YARN RM
Hi, Raja, OK. Unfortunately, we are quite busy working on a release now. We may be able to get back to this patch sometime next month. In the meantime, applying the patch to test out the feature should not be too hard. You should give it a try. If you encounter any problems, we are more than happy to help answer your questions. Thanks! -Yi On Sun, Nov 8, 2015 at 10:52 PM, Raja.Aravapalli wrote: > Hi Yi, > > Thanks for your reply. > I am fine to do the testing, but i am not so familiar with how to apply > patch and test it. I am a newbie.!! > > > Regards, > Raja. > > > On 11/9/15, 12:05 PM, "Yi Pan" wrote: > > >Hi, Raja, > > > >Please watch SAMZA-727. There is a patch available already. Unfortunately, > >no one seems to have the time to test it and verifies it yet. If you want > >to pick up the patch and test/verify it, it would be great! > > > >Thanks! > > > >-Yi > > > >On Sun, Nov 8, 2015 at 12:24 AM, Raja.Aravapalli > > >> wrote: > > > >> Hi, > >> > >> I am getting below keberos exception, when i try to submit Samza job to > >> YARN RM in our Hadoop environment. > >> > >> FYI, our hadoop environment is on Hortonworks platform and it is > >> KERBERIZED!! > >> > >> > >> Exception in thread "main" > >> org.apache.hadoop.security.AccessControlException: SIMPLE > >>authentication is > >> not enabled. Available:[TOKEN, KERBEROS] > >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > >> at > >> > >>sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAc > >>cessorImpl.java:57) > >> at > >> > >>sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConst > >>ructorAccessorImpl.java:45) > >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > >> at > >>org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53) > >> at > >> > >>org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:1 > >>04) > >> at > >> > >>org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClie > >>ntImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:196) > >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> at > >> > >>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java > >>:57) > >> at > >> > >>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI > >>mpl.java:43) > >> at java.lang.reflect.Method.invoke(Method.java:606) > >> at > >> > >>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvoc > >>ationHandler.java:190) > >> at > >> > >>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationH > >>andler.java:103) > >> at com.sun.proxy.$Proxy12.getNewApplication(Unknown Source) > >> at > >> > >>org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(Y > >>arnClientImpl.java:165) > >> at > >> > >>org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(Y > >>arnClientImpl.java:173) > >> at > >> > >>org.apache.samza.job.yarn.ClientHelper.submitApplication(ClientHelper.sca > >>la:70) > >> at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:54) > >> at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:47) > >> at org.apache.samza.job.JobRunner.run(JobRunner.scala:62) > >> at org.apache.samza.job.JobRunner$.main(JobRunner.scala:37) > >> at org.apache.samza.job.JobRunner.main(JobRunner.scala) > >> Caused by: > >> > >>org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessCo > >>ntrolException): > >> SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS] > >> at org.apache.hadoop.ipc.Client.call(Client.java:1410) > >> at org.apache.hadoop.ipc.Client.call(Client.java:1363) > >> at > >> > >>org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine. > >>java:206) > >> at com.sun.proxy.$Proxy11.getNewApplication(Unknown Source) > >> at > >> > >>org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClie > >>ntImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:193) > >> ... 15 more > >> > >> > >> Request someone to please help me fix the issue i am facing. Thanks a > >>lot. > >> > >> > >> Regards, > >> Raja. > >> > >
Re: Unable to submit Samza job into YARN RM
Hi Yi, Thanks for your reply. I am fine to do the testing, but i am not so familiar with how to apply patch and test it. I am a newbie.!! Regards, Raja. On 11/9/15, 12:05 PM, "Yi Pan" wrote: >Hi, Raja, > >Please watch SAMZA-727. There is a patch available already. Unfortunately, >no one seems to have the time to test it and verifies it yet. If you want >to pick up the patch and test/verify it, it would be great! > >Thanks! > >-Yi > >On Sun, Nov 8, 2015 at 12:24 AM, Raja.Aravapalli >> wrote: > >> Hi, >> >> I am getting below keberos exception, when i try to submit Samza job to >> YARN RM in our Hadoop environment. >> >> FYI, our hadoop environment is on Hortonworks platform and it is >> KERBERIZED!! >> >> >> Exception in thread "main" >> org.apache.hadoop.security.AccessControlException: SIMPLE >>authentication is >> not enabled. Available:[TOKEN, KERBEROS] >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> >>sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAc >>cessorImpl.java:57) >> at >> >>sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConst >>ructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >>org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53) >> at >> >>org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:1 >>04) >> at >> >>org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClie >>ntImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:196) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> >>sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java >>:57) >> at >> >>sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI >>mpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> >>org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvoc >>ationHandler.java:190) >> at >> >>org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationH >>andler.java:103) >> at com.sun.proxy.$Proxy12.getNewApplication(Unknown Source) >> at >> >>org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(Y >>arnClientImpl.java:165) >> at >> >>org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(Y >>arnClientImpl.java:173) >> at >> >>org.apache.samza.job.yarn.ClientHelper.submitApplication(ClientHelper.sca >>la:70) >> at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:54) >> at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:47) >> at org.apache.samza.job.JobRunner.run(JobRunner.scala:62) >> at org.apache.samza.job.JobRunner$.main(JobRunner.scala:37) >> at org.apache.samza.job.JobRunner.main(JobRunner.scala) >> Caused by: >> >>org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessCo >>ntrolException): >> SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS] >> at org.apache.hadoop.ipc.Client.call(Client.java:1410) >> at org.apache.hadoop.ipc.Client.call(Client.java:1363) >> at >> >>org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine. >>java:206) >> at com.sun.proxy.$Proxy11.getNewApplication(Unknown Source) >> at >> >>org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClie >>ntImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:193) >> ... 15 more >> >> >> Request someone to please help me fix the issue i am facing. Thanks a >>lot. >> >> >> Regards, >> Raja. >>
Re: Unable to submit Samza job into YARN RM
Hi, Raja, Please watch SAMZA-727. There is a patch available already. Unfortunately, no one seems to have the time to test it and verifies it yet. If you want to pick up the patch and test/verify it, it would be great! Thanks! -Yi On Sun, Nov 8, 2015 at 12:24 AM, Raja.Aravapalli wrote: > Hi, > > I am getting below keberos exception, when i try to submit Samza job to > YARN RM in our Hadoop environment. > > FYI, our hadoop environment is on Hortonworks platform and it is > KERBERIZED!! > > > Exception in thread "main" > org.apache.hadoop.security.AccessControlException: SIMPLE authentication is > not enabled. Available:[TOKEN, KERBEROS] > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53) > at > org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:104) > at > org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:196) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:190) > at > org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103) > at com.sun.proxy.$Proxy12.getNewApplication(Unknown Source) > at > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:165) > at > org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:173) > at > org.apache.samza.job.yarn.ClientHelper.submitApplication(ClientHelper.scala:70) > at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:54) > at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:47) > at org.apache.samza.job.JobRunner.run(JobRunner.scala:62) > at org.apache.samza.job.JobRunner$.main(JobRunner.scala:37) > at org.apache.samza.job.JobRunner.main(JobRunner.scala) > Caused by: > org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): > SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS] > at org.apache.hadoop.ipc.Client.call(Client.java:1410) > at org.apache.hadoop.ipc.Client.call(Client.java:1363) > at > org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) > at com.sun.proxy.$Proxy11.getNewApplication(Unknown Source) > at > org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:193) > ... 15 more > > > Request someone to please help me fix the issue i am facing. Thanks a lot. > > > Regards, > Raja. >
Unable to submit Samza job into YARN RM
Hi, I am getting below keberos exception, when i try to submit Samza job to YARN RM in our Hadoop environment. FYI, our hadoop environment is on Hortonworks platform and it is KERBERIZED!! Exception in thread "main" org.apache.hadoop.security.AccessControlException: SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS] at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53) at org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:104) at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:196) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:190) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:103) at com.sun.proxy.$Proxy12.getNewApplication(Unknown Source) at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:165) at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:173) at org.apache.samza.job.yarn.ClientHelper.submitApplication(ClientHelper.scala:70) at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:54) at org.apache.samza.job.yarn.YarnJob.submit(YarnJob.scala:47) at org.apache.samza.job.JobRunner.run(JobRunner.scala:62) at org.apache.samza.job.JobRunner$.main(JobRunner.scala:37) at org.apache.samza.job.JobRunner.main(JobRunner.scala) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): SIMPLE authentication is not enabled. Available:[TOKEN, KERBEROS] at org.apache.hadoop.ipc.Client.call(Client.java:1410) at org.apache.hadoop.ipc.Client.call(Client.java:1363) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206) at com.sun.proxy.$Proxy11.getNewApplication(Unknown Source) at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:193) ... 15 more Request someone to please help me fix the issue i am facing. Thanks a lot. Regards, Raja.
