Cool! -Flavio
> On 19 Oct 2015, at 12:56, sagar shukla <[email protected]> wrote: > > Hi Flavio, > Setting up that parameter while executing MapReduce job helped get it working > without any issues. Thanks for your prompt responses :) > > Regards,Sagar > > > > On Monday, October 19, 2015 2:59 PM, Flavio Junqueira <[email protected]> > wrote: > > > All I'm saying is that if the zk client finds the system property set, it > will think that you want to authenticate. You could also try setting > zookeeper.sasl.client to false. > -Flavio > > On 19 Oct 2015, at 10:16, sagar shukla <[email protected]> wrote: > Thanks for the prompt response. Since i am running MapReduce on hadoop node, > i feel i should use default jaas file, else my MapReduce auth might break ... > right? > Exception indicates issue at zookeeper side. > I tried with non-secure hadoop cluster which works as expected. > Regards,Sagar > > Sent from Yahoo Mail on Android > > On Mon, 19 Oct, 2015 at 2:33 pm, Flavio Junqueira<[email protected]> wrote: Do > you have the jaas config property set which is causing your client to believe > you want to authenticate? You may also want to ask that same question on the > Kafka list. > > -Flavio > >> On 19 Oct 2015, at 09:56, sagar shukla <[email protected]> wrote: >> >> Hi All, >> I have a zookeeper cluster configured with Kafka without any SASL security >> configuration. Also I have a hadoop cluster configured with security which >> uses a different zookeeper cluster. So overall, I have two zookeeper >> clusters - one with security and one without security. >> >> Now when I try to run a mapreduce program to fetch data from Kafka using >> non-secure zookeeper, I get following error message of SASL though my read >> zookeeper cluster does not have security configured. >> : org.I0Itec.zkclient.exception.ZkException: >> org.apache.zookeeper.KeeperException$AuthFailedException: KeeperErrorCode = >> AuthFailed for /consumers/myGroup/ids/myGroup_server-1445242267846-420b8826 >> at >> org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:68) >> at >> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685) >> at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304) >> at org.I0Itec.zkclient.ZkClient.createEphemeral(ZkClient.java:328) >> at kafka.utils.ZkUtils$.createEphemeralPath(ZkUtils.scala:222) >> at >> kafka.utils.ZkUtils$.createEphemeralPathExpectConflict(ZkUtils.scala:237) >> at >> kafka.utils.ZkUtils$.createEphemeralPathExpectConflictHandleZKBug(ZkUtils.scala:275) >> at >> kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$registerConsumerInZK(ZookeeperConsumerConnector.scala:254) >> at >> kafka.consumer.ZookeeperConsumerConnector.consume(ZookeeperConsumerConnector.scala:239) >> at >> kafka.consumer.ZookeeperConsumerConnector.createMessageStreams(ZookeeperConsumerConnector.scala:153) >> at >> org.apache.spark.streaming.kafka.KafkaReceiver.onStart(KafkaInputDStream.scala:111) >> at >> org.apache.spark.streaming.receiver.ReceiverSupervisor.startReceiver(ReceiverSupervisor.scala:125) >> at >> org.apache.spark.streaming.receiver.ReceiverSupervisor.start(ReceiverSupervisor.scala:109) >> at >> org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverLauncher$$anonfun$8.apply(ReceiverTracker.scala:308) >> at >> org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverLauncher$$anonfun$8.apply(ReceiverTracker.scala:300) >> at >> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767) >> at >> org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1767) >> at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:63) >> at org.apache.spark.scheduler.Task.run(Task.scala:70) >> at >> org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> at java.lang.Thread.run(Thread.java:745) >> Caused by: org.apache.zookeeper.KeeperException$AuthFailedException: >> KeeperErrorCode = AuthFailed for >> /consumers/myGroup/ids/myGroup_server-1445242267846-420b8826 >> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:123) >> at >> org.apache.zookeeper.KeeperException.create(KeeperException.java:51) >> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783) >> at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87) >> at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308) >> at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304) >> at >> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675) >> ... 21 more >> >> I did try setting up parameter -Djava.security.auth.login.config=none while >> trying to run the mapreduce program. >> >> Any thoughts on how I can get rid of this security warning? >> Regards,Sagar >> > > > > >
