[ https://issues.apache.org/jira/browse/AMBARI-19790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Greg Senia resolved AMBARI-19790. --------------------------------- Resolution: Won't Fix > HiveCLI and AtlasHook do not work correctly > ------------------------------------------- > > Key: AMBARI-19790 > URL: https://issues.apache.org/jira/browse/AMBARI-19790 > Project: Ambari > Issue Type: Bug > Environment: HDP 2.5.3.x > Reporter: Greg Senia > > After upgrading to HDP 2.5.3.x we are no longer able to correctly use the > HiveCLI with Atlas Hive Hook. Some assumptions specifically that the only > access method is HiveServer2. > We need the ability to split option in Ambari so HiveCLI AtlasHook uses the > following options: > atlas.jaas.KafkaClient.loginModuleControlFlag=required > atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule > atlas.jaas.KafkaClient.option.serviceName=kafka > atlas.jaas.KafkaClient.option.renewTicket=True > atlas.jaas.KafkaClient.option.useTicketCache=True > and HiveServer2 using: > atlas.jaas.KafkaClient.loginModuleControlFlag=required > atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule > atlas.jaas.KafkaClient.option.keyTab=/etc/security/keytabs/hive.service.keytab > atlas.jaas.KafkaClient.option.principal=hive/_h...@tech.hdp.example.com > atlas.jaas.KafkaClient.option.serviceName=kafka > atlas.jaas.KafkaClient.option.storeKey=True > atlas.jaas.KafkaClient.option.useKeyTab=True > If this is not done HiveCLI will fail to post to Kafka: > ve/warehouse/nyse_stocks_test"}}}}}, endTime=Mon Jan 30 11:42:38 EST 2017}}]] > after 3 retries. Quitting > org.apache.kafka.common.KafkaException: Failed to construct kafka producer > at > org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:335) > at > org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:188) > at > org.apache.atlas.kafka.KafkaNotification.createProducer(KafkaNotification.java:311) > at > org.apache.atlas.kafka.KafkaNotification.sendInternal(KafkaNotification.java:220) > at > org.apache.atlas.notification.AbstractNotification.send(AbstractNotification.java:84) > at > org.apache.atlas.hook.AtlasHook.notifyEntitiesInternal(AtlasHook.java:129) > at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:114) > at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:167) > at > org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:282) > at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82) > at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:193) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: org.apache.kafka.common.KafkaException: > javax.security.auth.login.LoginException: Could not login: the client is > being asked for a password, but the Kafka client code does not currently > support obtaining a password from the user. not available to garner > authentication information from the user > at > org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:86) > at > org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:71) > at > org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:83) > at > org.apache.kafka.clients.producer.KafkaProducer.<init>(KafkaProducer.java:277) > After adjusting atlas-application.properties: > -b558-4b02d509d888 > 2017-01-30 23:13:41,053 INFO [main]: log.PerfLogger > (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG > method=PostHook.org.apache.atlas.hive.hook.HiveHook > from=org.apache.hadoop.hive.ql.Driver> > 2017-01-30 23:13:41,062 INFO [main]: log.PerfLogger > (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG > method=PostHook.org.apache.atlas.hive.hook.HiveHook start=1485836021053 > end=1485836021062 duration=9 from=org.apache.hadoop.hive.ql.Driver> > 2017-01-30 23:13:41,062 INFO [Atlas Logger 1]: hook.HiveHook > (HiveHook.java:fireAndForget(209)) - Entered Atlas hook for hook type > POST_EXEC_HOOK operation CREATETABLE_AS_SELECT > 2017-01-30 23:13:41,062 INFO [main]: ql.Driver (Driver.java:execute(1635)) - > Resetting the caller context to -- This message was sent by Atlassian JIRA (v6.3.15#6346)