[
https://issues.apache.org/jira/browse/ATLAS-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruchi Solani updated ATLAS-2592:
--------------------------------
Attachment: ATLAS-2592.patch
> Storm atlas hook fails with NPE
> -------------------------------
>
> Key: ATLAS-2592
> URL: https://issues.apache.org/jira/browse/ATLAS-2592
> Project: Atlas
> Issue Type: Bug
> Reporter: Ruchi Solani
> Assignee: Ruchi Solani
> Priority: Blocker
> Attachments: ATLAS-2592.patch
>
>
> Here is the output of submission request:
> {code}
> 2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka
> consumer property 'auto.offset.reset' to 'earliest' to ensure at-least-once
> processing (KafkaSpoutConfig:761)
> 2018-04-13 07:34:04,222 INFO - [TestNGInvoker-testRetry():[]] ~ Setting Kafka
> consumer property 'enable.auto.commit' to 'false', because the spout does not
> support auto-commit (KafkaSpoutConfig:775)
> 2018-04-13 07:34:04,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION
> new 1.2.1.3.0.0.0-1189 old null (Utils:2286)
> 2018-04-13 07:34:04,252 INFO - [TestNGInvoker-testRetry():[]] ~ Generated
> ZooKeeper secret payload for MD5-digest:
> -7659255060620243743:-5999822419551893831 (StormSubmitter:87)
> 2018-04-13 07:34:04,266 INFO - [TestNGInvoker-testRetry():[]] ~ successfully
> logged in. (Login:300)
> 2018-04-13 07:34:04,278 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader
> nimbus : ctr-e138-1518143905142-226131-01-000003.hwx.site:6627
> (NimbusClient:96)
> 2018-04-13 07:34:04,288 INFO - [TestNGInvoker-testRetry():[]] ~ Got AutoCreds
> [] (AuthUtils:208)
> 2018-04-13 07:34:04,289 INFO - [TestNGInvoker-testRetry():[]] ~ successfully
> logged in. (Login:300)
> 2018-04-13 07:34:04,300 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader
> nimbus : ctr-e138-1518143905142-226131-01-000003.hwx.site:6627
> (NimbusClient:96)
> 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading
> dependencies - jars... (StormSubmitter:280)
> 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading
> dependencies - artifacts... (StormSubmitter:295)
> 2018-04-13 07:34:04,305 INFO - [TestNGInvoker-testRetry():[]] ~ Dependency
> Blob keys - jars : [] / artifacts : [] (StormSubmitter:310)
> 2018-04-13 07:34:04,306 INFO - [TestNGInvoker-testRetry():[]] ~ Uploading
> topology jar
> /hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar
> to assigned location:
> /hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar
> (StormSubmitter:475)
> Start uploading file
> '/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar'
> to
> '/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar'
> (295334349 bytes)
> [ ] 307200 / 295334349
> ...
> [==================================================] 295334349 / 295334349
> [==================================================] 295334349 / 295334349
> File
> '/hwqe/hadoopqe/tests/storm/java_tests/storm-qe/target/storm-integration-test-0.3.jar'
> uploaded to
> '/hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar'
> (295334349 bytes)
> 2018-04-13 07:34:07,245 INFO - [TestNGInvoker-testRetry():[]] ~ Successfully
> uploaded topology jar to assigned location:
> /hadoop/storm/nimbus/inbox/stormjar-696f60e0-bb90-4e44-8ccf-a5780251617b.jar
> (StormSubmitter:500)
> 2018-04-13 07:34:07,246 INFO - [TestNGInvoker-testRetry():[]] ~ Submitting
> topology SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE in distributed
> mode with conf
> \{"java.security.auth.login.config":"\/etc\/storm\/conf\/client_jaas.conf","storm.zookeeper.topology.auth.scheme":"digest","topology.workers":2,"storm.thrift.transport":"org.apache.storm.security.auth.kerberos.KerberosSaslTransportPlugin","topology.debug":true,"storm.zookeeper.topology.auth.payload":"-7659255060620243743:-5999822419551893831","topology.eventlogger.executors":1}
> (StormSubmitter:320)
> 2018-04-13 07:34:07,247 WARN - [TestNGInvoker-testRetry():[]] ~ STORM-VERSION
> new 1.2.1.3.0.0.0-1189 old 1.2.1.3.0.0.0-1189 (Utils:2286)
> 2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Finished
> submitting topology: SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE
> (StormSubmitter:328)
> 2018-04-13 07:34:13,277 INFO - [TestNGInvoker-testRetry():[]] ~ Initializing
> the registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
> (StormSubmitter:352)
> 2018-04-13 07:34:13,279 INFO - [TestNGInvoker-testRetry():[]] ~ successfully
> logged in. (Login:300)
> 2018-04-13 07:34:13,289 INFO - [TestNGInvoker-testRetry():[]] ~ Found leader
> nimbus : ctr-e138-1518143905142-226131-01-000003.hwx.site:6627
> (NimbusClient:96)
> 2018-04-13 07:34:13,390 INFO - [TestNGInvoker-testRetry():[]] ~ Invoking the
> registered ISubmitterHook [org.apache.atlas.storm.hook.StormAtlasHook]
> (StormSubmitter:360)
> 2018-04-13 07:34:13,390 INFO - [TestNGInvoker-testRetry():[]] ~ Collecting
> metadata for a new storm topology:
> SpoutRetryTest-nPartition1-guarantee-AT_LEAST_ONCE (StormAtlasHook:88)
> 2018-04-13 07:34:13,403 WARN - [TestNGInvoker-testRetry():[]] ~ Error
> occurred in invoking submitter
> hook:[org.apache.atlas.storm.hook.StormAtlasHook] (StormSubmitter:364)
> java.lang.RuntimeException: Atlas hook is unable to process the topology.
> at
> org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:113)
> ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
> at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:58)
> ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
> at
> org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:361)
> [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
> at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:275)
> [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
> at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:387)
> [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
> at
> org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:423)
> [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
> at
> org.apache.storm.StormSubmitter.submitTopologyWithProgressBar(StormSubmitter.java:404)
> [storm-core-1.2.1.3.0.0.0-1189.jar:1.2.1.3.0.0.0-1189]
> at com.hortonworks.storm.st.wrapper.TopoWrap.submit(TopoWrap.java:62)
> [test-classes/:?]
> at
> com.hortonworks.storm.st.wrapper.TopoWrap.submitSuccessfully(TopoWrap.java:112)
> [test-classes/:?]
> at
> com.hortonworks.storm.st.tests.kafka.SpoutRetryTest.testRetry(SpoutRetryTest.java:75)
> [test-classes/:?]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_161]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_161]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_161]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_161]
> at
> org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:84)
> [testng-6.8.5.jar:?]
> at
> org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:46)
> [testng-6.8.5.jar:?]
> at
> org.testng.internal.InvokeMethodRunnable.run(InvokeMethodRunnable.java:37)
> [testng-6.8.5.jar:?]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [?:1.8.0_161]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_161]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_161]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_161]
> at java.lang.Thread.run(Thread.java:748) [?:1.8.0_161]
> Caused by: java.lang.NullPointerException
> at
> org.apache.atlas.storm.hook.StormAtlasHook.getKafkaTopicQualifiedName(StormAtlasHook.java:386)
> ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
> at
> org.apache.atlas.storm.hook.StormAtlasHook.addDataSet(StormAtlasHook.java:207)
> ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
> at
> org.apache.atlas.storm.hook.StormAtlasHook.addTopologyInputs(StormAtlasHook.java:149)
> ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
> at
> org.apache.atlas.storm.hook.StormAtlasHook.addTopologyDataSets(StormAtlasHook.java:137)
> ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
> at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:95)
> ~[storm-bridge-shim-1.0.0.3.0.0.0-1189.jar:1.0.0.3.0.0.0-1189]
> ... 21 more
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
