[ https://issues.apache.org/jira/browse/METRON-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16492746#comment-16492746 ]
ASF GitHub Bot commented on METRON-1581: ---------------------------------------- Github user ottobackwards commented on the issue: https://github.com/apache/metron/pull/1035 Do we know why it is not shutting down? What if this results in data loss? I think we need a better understanding of what is happening. > restarting profiler topology fails as the kill topology takes longer time > ------------------------------------------------------------------------- > > Key: METRON-1581 > URL: https://issues.apache.org/jira/browse/METRON-1581 > Project: Metron > Issue Type: Bug > Reporter: Mohan > Assignee: Mohan > Priority: Minor > > storm kill 'topology' command will leave the profiler topology in 'KILLED' > state for longer time some times more than 10 mins .. below is the stdout or > restart profiler command. > {code:java} > 2018-05-28 10:45:38,622 - Stack Feature Version Info: Cluster Stack=2.6, > Command Stack=None, Command Version=2.6.5.0-292 -> 2.6.5.0-292 > 2018-05-28 10:45:38,640 - Using hadoop conf dir: > /usr/hdp/2.6.5.0-292/hadoop/conf > 2018-05-28 10:45:39,324 - Stack Feature Version Info: Cluster Stack=2.6, > Command Stack=None, Command Version=2.6.5.0-292 -> 2.6.5.0-292 > 2018-05-28 10:45:39,335 - Using hadoop conf dir: > /usr/hdp/2.6.5.0-292/hadoop/conf > 2018-05-28 10:45:39,338 - Group['metron'] {} > 2018-05-28 10:45:39,340 - Group['livy'] {} > 2018-05-28 10:45:39,341 - Group['spark'] {} > 2018-05-28 10:45:39,341 - Group['solr'] {} > 2018-05-28 10:45:39,341 - Group['hdfs'] {} > 2018-05-28 10:45:39,342 - Group['zeppelin'] {} > 2018-05-28 10:45:39,342 - Group['hadoop'] {} > 2018-05-28 10:45:39,342 - Group['users'] {} > 2018-05-28 10:45:39,344 - User['hive'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,346 - User['storm'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,348 - User['zookeeper'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,349 - User['ams'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,351 - User['tez'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} > 2018-05-28 10:45:39,353 - User['zeppelin'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop'], 'uid': > None} > 2018-05-28 10:45:39,356 - User['metron'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,357 - User['livy'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,359 - User['spark'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,361 - User['ambari-qa'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} > 2018-05-28 10:45:39,363 - User['solr'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,365 - User['kafka'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,367 - User['hdfs'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None} > 2018-05-28 10:45:39,369 - User['yarn'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,371 - User['mapred'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,373 - User['hbase'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,375 - User['hcat'] {'gid': 'hadoop', > 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} > 2018-05-28 10:45:39,376 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] > {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} > 2018-05-28 10:45:39,380 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh > ambari-qa > /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa > 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} > 2018-05-28 10:45:39,390 - Skipping > Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa > /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa > 0'] due to not_if > 2018-05-28 10:45:39,391 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', > 'create_parents': True, 'mode': 0775, 'cd_access': 'a'} > 2018-05-28 10:45:39,393 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] > {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} > 2018-05-28 10:45:39,396 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] > {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} > 2018-05-28 10:45:39,398 - call['/var/lib/ambari-agent/tmp/changeUid.sh > hbase'] {} > 2018-05-28 10:45:39,408 - call returned (0, '1814') > 2018-05-28 10:45:39,409 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh > hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase > 1814'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'} > 2018-05-28 10:45:39,416 - Skipping > Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase > /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 1814'] > due to not_if > 2018-05-28 10:45:39,416 - Group['hdfs'] {} > 2018-05-28 10:45:39,417 - User['hdfs'] {'fetch_nonlocal_groups': True, > 'groups': ['hdfs', u'hdfs']} > 2018-05-28 10:45:39,418 - FS Type: > 2018-05-28 10:45:39,418 - Directory['/etc/hadoop'] {'mode': 0755} > 2018-05-28 10:45:39,436 - > File['/usr/hdp/2.6.5.0-292/hadoop/conf/hadoop-env.sh'] {'content': > InlineTemplate(...), 'owner': 'root', 'group': 'hadoop'} > 2018-05-28 10:45:39,437 - > Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': > 'hdfs', 'group': 'hadoop', 'mode': 01777} > 2018-05-28 10:45:39,463 - Execute[('setenforce', '0')] {'not_if': '(! which > getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': > True, 'only_if': 'test -f /selinux/enforce'} > 2018-05-28 10:45:39,473 - Skipping Execute[('setenforce', '0')] due to not_if > 2018-05-28 10:45:39,473 - Directory['/grid/0/log/hdfs'] {'owner': 'root', > 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'} > 2018-05-28 10:45:39,477 - Directory['/var/run/hadoop'] {'owner': 'root', > 'create_parents': True, 'group': 'root', 'cd_access': 'a'} > 2018-05-28 10:45:39,478 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', > 'create_parents': True, 'cd_access': 'a'} > 2018-05-28 10:45:39,483 - > File['/usr/hdp/2.6.5.0-292/hadoop/conf/commons-logging.properties'] > {'content': Template('commons-logging.properties.j2'), 'owner': 'root'} > 2018-05-28 10:45:39,486 - > File['/usr/hdp/2.6.5.0-292/hadoop/conf/health_check'] {'content': > Template('health_check.j2'), 'owner': 'root'} > 2018-05-28 10:45:39,494 - > File['/usr/hdp/2.6.5.0-292/hadoop/conf/log4j.properties'] {'content': > InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644} > 2018-05-28 10:45:39,506 - > File['/usr/hdp/2.6.5.0-292/hadoop/conf/hadoop-metrics2.properties'] > {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} > 2018-05-28 10:45:39,508 - > File['/usr/hdp/2.6.5.0-292/hadoop/conf/task-log4j.properties'] {'content': > StaticFile('task-log4j.properties'), 'mode': 0755} > 2018-05-28 10:45:39,510 - > File['/usr/hdp/2.6.5.0-292/hadoop/conf/configuration.xsl'] {'owner': 'hdfs', > 'group': 'hadoop'} > 2018-05-28 10:45:39,519 - File['/etc/hadoop/conf/topology_mappings.data'] > {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), > 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop', 'mode': 0644} > 2018-05-28 10:45:39,526 - File['/etc/hadoop/conf/topology_script.py'] > {'content': StaticFile('topology_script.py'), 'only_if': 'test -d > /etc/hadoop/conf', 'mode': 0755} > 2018-05-28 10:45:39,541 - Skipping stack-select on METRON because it does not > exist in the stack-select package structure. > 2018-05-28 10:45:39,577 - Skipping stack-select on METRON because it does not > exist in the stack-select package structure. > 2018-05-28 10:45:40,178 - Using hadoop conf dir: > /usr/hdp/2.6.5.0-292/hadoop/conf > 2018-05-28 10:45:40,181 - Running profiler configure > 2018-05-28 10:45:40,191 - > File['/usr/hcp/1.5.0.0-8/metron/config/profiler.properties'] {'owner': > 'metron', 'content': Template('profiler.properties.j2'), 'group': 'metron'} > 2018-05-28 10:45:40,193 - Patch global config in Zookeeper > 2018-05-28 10:45:40,193 - Setup temporary global config JSON patch > (formatting per RFC6902): /tmp/metron-global-config-patch.json > 2018-05-28 10:45:40,196 - File['/tmp/metron-global-config-patch.json'] > {'owner': 'metron', 'content': InlineTemplate(...), 'group': 'metron'} > 2018-05-28 10:45:40,197 - Patching global config in ZooKeeper > 2018-05-28 10:45:40,198 - > Execute['/usr/hcp/1.5.0.0-8/metron/bin/zk_load_configs.sh --zk_quorum > ctr-e138-1518143905142-333856-01-000004.hwx.site:2181,ctr-e138-1518143905142-333856-01-000002.hwx.site:2181,ctr-e138-1518143905142-333856-01-000003.hwx.site:2181 > --mode PATCH --config_type GLOBAL --patch_file > /tmp/metron-global-config-patch.json'] {'path': > [u'/usr/lib/jvm/java-openjdk/bin']} > 2018-05-28 10:45:42,125 - Done patching global config > 2018-05-28 10:45:42,125 - Pull zookeeper config locally > 2018-05-28 10:45:42,125 - Pulling all Metron configs down from ZooKeeper to > local file system > 2018-05-28 10:45:42,126 - NOTE - THIS IS OVERWRITING THE LOCAL METRON CONFIG > DIR WITH ZOOKEEPER CONTENTS: /usr/hcp/1.5.0.0-8/metron/config/zookeeper > 2018-05-28 10:45:42,126 - > Execute['/usr/hcp/1.5.0.0-8/metron/bin/zk_load_configs.sh --zk_quorum > ctr-e138-1518143905142-333856-01-000004.hwx.site:2181,ctr-e138-1518143905142-333856-01-000002.hwx.site:2181,ctr-e138-1518143905142-333856-01-000003.hwx.site:2181 > --mode PULL --output_dir /usr/hcp/1.5.0.0-8/metron/config/zookeeper > --force'] {'path': [u'/usr/lib/jvm/java-openjdk/bin']} > 2018-05-28 10:45:44,702 - Calling security setup > 2018-05-28 10:45:44,704 - Directory['/usr/hcp/1.5.0.0-8/metron'] {'owner': > 'metron', 'group': 'metron', 'create_parents': True, 'mode': 0755} > 2018-05-28 10:45:44,705 - Directory['/home/metron/.storm'] {'owner': > 'metron', 'group': 'metron', 'mode': 0755} > 2018-05-28 10:45:44,711 - File['/usr/hcp/1.5.0.0-8/metron/client_jaas.conf'] > {'owner': 'metron', 'content': Template('client_jaas.conf.j2'), 'group': > 'metron', 'mode': 0755} > 2018-05-28 10:45:44,714 - File['/home/metron/.storm/storm.yaml'] {'owner': > 'metron', 'content': Template('storm.yaml.j2'), 'group': 'metron', 'mode': > 0755} > 2018-05-28 10:45:44,718 - File['/home/metron/.storm/storm.config'] {'owner': > 'metron', 'content': Template('storm.config.j2'), 'group': 'metron', 'mode': > 0755} > 2018-05-28 10:45:44,719 - Restarting the profiler topologies > 2018-05-28 10:45:44,719 - Stopping profiler > 2018-05-28 10:45:44,721 - Getting Running Storm Topologies from Storm REST > Server > 2018-05-28 10:45:44,722 - Security enabled? True > 2018-05-28 10:45:44,722 - kinit command: /usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; as user: > metron > 2018-05-28 10:45:44,722 - Execute['/usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; '] {'user': > 'metron'} > 2018-05-28 10:45:44,803 - Running cmd: curl --max-time 3 --negotiate -u : > http://ctr-e138-1518143905142-333856-01-000014.hwx.site:8744/api/v1/topology/summary > 2018-05-28 10:45:44,805 - call['ambari-sudo.sh su metron -l -s /bin/bash -c > 'curl --max-time 3 --negotiate -u : > http://ctr-e138-1518143905142-333856-01-000014.hwx.site:8744/api/v1/topology/summary > 1>/tmp/tmpz8ctlJ 2>/tmp/tmpYx0SsX''] {'quiet': False} > 2018-05-28 10:45:44,959 - call returned (0, '') > 2018-05-28 10:45:44,960 - Topologies: {u'batch_indexing': u'ACTIVE', > u'random_access_indexing': u'ACTIVE', u'bro': u'ACTIVE', u'profiler': > u'ACTIVE', u'snort': u'ACTIVE', u'yaf': u'ACTIVE', u'enrichment': u'ACTIVE'} > 2018-05-28 10:45:44,960 - kinit command: /usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; as user: > metron > 2018-05-28 10:45:44,960 - Execute['/usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; '] {'user': > 'metron'} > 2018-05-28 10:45:45,040 - Execute['storm kill profiler'] {'logoutput': True, > 'tries': 3, 'user': 'metron', 'try_sleep': 5} > Running: /usr/lib/jvm/java-openjdk/bin/java -Ddaemon.name= -Dstorm.options= > -Dstorm.home=/grid/0/hdp/2.6.5.0-292/storm -Dstorm.log.dir=/grid/0/log/storm > -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= > -cp > /grid/0/hdp/2.6.5.0-292/storm/lib/reflectasm-1.10.1.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/storm-core-1.1.0.2.6.5.0-292.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/ring-cors-0.1.5.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/objenesis-2.1.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/clojure-1.7.0.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-api-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/servlet-api-2.5.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/slf4j-api-1.7.21.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/zookeeper.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/minlog-1.3.0.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/kryo-3.0.3.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-slf4j-impl-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/disruptor-3.3.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-core-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/storm-rename-hack-1.1.0.2.6.5.0-292.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/asm-5.0.3.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/ambari-metrics-storm-sink.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-over-slf4j-1.6.6.jar:/grid/0/hdp/2.6.5.0-292/storm/extlib-daemon/ranger-plugin-classloader-0.7.0.2.6.5.0-292.jar:/grid/0/hdp/2.6.5.0-292/storm/extlib-daemon/ranger-storm-plugin-shim-0.7.0.2.6.5.0-292.jar:/grid/0/hdp/2.6.5.0-292/storm/extlib-daemon/ojdbc6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-core-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/joni-2.1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/libfb303-0.9.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-0.20S-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guice-servlet-3.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-web-proxy-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-math3-3.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-lang-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/gson-2.2.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-core-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/objenesis-2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-lang3-3.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-rdbms-4.1.7.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/activation-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xml-apis-1.3.04.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-serde-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-s3-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/zookeeper-3.4.6.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/fst-2.24.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/netty-3.9.0.Final.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/log4j-1.2.17.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/paranamer-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-json-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-pool-1.5.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/antlr-runtime-3.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-framework-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-core-4.1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jsp-api-2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-webhcat-java-client-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-net-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/mail-1.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/netty-all-4.0.52.Final.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-commons-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-compress-1.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-common-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jcodings-1.0.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-core-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-tree-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jcip-annotations-1.0-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-core-asl-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-configuration-1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/snappy-java-1.0.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javassist-3.18.1-GA.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/json-smart-1.3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-client-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/zookeeper-3.4.6.2.6.5.0-292-tests.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/libthrift-0.9.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jettison-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-service-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-common-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/oro-2.0.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stax-api-1.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-client-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/joda-time-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/leveldbjni-all-1.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-logging-1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ant-launcher-1.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/groovy-all-2.4.11.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javax.inject-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jsr305-3.0.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-digester-1.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/storm-autocreds-1.1.0.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-httpclient-3.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-common-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-kms-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/servlet-api-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guava-16.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ant-1.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/avro-1.7.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/derby-10.10.2.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-cli-1.3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-jvm-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jms-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-collections-3.2.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ivy-2.4.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-streaming-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jline-0.9.94.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/apache-log4j-extras-1.2.17.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stax-api-1.0-2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/slf4j-api-1.7.21.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stringtemplate-3.2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-core-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javax.jdo-3.2.0-m3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/azure-storage-5.4.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-cli-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-client-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/json-20090211.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-auth-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/httpclient-4.3.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-registry-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-client-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-shuffle-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/HikariCP-2.5.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/okio-1.6.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-0.23-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-databind-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/protobuf-java-2.5.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/bonecp-0.8.0.RELEASE.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/transaction-api-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/opencsv-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-annotations-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/httpcore-4.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-server-extensions-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/velocity-1.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jta-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-all-7.6.0.v20120127.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xmlenc-0.52.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-protocol-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ST4-4.0.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/azure-keyvault-core-0.8.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-api-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/okhttp-2.7.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-core-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-annotations-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xercesImpl-2.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-aws-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-app-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jdo-api-3.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xz-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-resourcemanager-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-dbcp-1.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aopalliance-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-ant-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-hdfs-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jaxb-api-2.2.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/antlr-2.7.7.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-metastore-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-jobclient-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guice-3.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-annotations-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jpam-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-scheduler-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-io-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-xc-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-codec-1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-recipes-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-exec-1.2.1000.2.6.5.0-292.jar:/home/metron/.storm:/grid/0/hdp/2.6.5.0-292/storm/bin > org.apache.storm.command.kill_topology profiler > 2729 [main] INFO o.a.s.m.n.Login - successfully logged in. > 2881 [main] INFO o.a.s.u.NimbusClient - Found leader nimbus : > ctr-e138-1518143905142-333856-01-000008.hwx.site:6627 > 2959 [main] INFO o.a.s.c.kill-topology - Killed topology: profiler > 2018-05-28 10:45:53,979 - Done stopping profiler topologies > 2018-05-28 10:45:53,982 - Getting Running Storm Topologies from Storm REST > Server > 2018-05-28 10:45:53,982 - Security enabled? True > 2018-05-28 10:45:53,982 - kinit command: /usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; as user: > metron > 2018-05-28 10:45:53,983 - Execute['/usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; '] {'user': > 'metron'} > 2018-05-28 10:45:54,067 - Running cmd: curl --max-time 3 --negotiate -u : > http://ctr-e138-1518143905142-333856-01-000014.hwx.site:8744/api/v1/topology/summary > 2018-05-28 10:45:54,068 - call['ambari-sudo.sh su metron -l -s /bin/bash -c > 'curl --max-time 3 --negotiate -u : > http://ctr-e138-1518143905142-333856-01-000014.hwx.site:8744/api/v1/topology/summary > 1>/tmp/tmpCss_23 2>/tmp/tmpIKkmW2''] {'quiet': False} > 2018-05-28 10:45:54,225 - call returned (0, '') > 2018-05-28 10:45:54,226 - Topologies: {u'batch_indexing': u'ACTIVE', > u'random_access_indexing': u'ACTIVE', u'bro': u'ACTIVE', u'profiler': > u'KILLED', u'snort': u'ACTIVE', u'yaf': u'ACTIVE', u'enrichment': u'ACTIVE'} > 2018-05-28 10:45:54,230 - Getting Running Storm Topologies from Storm REST > Server > 2018-05-28 10:45:54,230 - Security enabled? True > 2018-05-28 10:45:54,230 - kinit command: /usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; as user: > metron > 2018-05-28 10:45:54,231 - Execute['/usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; '] {'user': > 'metron'} > 2018-05-28 10:45:54,322 - Running cmd: curl --max-time 3 --negotiate -u : > http://ctr-e138-1518143905142-333856-01-000014.hwx.site:8744/api/v1/topology/summary > 2018-05-28 10:45:54,323 - call['ambari-sudo.sh su metron -l -s /bin/bash -c > 'curl --max-time 3 --negotiate -u : > http://ctr-e138-1518143905142-333856-01-000014.hwx.site:8744/api/v1/topology/summary > 1>/tmp/tmpmHVTXz 2>/tmp/tmp6xO6QX''] {'quiet': False} > 2018-05-28 10:45:54,475 - call returned (0, '') > 2018-05-28 10:45:54,476 - Topologies: {u'batch_indexing': u'ACTIVE', > u'random_access_indexing': u'ACTIVE', u'bro': u'ACTIVE', u'profiler': > u'KILLED', u'snort': u'ACTIVE', u'yaf': u'ACTIVE', u'enrichment': u'ACTIVE'} > 2018-05-28 10:45:54,476 - Waiting for storm kill to complete > 2018-05-28 10:46:24,506 - Starting profiler > 2018-05-28 10:46:24,508 - Getting Running Storm Topologies from Storm REST > Server > 2018-05-28 10:46:24,508 - Security enabled? True > 2018-05-28 10:46:24,508 - kinit command: /usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; as user: > metron > 2018-05-28 10:46:24,508 - Execute['/usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; '] {'user': > 'metron'} > 2018-05-28 10:46:24,597 - Running cmd: curl --max-time 3 --negotiate -u : > http://ctr-e138-1518143905142-333856-01-000014.hwx.site:8744/api/v1/topology/summary > 2018-05-28 10:46:24,598 - call['ambari-sudo.sh su metron -l -s /bin/bash -c > 'curl --max-time 3 --negotiate -u : > http://ctr-e138-1518143905142-333856-01-000014.hwx.site:8744/api/v1/topology/summary > 1>/tmp/tmpa545Eq 2>/tmp/tmpj1VYgQ''] {'quiet': False} > 2018-05-28 10:46:24,778 - call returned (0, '') > 2018-05-28 10:46:24,779 - Topologies: {u'batch_indexing': u'ACTIVE', > u'random_access_indexing': u'ACTIVE', u'bro': u'ACTIVE', u'profiler': > u'KILLED', u'snort': u'ACTIVE', u'yaf': u'ACTIVE', u'enrichment': u'ACTIVE'} > 2018-05-28 10:46:24,780 - kinit command: /usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; as user: > metron > 2018-05-28 10:46:24,780 - Execute['/usr/bin/kinit -kt > /etc/security/keytabs/metron.headless.keytab met...@example.com; '] {'user': > 'metron'} > 2018-05-28 10:46:24,873 - > Execute['/usr/hcp/1.5.0.0-8/metron/bin/start_profiler_topology.sh > -s profiler -z > ctr-e138-1518143905142-333856-01-000004.hwx.site:2181,ctr-e138-1518143905142-333856-01-000002.hwx.site:2181,ctr-e138-1518143905142-333856-01-000003.hwx.site:2181'] > {'logoutput': True, 'tries': 3, 'user': 'metron', 'try_sleep': 5} > Running: /usr/lib/jvm/java-openjdk/bin/java -server -Ddaemon.name= > -Dstorm.options= -Dstorm.home=/grid/0/hdp/2.6.5.0-292/storm > -Dstorm.log.dir=/grid/0/log/storm > -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= > -cp > /grid/0/hdp/2.6.5.0-292/storm/lib/reflectasm-1.10.1.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/storm-core-1.1.0.2.6.5.0-292.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/ring-cors-0.1.5.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/objenesis-2.1.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/clojure-1.7.0.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-api-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/servlet-api-2.5.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/slf4j-api-1.7.21.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/zookeeper.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/minlog-1.3.0.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/kryo-3.0.3.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-slf4j-impl-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/disruptor-3.3.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-core-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/storm-rename-hack-1.1.0.2.6.5.0-292.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/asm-5.0.3.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/ambari-metrics-storm-sink.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-core-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/joni-2.1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/libfb303-0.9.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-0.20S-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guice-servlet-3.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-web-proxy-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-math3-3.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-lang-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/gson-2.2.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-core-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/objenesis-2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-lang3-3.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-rdbms-4.1.7.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/activation-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xml-apis-1.3.04.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-serde-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-s3-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/zookeeper-3.4.6.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/fst-2.24.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/netty-3.9.0.Final.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/log4j-1.2.17.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/paranamer-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-json-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-pool-1.5.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/antlr-runtime-3.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-framework-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-core-4.1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jsp-api-2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-webhcat-java-client-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-net-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/mail-1.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/netty-all-4.0.52.Final.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-commons-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-compress-1.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-common-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jcodings-1.0.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-core-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-tree-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jcip-annotations-1.0-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-core-asl-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-configuration-1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/snappy-java-1.0.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javassist-3.18.1-GA.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/json-smart-1.3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-client-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/zookeeper-3.4.6.2.6.5.0-292-tests.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/libthrift-0.9.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jettison-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-service-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-common-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/oro-2.0.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stax-api-1.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-client-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/joda-time-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/leveldbjni-all-1.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-logging-1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ant-launcher-1.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/groovy-all-2.4.11.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javax.inject-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jsr305-3.0.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-digester-1.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/storm-autocreds-1.1.0.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-httpclient-3.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-common-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-kms-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/servlet-api-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guava-16.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ant-1.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/avro-1.7.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/derby-10.10.2.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-cli-1.3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-jvm-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jms-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-collections-3.2.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ivy-2.4.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-streaming-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jline-0.9.94.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/apache-log4j-extras-1.2.17.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stax-api-1.0-2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/slf4j-api-1.7.21.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stringtemplate-3.2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-core-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javax.jdo-3.2.0-m3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/azure-storage-5.4.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-cli-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-client-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/json-20090211.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-auth-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/httpclient-4.3.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-registry-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-client-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-shuffle-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/HikariCP-2.5.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/okio-1.6.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-0.23-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-databind-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/protobuf-java-2.5.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/bonecp-0.8.0.RELEASE.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/transaction-api-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/opencsv-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-annotations-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/httpcore-4.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-server-extensions-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/velocity-1.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jta-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-all-7.6.0.v20120127.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xmlenc-0.52.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-protocol-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ST4-4.0.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/azure-keyvault-core-0.8.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-api-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/okhttp-2.7.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-core-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-annotations-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xercesImpl-2.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-aws-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-app-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jdo-api-3.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xz-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-resourcemanager-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-dbcp-1.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aopalliance-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-ant-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-hdfs-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jaxb-api-2.2.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/antlr-2.7.7.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-metastore-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-jobclient-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guice-3.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-annotations-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jpam-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-scheduler-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-io-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-xc-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-codec-1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-recipes-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-exec-1.2.1000.2.6.5.0-292.jar > org.apache.storm.daemon.ClientJarTransformerRunner > org.apache.storm.hack.StormShadeTransformer > /usr/hcp/1.5.0.0-8/metron/lib/metron-profiler-0.4.3.1.5.0.0-8-uber.jar > /tmp/5fdb5190626411e886770242ac1b0c4d.jar > Running: /usr/lib/jvm/java-openjdk/bin/java -Ddaemon.name= -Dstorm.options= > -Dstorm.home=/grid/0/hdp/2.6.5.0-292/storm -Dstorm.log.dir=/grid/0/log/storm > -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= > -cp > /grid/0/hdp/2.6.5.0-292/storm/lib/reflectasm-1.10.1.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/storm-core-1.1.0.2.6.5.0-292.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/ring-cors-0.1.5.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/objenesis-2.1.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/clojure-1.7.0.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-api-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/servlet-api-2.5.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/slf4j-api-1.7.21.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/zookeeper.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/minlog-1.3.0.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/kryo-3.0.3.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-slf4j-impl-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/disruptor-3.3.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-core-2.8.2.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/storm-rename-hack-1.1.0.2.6.5.0-292.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/asm-5.0.3.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/ambari-metrics-storm-sink.jar:/grid/0/hdp/2.6.5.0-292/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-core-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/joni-2.1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/libfb303-0.9.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-0.20S-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guice-servlet-3.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-web-proxy-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-math3-3.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-lang-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-util-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/gson-2.2.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-core-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/objenesis-2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-lang3-3.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-rdbms-4.1.7.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/activation-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xml-apis-1.3.04.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-jaxrs-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-serde-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-s3-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/zookeeper-3.4.6.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/fst-2.24.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/netty-3.9.0.Final.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/log4j-1.2.17.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/paranamer-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-json-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-pool-1.5.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/antlr-runtime-3.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-framework-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-core-4.1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jsp-api-2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-webhcat-java-client-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-net-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/mail-1.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/netty-all-4.0.52.Final.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-commons-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-compress-1.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-common-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jcodings-1.0.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-core-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-tree-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/asm-3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jcip-annotations-1.0-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-core-asl-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-configuration-1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/snappy-java-1.0.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javassist-3.18.1-GA.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/json-smart-1.3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-client-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-applicationhistoryservice-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/zookeeper-3.4.6.2.6.5.0-292-tests.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/libthrift-0.9.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jettison-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-service-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-common-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/oro-2.0.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stax-api-1.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-client-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/joda-time-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/leveldbjni-all-1.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-logging-1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ant-launcher-1.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/groovy-all-2.4.11.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javax.inject-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jsr305-3.0.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-digester-1.8.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/storm-autocreds-1.1.0.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-httpclient-3.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-common-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-kms-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/servlet-api-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guava-16.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ant-1.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/avro-1.7.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/derby-10.10.2.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-cli-1.3.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-jvm-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jms-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-collections-3.2.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ivy-2.4.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-streaming-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jline-0.9.94.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/apache-log4j-extras-1.2.17.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stax-api-1.0-2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/slf4j-api-1.7.21.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/stringtemplate-3.2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aws-java-sdk-core-1.10.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/javax.jdo-3.2.0-m3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/azure-storage-5.4.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-cli-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-client-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/json-20090211.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-auth-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/httpclient-4.3.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-registry-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-client-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-shuffle-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/HikariCP-2.5.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/okio-1.6.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-0.23-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-databind-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/protobuf-java-2.5.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/bonecp-0.8.0.RELEASE.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/transaction-api-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/opencsv-2.3.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-annotations-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-common-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/httpcore-4.4.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-hcatalog-server-extensions-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/velocity-1.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jta-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-all-7.6.0.v20120127.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xmlenc-0.52.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-protocol-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/ST4-4.0.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/azure-keyvault-core-0.8.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-api-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/okhttp-2.7.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/metrics-core-3.1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-annotations-2.9.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xercesImpl-2.9.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-aws-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-app-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jdo-api-3.0.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/xz-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-yarn-server-resourcemanager-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/htrace-core-3.1.0-incubating.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-dbcp-1.4.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/aopalliance-1.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-ant-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-hdfs-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jaxb-api-2.2.2.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/antlr-2.7.7.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jetty-sslengine-6.1.26.hwx.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-metastore-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hadoop-mapreduce-client-jobclient-2.7.3.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/guice-3.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hbase-annotations-1.1.2.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jpam-1.1.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-shims-scheduler-1.2.1000.2.6.5.0-292.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-io-2.5.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/jackson-xc-1.9.13.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/commons-codec-1.6.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/curator-recipes-2.12.0.jar:/usr/hdp/current/storm-supervisor/external/storm-autocreds/hive-exec-1.2.1000.2.6.5.0-292.jar:/tmp/5fdb5190626411e886770242ac1b0c4d.jar:/home/metron/.storm:/grid/0/hdp/2.6.5.0-292/storm/bin > -Dstorm.jar=/tmp/5fdb5190626411e886770242ac1b0c4d.jar > -Dstorm.dependency.jars= -Dstorm.dependency.artifacts={} > org.apache.storm.flux.Flux --remote > /usr/hcp/1.5.0.0-8/metron/flux/profiler/remote.yaml --filter > /usr/hcp/1.5.0.0-8/metron/config/profiler.properties > ███████╗██╗ ██╗ ██╗██╗ ██╗ > ██╔════╝██║ ██║ ██║╚██╗██╔╝ > █████╗ ██║ ██║ ██║ ╚███╔╝ > ██╔══╝ ██║ ██║ ██║ ██╔██╗ > ██║ ███████╗╚██████╔╝██╔╝ ██╗ > ╚═╝ ╚══════╝ ╚═════╝ ╚═╝ ╚═╝ > +- Apache Storm -+ > +- data FLow User eXperience -+ > Version: 1.0.1 > Parsing file: /usr/hcp/1.5.0.0-8/metron/flux/profiler/remote.yaml > 853 [main] INFO o.a.s.f.p.FluxParser - loading YAML from input stream... > 865 [main] INFO o.a.s.f.p.FluxParser - Performing property substitution. > 876 [main] INFO o.a.s.f.p.FluxParser - Not performing environment variable > substitution. > 1151 [main] INFO o.a.c.f.i.CuratorFrameworkImpl - Starting > 1276 [main-EventThread] INFO o.a.c.f.s.ConnectionStateManager - State > change: CONNECTED > 1797 [Curator-Framework-0] INFO o.a.c.f.i.CuratorFrameworkImpl - > backgroundOperationsLoop exiting > 1844 [main] INFO o.a.s.f.FluxBuilder - Detected DSL topology... > 2055 [main] INFO o.a.m.w.b.BulkMessageWriterBolt - Requesting > topology.tick.tuple.freq.secs set to 14 > ---------- TOPOLOGY DETAILS ---------- > Topology Name: profiler > --------------- SPOUTS --------------- > kafkaSpout [1] (org.apache.metron.storm.kafka.flux.StormKafkaSpout) > ---------------- BOLTS --------------- > splitterBolt [1] (org.apache.metron.profiler.bolt.ProfileSplitterBolt) > builderBolt [1] (org.apache.metron.profiler.bolt.ProfileBuilderBolt) > hbaseBolt [1] (org.apache.metron.hbase.bolt.HBaseBolt) > kafkaBolt [1] (org.apache.metron.writer.bolt.BulkMessageWriterBolt) > --------------- STREAMS --------------- > kafkaSpout --LOCAL_OR_SHUFFLE--> splitterBolt > splitterBolt --FIELDS--> builderBolt > builderBolt --LOCAL_OR_SHUFFLE--> hbaseBolt > builderBolt --LOCAL_OR_SHUFFLE--> kafkaBolt > -------------------------------------- > 2150 [main] INFO o.a.s.f.Flux - Running remotely... > 2151 [main] INFO o.a.s.f.Flux - Deploying topology in an ACTIVE state... > 2240 [main] INFO o.a.s.StormSubmitter - Generated ZooKeeper secret payload > for MD5-digest: -7577618531371891589:-8149954680466423354 > 2373 [main] INFO o.a.s.m.n.Login - successfully logged in. > 2516 [main] INFO o.a.s.u.NimbusClient - Found leader nimbus : > ctr-e138-1518143905142-333856-01-000008.hwx.site:6627 > 2549 [main] INFO o.a.s.s.a.AuthUtils - Got AutoCreds > [org.apache.storm.security.auth.kerberos.AutoTGT@7fcff1b9] > 2549 [main] INFO o.a.s.StormSubmitter - Running > org.apache.storm.security.auth.kerberos.AutoTGT@7fcff1b9 > 2551 [main] INFO o.a.s.s.a.k.AutoTGT - Pushing TGT for met...@example.com to > topology. > 2563 [main] INFO o.a.s.m.n.Login - successfully logged in. > 2577 [main] INFO o.a.s.u.NimbusClient - Found leader nimbus : > ctr-e138-1518143905142-333856-01-000008.hwx.site:6627 > Exception in thread "main" java.lang.RuntimeException: Topology with name > `profiler` already exists on cluster > at > org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:240) > at > org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:390) > at org.apache.storm.flux.Flux.runCli(Flux.java:171) > at org.apache.storm.flux.Flux.main(Flux.java:98) > 2018-05-28 10:47:17,428 - Retrying after 5 seconds. > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)