Hi ,
When I tried to send bro/yaf/snort related logs I am seeing that the topology is often getting killed and created .. and my logs are not seen after the bro/snort/yaf kafka topic .. In the storm supervisor log I am seeing these logs .. Any help is highly appreciated Regards, Meenakshi 2019-04-01 19:22:17.601 o.a.s.d.s.Container SLOT_6700 [INFO] Creating symlinks for worker-id: 7c1b4598-b9cd-4d81-994c-ec18c28e274c storm-id: enrichment-17-1553860818 for files(1): [resources] 2019-04-01 19:22:17.601 o.a.s.d.s.BasicContainer SLOT_6700 [INFO] Launching worker with assignment LocalAssignment(topology_id:enrichment-17-1553860818, executors:[ExecutorInfo(task_start:8, task_end:8), ExecutorInfo(task_start:7, task_end:7), ExecutorInfo(task_start:6, task_end:6), ExecutorInfo(task_start:5, task_end:5), ExecutorInfo(task_start:4, task_end:4), ExecutorInfo(task_start:3, task_end:3), ExecutorInfo(task_start:2, task_end:2), ExecutorInfo(task_start:1, task_end:1)], resources:WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, cpu:0.0), owner:storm) for this supervisor bbb51a05-6b0a-4bdc-aa99-35d700959630 on port 6700 with id 7c1b4598-b9cd-4d81-994c-ec18c28e274c 2019-04-01 19:22:17.602 o.a.s.d.s.BasicContainer SLOT_6700 [INFO] Launching worker with command: '/usr/jdk64/jdk1.8.0_112/bin/java' '-cp' '/usr/hdp/2.6.5.1100-53/storm/lib/asm-5.0.3.jar:/usr/hdp/2.6.5.1100-53/storm /lib/clojure-1.7.0.jar:/usr/hdp/2.6.5.1100-53/storm/lib/disruptor-3.3.2.jar: /usr/hdp/2.6.5.1100-53/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.6.5.1100-53/storm /lib/log4j-api-2.8.2.jar:/usr/hdp/2.6.5.1100-53/storm/lib/log4j-core-2.8.2.j ar:/usr/hdp/2.6.5.1100-53/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.6. 5.1100-53/storm/lib/log4j-slf4j-impl-2.8.2.jar:/usr/hdp/2.6.5.1100-53/storm/ lib/minlog-1.3.0.jar:/usr/hdp/2.6.5.1100-53/storm/lib/objenesis-2.1.jar:/usr /hdp/2.6.5.1100-53/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.6.5.1100-53/st orm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.6.5.1100-53/storm/lib/servlet-api-2.5 .jar:/usr/hdp/2.6.5.1100-53/storm/lib/slf4j-api-1.7.21.jar:/usr/hdp/2.6.5.11 00-53/storm/lib/storm-core-1.1.0.2.6.5.1100-53.jar:/usr/hdp/2.6.5.1100-53/st orm/lib/storm-rename-hack-1.1.0.2.6.5.1100-53.jar:/usr/hdp/2.6.5.1100-53/sto rm/lib/zookeeper.jar:/usr/hdp/2.6.5.1100-53/storm/lib/ambari-metrics-storm-s ink.jar:/usr/hdp/current/storm-supervisor/conf:/hadoop/storm/supervisor/stor mdist/enrichment-17-1553860818/stormjar.jar:/etc/hbase/conf:/etc/hadoop/conf ' '-Xmx64m' '-Dlogging.sensitivity=S3' '-Dlogfile.name=worker.log' '-Dstorm.home=/usr/hdp/2.6.5.1100-53/storm' '-Dworkers.artifacts=/var/log/storm/workers-artifacts' '-Dstorm.id=enrichment-17-1553860818' '-Dworker.id=7c1b4598-b9cd-4d81-994c-ec18c28e274c' '-Dworker.port=6700' '-Dstorm.log.dir=/var/log/storm' '-Dlog4j.configurationFile=/usr/hdp/2.6.5.1100-53/storm/log4j2/worker.xml' '-DLog4jContextSelector=org.apache.logging.log4j.core.selector.BasicContextS elector' '-Dstorm.local.dir=/hadoop/storm' 'org.apache.storm.LogWriter' '/usr/jdk64/jdk1.8.0_112/bin/java' '-server' '-Dlogging.sensitivity=S3' '-Dlogfile.name=worker.log' '-Dstorm.home=/usr/hdp/2.6.5.1100-53/storm' '-Dworkers.artifacts=/var/log/storm/workers-artifacts' '-Dstorm.id=enrichment-17-1553860818' '-Dworker.id=7c1b4598-b9cd-4d81-994c-ec18c28e274c' '-Dworker.port=6700' '-Dstorm.log.dir=/var/log/storm' '-Dlog4j.configurationFile=/usr/hdp/2.6.5.1100-53/storm/log4j2/worker.xml' '-DLog4jContextSelector=org.apache.logging.log4j.core.selector.BasicContextS elector' '-Dstorm.local.dir=/hadoop/storm' '-Xmx768m' '-Djava.library.path=/hadoop/storm/supervisor/stormdist/enrichment-17-155386 0818/resources/Linux-amd64:/hadoop/storm/supervisor/stormdist/enrichment-17- 1553860818/resources:/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdp/current /storm-client/lib' '-Dstorm.conf.file=' '-Dstorm.options=' '-Djava.io.tmpdir=/hadoop/storm/workers/7c1b4598-b9cd-4d81-994c-ec18c28e274c /tmp' '-cp' '/usr/hdp/2.6.5.1100-53/storm/lib/asm-5.0.3.jar:/usr/hdp/2.6.5.1100-53/storm /lib/clojure-1.7.0.jar:/usr/hdp/2.6.5.1100-53/storm/lib/disruptor-3.3.2.jar: /usr/hdp/2.6.5.1100-53/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.6.5.1100-53/storm /lib/log4j-api-2.8.2.jar:/usr/hdp/2.6.5.1100-53/storm/lib/log4j-core-2.8.2.j ar:/usr/hdp/2.6.5.1100-53/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.6. 5.1100-53/storm/lib/log4j-slf4j-impl-2.8.2.jar:/usr/hdp/2.6.5.1100-53/storm/ lib/minlog-1.3.0.jar:/usr/hdp/2.6.5.1100-53/storm/lib/objenesis-2.1.jar:/usr /hdp/2.6.5.1100-53/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.6.5.1100-53/st orm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.6.5.1100-53/storm/lib/servlet-api-2.5 .jar:/usr/hdp/2.6.5.1100-53/storm/lib/slf4j-api-1.7.21.jar:/usr/hdp/2.6.5.11 00-53/storm/lib/storm-core-1.1.0.2.6.5.1100-53.jar:/usr/hdp/2.6.5.1100-53/st orm/lib/storm-rename-hack-1.1.0.2.6.5.1100-53.jar:/usr/hdp/2.6.5.1100-53/sto rm/lib/zookeeper.jar:/usr/hdp/2.6.5.1100-53/storm/lib/ambari-metrics-storm-s ink.jar:/usr/hdp/current/storm-supervisor/conf:/hadoop/storm/supervisor/stor mdist/enrichment-17-1553860818/stormjar.jar:/etc/hbase/conf:/etc/hadoop/conf ' 'org.apache.storm.daemon.worker' 'enrichment-17-1553860818' 'bbb51a05-6b0a-4bdc-aa99-35d700959630' '6700' '7c1b4598-b9cd-4d81-994c-ec18c28e274c'. 2019-04-01 19:22:17.603 o.a.s.d.s.Slot SLOT_6700 [INFO] STATE KILL_AND_RELAUNCH msInState: 62 topo:enrichment-17-1553860818 worker:7c1b4598-b9cd-4d81-994c-ec18c28e274c -> WAITING_FOR_WORKER_START msInState: 0 topo:enrichment-17-1553860818 worker:7c1b4598-b9cd-4d81-994c-ec18c28e274c ^C
