Any suggestion how to fix that ? On Mon, Jan 22, 2018 at 9:01 PM, Farrukh Naveed Anjum < anjum.farr...@gmail.com> wrote:
> Hi Simon, > > Thanks for replying yes, these are indexing bolt errors. I am basically > trying to forward RSyslog via Nifi. It comes down all the way till indexing > bolts causes error. > > My purpose of using Generic CEF Parser is so that it accumolate SysLog ? I > did not give him any format, just created a CEF Parsers in Metron > Management UI. Do I need to give some kind of pattern too ? Or it can > figure out default syslog pattern ? Kindly guide > > By the way following is the indexing bolt error > > > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 02:34:16.543 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 02:34:16.543 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 02:34:16.547 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 02:34:16.581 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 02:49:16.516 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 02:49:16.516 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 02:49:16.520 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 02:49:16.521 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 03:04:16.518 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 03:04:16.518 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 03:04:16.525 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 03:04:16.555 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-16 04:07:19.924 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-16 04:07:19.956 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-16 04:07:19.956 o.a.m.w.h.SourceHandler [INFO] File rotation took 32 > ms > 2018-01-16 04:07:23.544 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-16 04:07:23.561 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-16 04:07:23.561 o.a.m.w.h.SourceHandler [INFO] File rotation took 17 > ms > 2018-01-16 04:07:36.406 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-16 04:07:36.409 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-16 04:07:36.409 o.a.m.w.h.SourceHandler [INFO] File rotation took 3 ms > 2018-01-16 04:08:02.265 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-16 04:08:02.289 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-16 04:08:02.289 o.a.m.w.h.SourceHandler [INFO] File rotation took 24 > ms > 2018-01-17 01:24:20.876 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-17 01:24:20.879 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-17 01:24:20.879 o.a.m.w.h.SourceHandler [INFO] File rotation took 3 ms > 2018-01-17 04:07:19.923 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-17 04:07:19.958 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-17 04:07:19.958 o.a.m.w.h.SourceHandler [INFO] File rotation took 35 > ms > 2018-01-17 04:07:23.544 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-17 04:07:23.546 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-17 04:07:23.546 o.a.m.w.h.SourceHandler [INFO] File rotation took 2 ms > 2018-01-17 04:07:36.406 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-17 04:07:36.422 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-17 04:07:36.422 o.a.m.w.h.SourceHandler [INFO] File rotation took 16 > ms > 2018-01-17 04:08:02.264 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-17 04:08:02.265 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-17 04:08:02.266 o.a.m.w.h.SourceHandler [INFO] File rotation took 1 ms > 2018-01-17 09:49:16.529 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-17 09:49:16.529 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-17 09:49:16.572 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-17 09:49:16.594 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-18 01:24:20.876 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-18 01:24:20.879 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-18 01:24:20.879 o.a.m.w.h.SourceHandler [INFO] File rotation took 3 ms > 2018-01-18 04:07:19.923 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-18 04:07:19.945 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-18 04:07:19.946 o.a.m.w.h.SourceHandler [INFO] File rotation took 23 > ms > 2018-01-18 04:07:23.544 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-18 04:07:23.570 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-18 04:07:23.570 o.a.m.w.h.SourceHandler [INFO] File rotation took 26 > ms > 2018-01-18 04:07:36.406 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-18 04:07:36.407 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-18 04:07:36.407 o.a.m.w.h.SourceHandler [INFO] File rotation took 1 ms > 2018-01-18 04:08:02.264 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-18 04:08:02.289 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-18 04:08:02.289 o.a.m.w.h.SourceHandler [INFO] File rotation took 25 > ms > 2018-01-18 09:46:50.425 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-18 09:46:50.460 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-18 09:46:50.460 o.a.m.w.h.SourceHandler [INFO] File rotation took 35 > ms > 2018-01-18 09:49:16.568 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-18 09:49:16.614 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-18 09:49:16.614 o.a.m.w.h.SourceHandler [INFO] File rotation took 46 > ms > 2018-01-18 17:19:16.540 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-18 17:19:16.540 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-19 01:24:20.877 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 01:24:20.879 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 01:24:20.879 o.a.m.w.h.SourceHandler [INFO] File rotation took 2 ms > 2018-01-19 04:07:19.923 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 04:07:19.939 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 04:07:19.939 o.a.m.w.h.SourceHandler [INFO] File rotation took 16 > ms > 2018-01-19 04:07:23.545 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 04:07:23.561 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 04:07:23.561 o.a.m.w.h.SourceHandler [INFO] File rotation took 16 > ms > 2018-01-19 04:07:36.406 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 04:07:36.429 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 04:07:36.429 o.a.m.w.h.SourceHandler [INFO] File rotation took 23 > ms > 2018-01-19 04:08:02.264 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 04:08:02.289 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 04:08:02.289 o.a.m.w.h.SourceHandler [INFO] File rotation took 25 > ms > 2018-01-19 09:46:50.425 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 09:46:50.442 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 09:46:50.442 o.a.m.w.h.SourceHandler [INFO] File rotation took 17 > ms > 2018-01-19 09:49:16.568 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 09:49:16.586 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 09:49:16.586 o.a.m.w.h.SourceHandler [INFO] File rotation took 18 > ms > 2018-01-19 17:08:22.126 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 17:08:22.142 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 17:08:22.142 o.a.m.w.h.SourceHandler [INFO] File rotation took 16 > ms > 2018-01-19 17:19:16.556 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-19 17:19:16.582 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-19 17:19:16.582 o.a.m.w.h.SourceHandler [INFO] File rotation took 26 > ms > 2018-01-20 01:24:20.876 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 01:24:20.879 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 01:24:20.879 o.a.m.w.h.SourceHandler [INFO] File rotation took 3 ms > 2018-01-20 04:07:19.923 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 04:07:19.962 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 04:07:19.962 o.a.m.w.h.SourceHandler [INFO] File rotation took 38 > ms > 2018-01-20 04:07:23.544 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 04:07:23.561 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 04:07:23.561 o.a.m.w.h.SourceHandler [INFO] File rotation took 17 > ms > 2018-01-20 04:07:36.406 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 04:07:36.407 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 04:07:36.408 o.a.m.w.h.SourceHandler [INFO] File rotation took 2 ms > 2018-01-20 04:08:02.264 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 04:08:02.290 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 04:08:02.290 o.a.m.w.h.SourceHandler [INFO] File rotation took 26 > ms > 2018-01-20 09:34:16.559 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-20 09:34:16.559 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-20 09:46:50.425 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 09:46:50.445 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 09:46:50.446 o.a.m.w.h.SourceHandler [INFO] File rotation took 21 > ms > 2018-01-20 09:49:16.568 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 09:49:16.570 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 09:49:16.570 o.a.m.w.h.SourceHandler [INFO] File rotation took 2 ms > 2018-01-20 10:19:16.560 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-20 10:19:16.560 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-20 17:08:22.127 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 17:08:22.129 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 17:08:22.129 o.a.m.w.h.SourceHandler [INFO] File rotation took 2 ms > 2018-01-20 17:19:16.556 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-20 17:19:16.558 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-20 17:19:16.558 o.a.m.w.h.SourceHandler [INFO] File rotation took 2 ms > 2018-01-21 01:24:20.876 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-21 01:24:20.912 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-21 01:24:20.912 o.a.m.w.h.SourceHandler [INFO] File rotation took 32 > ms > 2018-01-21 04:07:19.923 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-21 04:07:19.949 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-21 04:07:19.950 o.a.m.w.h.SourceHandler [INFO] File rotation took 26 > ms > 2018-01-21 04:07:23.544 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-21 04:07:23.545 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-21 04:07:23.545 o.a.m.w.h.SourceHandler [INFO] File rotation took 1 ms > 2018-01-21 04:07:36.406 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-21 04:07:36.429 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-21 04:07:36.429 o.a.m.w.h.SourceHandler [INFO] File rotation took 23 > ms > 2018-01-21 04:08:02.264 o.a.m.w.h.SourceHandler [INFO] Rotating output file... > 2018-01-21 04:08:02.289 o.a.m.w.h.SourceHandler [INFO] Performing 0 file > rotation actions. > 2018-01-21 04:08:02.289 o.a.m.w.h.SourceHandler [INFO] File rotation took 25 > ms > 2018-01-21 07:34:16.569 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-21 07:34:16.573 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-21 07:34:16.593 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for hdfs writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] > at java.lang.Thread.run(Thread.java:745) [?:1.8.0_77] > 2018-01-21 07:34:16.773 o.a.s.d.executor [ERROR] > java.lang.Exception: WARNING: Default and (likely) unoptimized writer config > used for elasticsearch writer and sensor profiler > at > org.apache.metron.writer.bolt.BulkMessageWriterBolt.execute(BulkMessageWriterBolt.java:234) > [stormjar.jar:?] > at > org.apache.storm.daemon.executor$fn__6573$tuple_action_fn__6575.invoke(executor.clj:734) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$mk_task_receiver$fn__6494.invoke(executor.clj:466) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$clojure_handler$reify__6007.onEvent(disruptor.clj:40) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:451) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:430) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:73) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at > org.apache.storm.daemon.executor$fn__6573$fn__6586$fn__6639.invoke(executor.clj:853) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:484) > [storm-core-1.0.1.2.5.3.0-37.jar:1.0.1.2.5.3.0-37] > > > > > On Mon, Jan 22, 2018 at 2:14 PM, Simon Elliston Ball < > si...@simonellistonball.com> wrote: > >> Are there any errors in the logs for the indexing bolt? I would expect >> the errors are probably at the elastic ingest point, and probably caused by >> an incorrect elastic template for the CEF data. >> >> Simon >> >> >> On 22 Jan 2018, at 08:24, Farrukh Naveed Anjum <anjum.farr...@gmail.com> >> wrote: >> >> Yes its Strom Indexing Bolt that is halting it. Any one working on CEF >> Parser (Can Syslog work with it like RSyslog). We are stuck at that point. >> >> Please see the above error and suggest >> >> On Mon, Jan 22, 2018 at 1:10 PM, Gaurav Bapat <gauravb3...@gmail.com> >> wrote: >> >>> Hi, >>> >>> Even I am stuck with the same, and dont know how to solve the issue. >>> >>> Looks like this is a parsing error >>> >>> On 22 January 2018 at 13:00, Farrukh Naveed Anjum < >>> anjum.farr...@gmail.com> wrote: >>> >>>> Hi, >>>> >>>> I am trying to Ingest syslog using CEF Parser it is not creating any >>>> Elastic Search Index based on. >>>> >>>> Any suggestion how can I achieve it ? >>>> >>>> >>>> >>>> >>>> -- >>>> With Regards >>>> Farrukh Naveed Anjum >>>> >>> >>> >> >> >> -- >> With Regards >> Farrukh Naveed Anjum >> >> >> > > > -- > With Regards > Farrukh Naveed Anjum > -- With Regards Farrukh Naveed Anjum
