Hi and thanks in advance, I am trying to perform a log analyser with storm, starting from the beginning I am just reading a file and sending lines (spout) receiving bolt just save the lines to a new file. As simple as that by now, I want to compare origin and destination files and check they are the same. Problem is that when about 52K are written storm stops with following error:
34870 [main] INFO backtype.storm.daemon.nimbus - Shutting down master 34876 [main] INFO backtype.storm.daemon.nimbus - Shut down master 34880 [main] INFO backtype.storm.daemon.supervisor - Shutting down 74037900-6997-4732-a987-a5f996db5928:b5e20ba0-33eb-4236-bc38-c323a840cac1 34880 [main] INFO backtype.storm.process-simulator - Killing process db74c56d-6e27-4cc6-91d8-b4ac66a552ae 34881 [main] INFO backtype.storm.daemon.worker - Shutting down worker sentence-count-1-1430586398 74037900-6997-4732-a987-a5f996db5928 1024 34881 [main] INFO backtype.storm.daemon.worker - Shutting down receive thread 34881 [main] INFO backtype.storm.messaging.loader - Shutting down receiving-thread: [sentence-count-1-1430586398, 1024] 34882 [Thread-19-worker-receiver-thread-0] INFO backtype.storm.messaging.loader - Receiving-thread:[sentence-count-1-1430586398, 1024] received shutdown notice 34882 [main] INFO backtype.storm.messaging.loader - Waiting for receiving-thread:[sentence-count-1-1430586398, 1024] to die 34883 [main] INFO backtype.storm.messaging.loader - Shutdown receiving-thread: [sentence-count-1-1430586398, 1024] 34883 [main] INFO backtype.storm.daemon.worker - Shut down receive thread 34883 [main] INFO backtype.storm.daemon.worker - Terminating messaging context 34884 [main] INFO backtype.storm.daemon.worker - Shutting down executors 34884 [main] INFO backtype.storm.daemon.executor - Shutting down executor report-bolt:[2 2] 34884 [Thread-8-report-bolt] INFO backtype.storm.util - Async loop interrupted! 34884 [Thread-7-disruptor-executor[2 2]-send-queue] INFO backtype.storm.util - Async loop interrupted! 34885 [main] INFO backtype.storm.daemon.executor - Shut down executor report-bolt:[2 2] 34885 [main] INFO backtype.storm.daemon.executor - Shutting down executor report-bolt:[3 3] 34885 [Thread-9-disruptor-executor[3 3]-send-queue] INFO backtype.storm.util - Async loop interrupted! 34886 [Thread-10-report-bolt] INFO backtype.storm.util - Async loop interrupted! 34886 [main] INFO backtype.storm.daemon.executor - Shut down executor report-bolt:[3 3] 34886 [main] INFO backtype.storm.daemon.executor - Shutting down executor report-bolt:[4 4] 34886 [Thread-11-disruptor-executor[4 4]-send-queue] INFO backtype.storm.util - Async loop interrupted! 34887 [Thread-12-report-bolt] INFO backtype.storm.util - Async loop interrupted! 34887 [main] INFO backtype.storm.daemon.executor - Shut down executor report-bolt:[4 4] 34887 [main] INFO backtype.storm.daemon.executor - Shutting down executor sentence-spout:[5 5] 34887 [Thread-14-sentence-spout] INFO backtype.storm.util - Async loop interrupted! Any idea why this may be happening? Rgds, Juan
