jihoonson commented on issue #5343: Kafka indexing tasks occasionally fail with 'Stream closed' URL: https://github.com/apache/incubator-druid/issues/5343#issuecomment-475109733 @huang2012chao sorry, I missed your question. If one of Kafka tasks fail, the supervisor would print the reason in the overlord log. This might not easy to find before 0.14 because the reason may be printed in different line from the log of killing tasks. But, the reason to kill tasks should be in the overlord log. @usopan Even though we dropped Tranquility officially, it has not been updated for a while. And it doesn't support exactly-once. I would recommend using Kafka indexing service because it's more stable than Tranquility. This error doesn't necessarily mean the ingestion is failing. Rather, it's likely saying the supervisor killed some tasks for good reasons. @Jinstarry do you mean the memory of middleManager? Do you see any OutOfMemory error in the failed task log? I guess `index_kafka_ds_test2_4d88b40775ab307_cdkfbhbk` is the failed task you're saying. If you don't see any errors or exceptions in the task log, that means the supervisor killed that task. And if so, the reason for killing tasks should be in the overlord log. You should be able to see logs starting with `Sent shutdown message to worker` to kill those tasks. The reason for killing would be around that log.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
