[ https://issues.apache.org/jira/browse/SPARK-28397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yu Wang resolved SPARK-28397. ----------------------------- Resolution: Invalid > Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) > ----------------------------------------------------------------------- > > Key: SPARK-28397 > URL: https://issues.apache.org/jira/browse/SPARK-28397 > Project: Spark > Issue Type: Bug > Components: DStreams > Affects Versions: 2.0.2 > Reporter: Yu Wang > Priority: Critical > > ReceivedBlockTracker - Exception thrown while writing record: > BatchCleanupEvent(ArrayBuffer()) to the WriteAheadLog. > org.apache.spark.SparkException: Exception thrown in awaitResult: at > org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:194) at > org.apache.spark.streaming.util.BatchedWriteAheadLog.write(BatchedWriteAheadLog.scala:83) > at > org.apache.spark.streaming.scheduler.ReceivedBlockTracker.writeToLog(ReceivedBlockTracker.scala:234) > at > org.apache.spark.streaming.scheduler.ReceivedBlockTracker.cleanupOldBatches(ReceivedBlockTracker.scala:171) > at > org.apache.spark.streaming.scheduler.ReceiverTracker.cleanupOldBlocksAndBatches(ReceiverTracker.scala:226) > at > org.apache.spark.streaming.scheduler.JobGenerator.clearCheckpointData(JobGenerator.scala:287) > at > org.apache.spark.streaming.scheduler.JobGenerator.org$apache$spark$streaming$scheduler$JobGenerator$$processEvent(JobGenerator.scala:187) > at > org.apache.spark.streaming.scheduler.JobGenerator$$anon$1.onReceive(JobGenerator.scala:89) > at > org.apache.spark.streaming.scheduler.JobGenerator$$anon$1.onReceive(JobGenerator.scala:88) > at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48) Caused > by: java.util.concurrent.TimeoutException: Futures timed out after [5000 > milliseconds] at > scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219) at > scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223) at > scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190) at > scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53) > at scala.concurrent.Await$.result(package.scala:190) at > org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:190) ... 9 > more -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org