Zhiwen Sun created SPARK-20692: ---------------------------------- Summary: unknowing delay in event timeline Key: SPARK-20692 URL: https://issues.apache.org/jira/browse/SPARK-20692 Project: Spark Issue Type: Bug Components: DStreams Affects Versions: 1.6.2 Environment: Spark 1.6.1 + kafka 0.8.2 Reporter: Zhiwen Sun
Spark streaming job with 1s interval. Process time of micro batch suddenly became to 4s while is is usually 0.4s . when we check where time spent, we find a unknown delay in job. there is no executor computing or shuffle reading. About 4s blank in event timeline, -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org