Brian Cho created SPARK-20261: --------------------------------- Summary: EventLoggingListener may not truly flush the logger when a compression codec is used Key: SPARK-20261 URL: https://issues.apache.org/jira/browse/SPARK-20261 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 2.1.0 Reporter: Brian Cho Priority: Minor
Log events with flushLogger set to true are supposed to immediately flush to update the event history. However, this does not happen when using some compression codecs e.g., LZ4BlockOutputStream, because the compressed stream can hold on to the update until the compression block is filled. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org