[jira] [Created] (SPARK-45669) Ensure the continuity of rolling log index

shuyouZZ created SPARK-45669: Summary: Ensure the continuity of rolling log index Key: SPARK-45669 URL: https://issues.apache.org/jira/browse/SPARK-45669 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-45668) Improve the assert message in `RollingEventLogFilesFileReader`

[ https://issues.apache.org/jira/browse/SPARK-45668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-45668: - Description: Currently the assert message in `RollingEventLogFilesFileReader` is not clear. When the as

[jira] [Created] (SPARK-45668) Improve the assert message in `RollingEventLogFilesFileReader`

shuyouZZ created SPARK-45668: Summary: Improve the assert message in `RollingEventLogFilesFileReader` Key: SPARK-45668 URL: https://issues.apache.org/jira/browse/SPARK-45668 Project: Spark Issue

[jira] [Created] (SPARK-44703) Log eventLog rewrite duration when compact old event log files

shuyouZZ created SPARK-44703: Summary: Log eventLog rewrite duration when compact old event log files Key: SPARK-44703 URL: https://issues.apache.org/jira/browse/SPARK-44703 Project: Spark Issue

[jira] [Updated] (SPARK-44699) Add logging for complete write events to file in EventLogFileWriter.closeWriter

[ https://issues.apache.org/jira/browse/SPARK-44699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-44699: - Summary: Add logging for complete write events to file in EventLogFileWriter.closeWriter (was: add logg

[jira] [Created] (SPARK-44699) add logging for complete write events to file in EventLogFileWriter.closeWriter

shuyouZZ created SPARK-44699: Summary: add logging for complete write events to file in EventLogFileWriter.closeWriter Key: SPARK-44699 URL: https://issues.apache.org/jira/browse/SPARK-44699 Project: Spar

[jira] [Updated] (SPARK-43991) Use the compression codec set by the spark config file when write compact log

[ https://issues.apache.org/jira/browse/SPARK-43991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-43991: - Description: Currently, if enable rolling log in SHS, only {{originalFilePath}} is used to determine th

[jira] [Updated] (SPARK-43991) Use the value of spark.eventLog.compression.codec set by user when write compact file

[ https://issues.apache.org/jira/browse/SPARK-43991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-43991: - Summary: Use the value of spark.eventLog.compression.codec set by user when write compact file (was: Us

[jira] [Updated] (SPARK-43991) Use the compression codec set by the spark config file when write compact log

[ https://issues.apache.org/jira/browse/SPARK-43991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-43991: - Summary: Use the compression codec set by the spark config file when write compact log (was: Use the co

[jira] [Created] (SPARK-43991) Use the compression codec set by the spark config file

shuyouZZ created SPARK-43991: Summary: Use the compression codec set by the spark config file Key: SPARK-43991 URL: https://issues.apache.org/jira/browse/SPARK-43991 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-41962) Update the import order of scala package in class SpecificParquetRecordReaderBase

[ https://issues.apache.org/jira/browse/SPARK-41962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-41962: - Summary: Update the import order of scala package in class SpecificParquetRecordReaderBase (was: Update

[jira] [Created] (SPARK-41962) Update the import order of class SpecificParquetRecordReaderBase

shuyouZZ created SPARK-41962: Summary: Update the import order of class SpecificParquetRecordReaderBase Key: SPARK-41962 URL: https://issues.apache.org/jira/browse/SPARK-41962 Project: Spark Iss

[jira] [Updated] (SPARK-41447) Reduce the number of doMergeApplicationListing invocations

[ https://issues.apache.org/jira/browse/SPARK-41447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-41447: - Description: When restarting the history server, In history server log, we can see many {{INFO FsHIstory

[jira] [Updated] (SPARK-41447) clean up expired event log files that don't exist in listing db

[ https://issues.apache.org/jira/browse/SPARK-41447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-41447: - Description: When restarting the history server, the previous logic is to execute {{checkForLogs}} firs

[jira] [Updated] (SPARK-41447) clean up expired event log files that don't exist in listing db

[ https://issues.apache.org/jira/browse/SPARK-41447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuyouZZ updated SPARK-41447: - Description: When restarting the history server, the previous logic is to execute {{checkForLogs}} firs

[jira] [Created] (SPARK-41447) clean up expired event log files that don't exist in listing db

shuyouZZ created SPARK-41447: Summary: clean up expired event log files that don't exist in listing db Key: SPARK-41447 URL: https://issues.apache.org/jira/browse/SPARK-41447 Project: Spark Issu

[jira] [Created] (SPARK-38919) Filter stale event log before parse logs

shuyouZZ created SPARK-38919: Summary: Filter stale event log before parse logs Key: SPARK-38919 URL: https://issues.apache.org/jira/browse/SPARK-38919 Project: Spark Issue Type: Task C