[jira] [Created] (SPARK-38931) RocksDB File manager would not create initial dfs directory with unknown number of keys on 1st empty checkpoint

Yun Tang created SPARK-38931: Summary: RocksDB File manager would not create initial dfs directory with unknown number of keys on 1st empty checkpoint Key: SPARK-38931 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Created] (SPARK-38277) Clear write batch after RocksDB state store's commit

Yun Tang created SPARK-38277: Summary: Clear write batch after RocksDB state store's commit Key: SPARK-38277 URL: https://issues.apache.org/jira/browse/SPARK-38277 Project: Spark Issue Type: Impr

[jira] [Created] (SPARK-38275) Consider to include WriteBatch's memory in the memory usage of RocksDB state store

Yun Tang created SPARK-38275: Summary: Consider to include WriteBatch's memory in the memory usage of RocksDB state store Key: SPARK-38275 URL: https://issues.apache.org/jira/browse/SPARK-38275 Project: S

[jira] [Created] (SPARK-38178) Correct the logic to measure the memory usage of RocksDB

Yun Tang created SPARK-38178: Summary: Correct the logic to measure the memory usage of RocksDB Key: SPARK-38178 URL: https://issues.apache.org/jira/browse/SPARK-38178 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13758) Error message is misleading when RDD refer to null spark context

[ https://issues.apache.org/jira/browse/SPARK-13758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128570#comment-16128570 ] Yun Tang commented on SPARK-13758: -- For developers who visit this page in the future, th

[jira] [Updated] (SPARK-21239) Support WAL recover in windows

[ https://issues.apache.org/jira/browse/SPARK-21239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated SPARK-21239: - Description: When driver failed over, it will read WAL from HDFS by calling WriteAheadLogBackedBlockRDD.

[jira] [Created] (SPARK-21239) Support WAL recover in windows

Yun Tang created SPARK-21239: Summary: Support WAL recover in windows Key: SPARK-21239 URL: https://issues.apache.org/jira/browse/SPARK-21239 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-17523) Cannot get Spark build info from spark-core package which built in Windows

Yun Tang created SPARK-17523: Summary: Cannot get Spark build info from spark-core package which built in Windows Key: SPARK-17523 URL: https://issues.apache.org/jira/browse/SPARK-17523 Project: Spark