[jira] [Updated] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

2021-02-01 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-34325: - Description: shuffleBlockResolver in SortShuffleWriter is not used, can remove it. (was:

[jira] [Updated] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

2021-02-01 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-34325: - Description: shuffleBlockResolver in SortShuffleWriter is not used. >

[jira] [Created] (SPARK-34325) remove_shuffleBlockResolver_in_SortShuffleWriter

2021-02-01 Thread Xudingyu (Jira)
Xudingyu created SPARK-34325: Summary: remove_shuffleBlockResolver_in_SortShuffleWriter Key: SPARK-34325 URL: https://issues.apache.org/jira/browse/SPARK-34325 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34285) Implement Parquet StringEndsWith、StringContains Filter

2021-01-28 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-34285: - Summary: Implement Parquet StringEndsWith、StringContains Filter (was: Implement

[jira] [Created] (SPARK-34285) Implement StringEndWith、StringContains Filter

2021-01-28 Thread Xudingyu (Jira)
Xudingyu created SPARK-34285: Summary: Implement StringEndWith、StringContains Filter Key: SPARK-34285 URL: https://issues.apache.org/jira/browse/SPARK-34285 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-27 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255342#comment-17255342 ] Xudingyu commented on SPARK-33896: -- [~sro...@scient.com][~sro...@yahoo.com][~sowen] > Make Spark

[jira] [Commented] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254398#comment-17254398 ] Xudingyu commented on SPARK-33896: -- [~abani.apache][~apachespark] > Make Spark DAGScheduler datasource

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Priority: Critical (was: Major) > Make Spark DAGScheduler datasource cache aware when scheduling tasks

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals: * • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: Goals: • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication HDFS

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: *Goals:* • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Description: Goals: • Make Spark 3.0 Scheduler DataSource-Cache-Aware in multi-replication HDFS

[jira] [Updated] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-23 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudingyu updated SPARK-33896: - Summary: Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication

[jira] [Created] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks

2020-12-23 Thread Xudingyu (Jira)
Xudingyu created SPARK-33896: Summary: Make Spark DAGScheduler datasource cache aware when scheduling tasks Key: SPARK-33896 URL: https://issues.apache.org/jira/browse/SPARK-33896 Project: Spark

[jira] [Created] (SPARK-33835) Refector AbstractCommandBuilder

2020-12-17 Thread Xudingyu (Jira)
Xudingyu created SPARK-33835: Summary: Refector AbstractCommandBuilder Key: SPARK-33835 URL: https://issues.apache.org/jira/browse/SPARK-33835 Project: Spark Issue Type: Improvement