[jira] [Assigned] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

2021-07-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36032: --- Assignee: XiDuo You > Use inputPlan instead of currentPhysicalPlan to initialize logical

[jira] [Resolved] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

2021-07-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36032. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33244

[jira] [Commented] (SPARK-36058) Support replicasets/job API

2021-07-08 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377809#comment-17377809 ] Holden Karau commented on SPARK-36058: -- So we can make a job and put it in the podgroup and mutate

[jira] [Assigned] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36067: Assignee: Kousuke Saruta (was: Apache Spark) > YarnClusterSuite fails due to

[jira] [Assigned] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36067: Assignee: Apache Spark (was: Kousuke Saruta) > YarnClusterSuite fails due to

[jira] [Commented] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377807#comment-17377807 ] Apache Spark commented on SPARK-36067: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Description: YarnClusterSuite will fails due to NoClassDefFoundError unless hadoop-3.2

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Summary: YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Description: YarnClusterSuite will fails due to ClassNotFoundException unless hadoop-3.2

[jira] [Created] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36067: -- Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly Key: SPARK-36067 URL:

[jira] [Created] (SPARK-36066) UTF8String trimAll() only can trim space but not ({@literal <=} ASCII 32)

2021-07-08 Thread liukai (Jira)
liukai created SPARK-36066: -- Summary: UTF8String trimAll() only can trim space but not ({@literal <=} ASCII 32) Key: SPARK-36066 URL: https://issues.apache.org/jira/browse/SPARK-36066 Project: Spark

[jira] [Assigned] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36001: Assignee: Xinrong Meng > Assume result's index to be disordered in tests with

[jira] [Resolved] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36001. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33274

[jira] [Created] (SPARK-36065) date_trunc returns incorrect output

2021-07-08 Thread Sumeet (Jira)
Sumeet created SPARK-36065: -- Summary: date_trunc returns incorrect output Key: SPARK-36065 URL: https://issues.apache.org/jira/browse/SPARK-36065 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-36058) Support replicasets/job API

2021-07-08 Thread Klaus Ma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377731#comment-17377731 ] Klaus Ma commented on SPARK-36058: -- Volcano already support all API in k8s upstream; PodGroup

[jira] [Resolved] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36062. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33273

[jira] [Assigned] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36062: Assignee: Takuya Ueshin > Try to capture faulthanlder when a Python worker crashes. >

[jira] [Updated] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

2021-07-08 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-36032: -- Description: At {{initialPlan}} we may remove some Spark Plan with  {{queryStagePreparationRules}},

[jira] [Updated] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

2021-07-08 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-36032: -- Summary: Use inputPlan instead of currentPhysicalPlan to initialize logical link (was:

[jira] [Resolved] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36051. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33266

[jira] [Assigned] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36051: Assignee: Hyukjin Kwon > Remove automatic update of documentation build in the guides >

[jira] [Commented] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377655#comment-17377655 ] Apache Spark commented on SPARK-36064: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36064: Assignee: (was: Apache Spark) > Manage InternalField more in DataTypeOps. >

[jira] [Assigned] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36064: Assignee: Apache Spark > Manage InternalField more in DataTypeOps. >

[jira] [Commented] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377654#comment-17377654 ] Apache Spark commented on SPARK-36064: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36064: - Summary: Manage InternalField more in DataTypeOps. Key: SPARK-36064 URL: https://issues.apache.org/jira/browse/SPARK-36064 Project: Spark Issue Type:

[jira] [Created] (SPARK-36063) Optimize OneRowRelation subqueries

2021-07-08 Thread Allison Wang (Jira)
Allison Wang created SPARK-36063: Summary: Optimize OneRowRelation subqueries Key: SPARK-36063 URL: https://issues.apache.org/jira/browse/SPARK-36063 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377609#comment-17377609 ] Apache Spark commented on SPARK-36001: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377608#comment-17377608 ] Apache Spark commented on SPARK-36001: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36001: Assignee: (was: Apache Spark) > Assume result's index to be disordered in tests

[jira] [Assigned] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36001: Assignee: Apache Spark > Assume result's index to be disordered in tests with

[jira] [Commented] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377597#comment-17377597 ] Apache Spark commented on SPARK-36062: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36062: Assignee: Apache Spark > Try to capture faulthanlder when a Python worker crashes. >

[jira] [Assigned] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36062: Assignee: (was: Apache Spark) > Try to capture faulthanlder when a Python worker

[jira] [Created] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36062: - Summary: Try to capture faulthanlder when a Python worker crashes. Key: SPARK-36062 URL: https://issues.apache.org/jira/browse/SPARK-36062 Project: Spark

[jira] [Commented] (SPARK-36035) Adjust `test_astype`, `test_neg` for old pandas versions

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377590#comment-17377590 ] Apache Spark commented on SPARK-36035: -- User 'xinrong-databricks' has created a pull request for

[jira] [Resolved] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36049. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33265

[jira] [Assigned] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36049: Assignee: angerszhu > Remove IntervalUnit in code > --- > >

[jira] [Resolved] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36054. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33268

[jira] [Resolved] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-08 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35340. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Resolved] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36055. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33269

[jira] [Resolved] (SPARK-36050) Spark doesn’t support reading/writing TIMESTAMP_NTZ with ORC

2021-07-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36050. Resolution: Not A Problem > Spark doesn’t support reading/writing TIMESTAMP_NTZ with ORC

[jira] [Commented] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377545#comment-17377545 ] Apache Spark commented on SPARK-36056: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377544#comment-17377544 ] Apache Spark commented on SPARK-36056: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36056: Assignee: Apache Spark > Combine readBatch and readIntegers in VectorizedRleValuesReader

[jira] [Assigned] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36056: Assignee: (was: Apache Spark) > Combine readBatch and readIntegers in

[jira] [Created] (SPARK-36061) Create a PodGroup with user specified minimum resources required

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36061: Summary: Create a PodGroup with user specified minimum resources required Key: SPARK-36061 URL: https://issues.apache.org/jira/browse/SPARK-36061 Project: Spark

[jira] [Assigned] (SPARK-35743) Improve Parquet vectorized reader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35743: Assignee: (was: Apache Spark) > Improve Parquet vectorized reader >

[jira] [Commented] (SPARK-35743) Improve Parquet vectorized reader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377536#comment-17377536 ] Apache Spark commented on SPARK-35743: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35743) Improve Parquet vectorized reader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35743: Assignee: Apache Spark > Improve Parquet vectorized reader >

[jira] [Created] (SPARK-36060) Support backing off dynamic allocation increases if resources are "stuck"

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36060: Summary: Support backing off dynamic allocation increases if resources are "stuck" Key: SPARK-36060 URL: https://issues.apache.org/jira/browse/SPARK-36060 Project:

[jira] [Created] (SPARK-36058) Support replicasets/job API

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36058: Summary: Support replicasets/job API Key: SPARK-36058 URL: https://issues.apache.org/jira/browse/SPARK-36058 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36059) Add the ability to specify a scheduler & queue

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36059: Summary: Add the ability to specify a scheduler & queue Key: SPARK-36059 URL: https://issues.apache.org/jira/browse/SPARK-36059 Project: Spark Issue Type:

[jira] [Created] (SPARK-36057) Support volcano/alternative schedulers

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36057: Summary: Support volcano/alternative schedulers Key: SPARK-36057 URL: https://issues.apache.org/jira/browse/SPARK-36057 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377528#comment-17377528 ] Apache Spark commented on SPARK-35956: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35956: Assignee: Holden Karau (was: Apache Spark) > Support auto-assigning labels to less

[jira] [Assigned] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35956: Assignee: Apache Spark (was: Holden Karau) > Support auto-assigning labels to less

[jira] [Commented] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377527#comment-17377527 ] Apache Spark commented on SPARK-35956: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36012) Lost the null flag info when show create table

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36012: --- Assignee: PengLei > Lost the null flag info when show create table >

[jira] [Resolved] (SPARK-36012) Lost the null flag info when show create table

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36012. - Resolution: Fixed Issue resolved by pull request 33219

[jira] [Assigned] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36055: Assignee: Apache Spark (was: Gengliang Wang) > Assign pretty SQL string to TimestampNTZ

[jira] [Assigned] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36055: Assignee: Gengliang Wang (was: Apache Spark) > Assign pretty SQL string to TimestampNTZ

[jira] [Commented] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377507#comment-17377507 ] Apache Spark commented on SPARK-36055: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Chao Sun (Jira)
Chao Sun created SPARK-36056: Summary: Combine readBatch and readIntegers in VectorizedRleValuesReader Key: SPARK-36056 URL: https://issues.apache.org/jira/browse/SPARK-36056 Project: Spark

[jira] [Created] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36055: -- Summary: Assign pretty SQL string to TimestampNTZ literals Key: SPARK-36055 URL: https://issues.apache.org/jira/browse/SPARK-36055 Project: Spark Issue

[jira] [Resolved] (SPARK-35874) AQE Shuffle should wait for its subqueries to finish before materializing

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35874. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33058

[jira] [Assigned] (SPARK-35874) AQE Shuffle should wait for its subqueries to finish before materializing

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35874: --- Assignee: Wenchen Fan > AQE Shuffle should wait for its subqueries to finish before

[jira] [Assigned] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35958: --- Assignee: Karen Feng > Refactor SparkError.scala to SparkThrowable.java >

[jira] [Resolved] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35958. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33164

[jira] [Assigned] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36054: Assignee: Apache Spark (was: Gengliang Wang) > Support group by TimestampNTZ column >

[jira] [Commented] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377399#comment-17377399 ] Apache Spark commented on SPARK-36054: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36054: Assignee: Gengliang Wang (was: Apache Spark) > Support group by TimestampNTZ column >

[jira] [Created] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36054: -- Summary: Support group by TimestampNTZ column Key: SPARK-36054 URL: https://issues.apache.org/jira/browse/SPARK-36054 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36053: Assignee: (was: Apache Spark) > Unify write exception and delete abnormal disk block

[jira] [Commented] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377359#comment-17377359 ] Apache Spark commented on SPARK-36053: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36053: Assignee: Apache Spark > Unify write exception and delete abnormal disk block object

[jira] [Updated] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-36053: - Description: There are some duplicate codes related to cleaning up failed files after

[jira] [Resolved] (SPARK-35988) The implementation for RocksDBStateStoreProvider

2021-07-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-35988. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33187

[jira] [Created] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-36053: Summary: Unify write exception and delete abnormal disk block object file process Key: SPARK-36053 URL: https://issues.apache.org/jira/browse/SPARK-36053 Project: Spark

[jira] [Assigned] (SPARK-35988) The implementation for RocksDBStateStoreProvider

2021-07-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-35988: Assignee: Yuanjian Li > The implementation for RocksDBStateStoreProvider >

[jira] [Updated] (SPARK-36052) Introduce pending pod limit for Spark on K8s

2021-07-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36052: --- Description: Introduce pending POD limit for Spark on K8S as K8S scheduler could be

[jira] [Updated] (SPARK-36052) Introduce pending pod limit for Spark on K8s

2021-07-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36052: --- Description: Introduce a new configuration to limit the number of pending PODs for

[jira] [Created] (SPARK-36052) Introduce pending pod limit for Spark on K8s

2021-07-08 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-36052: -- Summary: Introduce pending pod limit for Spark on K8s Key: SPARK-36052 URL: https://issues.apache.org/jira/browse/SPARK-36052 Project: Spark

[jira] [Resolved] (SPARK-36043) Add end-to-end tests with default timestamp type as TIMESTAMP_NTZ

2021-07-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36043. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33259

[jira] [Commented] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377318#comment-17377318 ] Apache Spark commented on SPARK-36051: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36051: Assignee: (was: Apache Spark) > Remove automatic update of documentation build in

[jira] [Commented] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377316#comment-17377316 ] Apache Spark commented on SPARK-36051: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36051: Assignee: Apache Spark > Remove automatic update of documentation build in the guides >

[jira] [Updated] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36051: - Description: At

[jira] [Updated] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36051: - Summary: Remove automatic update of documentation build in the guides (was: Add the detection

[jira] [Commented] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377287#comment-17377287 ] Apache Spark commented on SPARK-36049: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36049: Assignee: Apache Spark > Remove IntervalUnit in code > --- > >

[jira] [Commented] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377289#comment-17377289 ] Apache Spark commented on SPARK-36049: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36049: Assignee: (was: Apache Spark) > Remove IntervalUnit in code >

[jira] [Updated] (SPARK-36051) Add the detection of .rst files into documentation build guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36051: - Priority: Trivial (was: Major) > Add the detection of .rst files into documentation build

[jira] [Created] (SPARK-36051) Add the detection of .rst files into documentation build guides

2021-07-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-36051: Summary: Add the detection of .rst files into documentation build guides Key: SPARK-36051 URL: https://issues.apache.org/jira/browse/SPARK-36051 Project: Spark

[jira] [Assigned] (SPARK-36050) Spark doesn’t support reading/writing TIMESTAMP_NTZ with ORC

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36050: Assignee: Gengliang Wang (was: Apache Spark) > Spark doesn’t support reading/writing

[jira] [Assigned] (SPARK-36050) Spark doesn’t support reading/writing TIMESTAMP_NTZ with ORC

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36050: Assignee: Apache Spark (was: Gengliang Wang) > Spark doesn’t support reading/writing

[jira] [Commented] (SPARK-36050) Spark doesn’t support reading/writing TIMESTAMP_NTZ with ORC

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377269#comment-17377269 ] Apache Spark commented on SPARK-36050: -- User 'gengliangwang' has created a pull request for this

  1   2   >