[jira] [Commented] (SPARK-36044) Suport TimestampNTZ in functions unix_timestamp/to_unix_timestamp

2021-07-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377841#comment-17377841 ] jiaan.geng commented on SPARK-36044: I'm working on this. > Suport TimestampNTZ in

[jira] [Resolved] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36067. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33276 [https://gi

[jira] [Assigned] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

2021-07-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36032: --- Assignee: XiDuo You > Use inputPlan instead of currentPhysicalPlan to initialize logical li

[jira] [Resolved] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

2021-07-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36032. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33244 [https://gith

[jira] [Commented] (SPARK-36058) Support replicasets/job API

2021-07-08 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377809#comment-17377809 ] Holden Karau commented on SPARK-36058: -- So we can make a job and put it in the podg

[jira] [Assigned] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36067: Assignee: Kousuke Saruta (was: Apache Spark) > YarnClusterSuite fails due to NoClassDefF

[jira] [Assigned] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36067: Assignee: Apache Spark (was: Kousuke Saruta) > YarnClusterSuite fails due to NoClassDefF

[jira] [Commented] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377807#comment-17377807 ] Apache Spark commented on SPARK-36067: -- User 'sarutak' has created a pull request f

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Description: YarnClusterSuite will fails due to NoClassDefFoundError unless hadoop-3.2 prof

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Summary: YarnClusterSuite fails due to NoClassDefFoundError unless hadoop-3.2 profile is act

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is a

[jira] [Updated] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is activated explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36067: --- Description: YarnClusterSuite will fails due to ClassNotFoundException unless hadoop-3.2 pr

[jira] [Created] (SPARK-36067) YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly

2021-07-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-36067: -- Summary: YarnClusterSuite fails due to ClassNotFoundException unless hadoop-3.2 profile is enabled explicitly Key: SPARK-36067 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Created] (SPARK-36066) UTF8String trimAll() only can trim space but not ({@literal <=} ASCII 32)

2021-07-08 Thread liukai (Jira)
liukai created SPARK-36066: -- Summary: UTF8String trimAll() only can trim space but not ({@literal <=} ASCII 32) Key: SPARK-36066 URL: https://issues.apache.org/jira/browse/SPARK-36066 Project: Spark

[jira] [Assigned] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36001: Assignee: Xinrong Meng > Assume result's index to be disordered in tests with operations

[jira] [Resolved] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36001. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33274 [https://gi

[jira] [Created] (SPARK-36065) date_trunc returns incorrect output

2021-07-08 Thread Sumeet (Jira)
Sumeet created SPARK-36065: -- Summary: date_trunc returns incorrect output Key: SPARK-36065 URL: https://issues.apache.org/jira/browse/SPARK-36065 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-36058) Support replicasets/job API

2021-07-08 Thread Klaus Ma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377731#comment-17377731 ] Klaus Ma commented on SPARK-36058: -- Volcano already support all API in k8s upstream; Po

[jira] [Resolved] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36062. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33273 [https://gi

[jira] [Assigned] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36062: Assignee: Takuya Ueshin > Try to capture faulthanlder when a Python worker crashes. > ---

[jira] [Updated] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

2021-07-08 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-36032: -- Description: At {{initialPlan}} we may remove some Spark Plan with  {{queryStagePreparationRules}}, if

[jira] [Updated] (SPARK-36032) Use inputPlan instead of currentPhysicalPlan to initialize logical link

2021-07-08 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-36032: -- Summary: Use inputPlan instead of currentPhysicalPlan to initialize logical link (was: RemoveRedundan

[jira] [Resolved] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36051. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33266 [https://gi

[jira] [Assigned] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36051: Assignee: Hyukjin Kwon > Remove automatic update of documentation build in the guides > -

[jira] [Commented] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377655#comment-17377655 ] Apache Spark commented on SPARK-36064: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36064: Assignee: (was: Apache Spark) > Manage InternalField more in DataTypeOps. > -

[jira] [Assigned] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36064: Assignee: Apache Spark > Manage InternalField more in DataTypeOps. >

[jira] [Commented] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377654#comment-17377654 ] Apache Spark commented on SPARK-36064: -- User 'ueshin' has created a pull request fo

[jira] [Created] (SPARK-36064) Manage InternalField more in DataTypeOps.

2021-07-08 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36064: - Summary: Manage InternalField more in DataTypeOps. Key: SPARK-36064 URL: https://issues.apache.org/jira/browse/SPARK-36064 Project: Spark Issue Type: Sub-t

[jira] [Created] (SPARK-36063) Optimize OneRowRelation subqueries

2021-07-08 Thread Allison Wang (Jira)
Allison Wang created SPARK-36063: Summary: Optimize OneRowRelation subqueries Key: SPARK-36063 URL: https://issues.apache.org/jira/browse/SPARK-36063 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377609#comment-17377609 ] Apache Spark commented on SPARK-36001: -- User 'xinrong-databricks' has created a pul

[jira] [Commented] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377608#comment-17377608 ] Apache Spark commented on SPARK-36001: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36001: Assignee: (was: Apache Spark) > Assume result's index to be disordered in tests with

[jira] [Assigned] (SPARK-36001) Assume result's index to be disordered in tests with operations on different Series

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36001: Assignee: Apache Spark > Assume result's index to be disordered in tests with operations

[jira] [Commented] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377597#comment-17377597 ] Apache Spark commented on SPARK-36062: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36062: Assignee: Apache Spark > Try to capture faulthanlder when a Python worker crashes. >

[jira] [Assigned] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36062: Assignee: (was: Apache Spark) > Try to capture faulthanlder when a Python worker cras

[jira] [Created] (SPARK-36062) Try to capture faulthanlder when a Python worker crashes.

2021-07-08 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-36062: - Summary: Try to capture faulthanlder when a Python worker crashes. Key: SPARK-36062 URL: https://issues.apache.org/jira/browse/SPARK-36062 Project: Spark I

[jira] [Commented] (SPARK-36035) Adjust `test_astype`, `test_neg` for old pandas versions

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377590#comment-17377590 ] Apache Spark commented on SPARK-36035: -- User 'xinrong-databricks' has created a pul

[jira] [Resolved] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36049. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33265 [https://github.com

[jira] [Assigned] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36049: Assignee: angerszhu > Remove IntervalUnit in code > --- > >

[jira] [Resolved] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36054. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33268 [https://github.com

[jira] [Resolved] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-08 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35340. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue resolved

[jira] [Resolved] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36055. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33269 [https://github.com

[jira] [Resolved] (SPARK-36050) Spark doesn’t support reading/writing TIMESTAMP_NTZ with ORC

2021-07-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36050. Resolution: Not A Problem > Spark doesn’t support reading/writing TIMESTAMP_NTZ with ORC >

[jira] [Commented] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377545#comment-17377545 ] Apache Spark commented on SPARK-36056: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377544#comment-17377544 ] Apache Spark commented on SPARK-36056: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36056: Assignee: Apache Spark > Combine readBatch and readIntegers in VectorizedRleValuesReader

[jira] [Assigned] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36056: Assignee: (was: Apache Spark) > Combine readBatch and readIntegers in VectorizedRleVa

[jira] [Created] (SPARK-36061) Create a PodGroup with user specified minimum resources required

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36061: Summary: Create a PodGroup with user specified minimum resources required Key: SPARK-36061 URL: https://issues.apache.org/jira/browse/SPARK-36061 Project: Spark

[jira] [Assigned] (SPARK-35743) Improve Parquet vectorized reader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35743: Assignee: (was: Apache Spark) > Improve Parquet vectorized reader > -

[jira] [Commented] (SPARK-35743) Improve Parquet vectorized reader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377536#comment-17377536 ] Apache Spark commented on SPARK-35743: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-35743) Improve Parquet vectorized reader

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35743: Assignee: Apache Spark > Improve Parquet vectorized reader >

[jira] [Created] (SPARK-36060) Support backing off dynamic allocation increases if resources are "stuck"

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36060: Summary: Support backing off dynamic allocation increases if resources are "stuck" Key: SPARK-36060 URL: https://issues.apache.org/jira/browse/SPARK-36060 Project: Sp

[jira] [Created] (SPARK-36058) Support replicasets/job API

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36058: Summary: Support replicasets/job API Key: SPARK-36058 URL: https://issues.apache.org/jira/browse/SPARK-36058 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-36059) Add the ability to specify a scheduler & queue

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36059: Summary: Add the ability to specify a scheduler & queue Key: SPARK-36059 URL: https://issues.apache.org/jira/browse/SPARK-36059 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-36057) Support volcano/alternative schedulers

2021-07-08 Thread Holden Karau (Jira)
Holden Karau created SPARK-36057: Summary: Support volcano/alternative schedulers Key: SPARK-36057 URL: https://issues.apache.org/jira/browse/SPARK-36057 Project: Spark Issue Type: Improvemen

[jira] [Commented] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377528#comment-17377528 ] Apache Spark commented on SPARK-35956: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35956: Assignee: Holden Karau (was: Apache Spark) > Support auto-assigning labels to less impor

[jira] [Assigned] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35956: Assignee: Apache Spark (was: Holden Karau) > Support auto-assigning labels to less impor

[jira] [Commented] (SPARK-35956) Support auto-assigning labels to less important pods (e.g. decommissioning pods)

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377527#comment-17377527 ] Apache Spark commented on SPARK-35956: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-36012) Lost the null flag info when show create table

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36012: --- Assignee: PengLei > Lost the null flag info when show create table > --

[jira] [Resolved] (SPARK-36012) Lost the null flag info when show create table

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36012. - Resolution: Fixed Issue resolved by pull request 33219 [https://github.com/apache/spark/pull/332

[jira] [Assigned] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36055: Assignee: Apache Spark (was: Gengliang Wang) > Assign pretty SQL string to TimestampNTZ

[jira] [Assigned] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36055: Assignee: Gengliang Wang (was: Apache Spark) > Assign pretty SQL string to TimestampNTZ

[jira] [Commented] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377507#comment-17377507 ] Apache Spark commented on SPARK-36055: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-36056) Combine readBatch and readIntegers in VectorizedRleValuesReader

2021-07-08 Thread Chao Sun (Jira)
Chao Sun created SPARK-36056: Summary: Combine readBatch and readIntegers in VectorizedRleValuesReader Key: SPARK-36056 URL: https://issues.apache.org/jira/browse/SPARK-36056 Project: Spark Issu

[jira] [Created] (SPARK-36055) Assign pretty SQL string to TimestampNTZ literals

2021-07-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36055: -- Summary: Assign pretty SQL string to TimestampNTZ literals Key: SPARK-36055 URL: https://issues.apache.org/jira/browse/SPARK-36055 Project: Spark Issue T

[jira] [Resolved] (SPARK-35874) AQE Shuffle should wait for its subqueries to finish before materializing

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35874. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33058 [https://gith

[jira] [Assigned] (SPARK-35874) AQE Shuffle should wait for its subqueries to finish before materializing

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35874: --- Assignee: Wenchen Fan > AQE Shuffle should wait for its subqueries to finish before materia

[jira] [Assigned] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35958: --- Assignee: Karen Feng > Refactor SparkError.scala to SparkThrowable.java > -

[jira] [Resolved] (SPARK-35958) Refactor SparkError.scala to SparkThrowable.java

2021-07-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35958. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33164 [https://gith

[jira] [Assigned] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36054: Assignee: Apache Spark (was: Gengliang Wang) > Support group by TimestampNTZ column > --

[jira] [Commented] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377399#comment-17377399 ] Apache Spark commented on SPARK-36054: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36054: Assignee: Gengliang Wang (was: Apache Spark) > Support group by TimestampNTZ column > --

[jira] [Created] (SPARK-36054) Support group by TimestampNTZ column

2021-07-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36054: -- Summary: Support group by TimestampNTZ column Key: SPARK-36054 URL: https://issues.apache.org/jira/browse/SPARK-36054 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36053: Assignee: (was: Apache Spark) > Unify write exception and delete abnormal disk block

[jira] [Commented] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377359#comment-17377359 ] Apache Spark commented on SPARK-36053: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36053: Assignee: Apache Spark > Unify write exception and delete abnormal disk block object file

[jira] [Updated] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-36053: - Description: There are some duplicate codes related to cleaning up failed files after DiskBlockObjectWr

[jira] [Resolved] (SPARK-35988) The implementation for RocksDBStateStoreProvider

2021-07-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-35988. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33187 [https://gi

[jira] [Created] (SPARK-36053) Unify write exception and delete abnormal disk block object file process

2021-07-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-36053: Summary: Unify write exception and delete abnormal disk block object file process Key: SPARK-36053 URL: https://issues.apache.org/jira/browse/SPARK-36053 Project: Spark

[jira] [Assigned] (SPARK-35988) The implementation for RocksDBStateStoreProvider

2021-07-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-35988: Assignee: Yuanjian Li > The implementation for RocksDBStateStoreProvider > --

[jira] [Updated] (SPARK-36052) Introduce pending pod limit for Spark on K8s

2021-07-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36052: --- Description: Introduce pending POD limit for Spark on K8S as K8S scheduler could be

[jira] [Updated] (SPARK-36052) Introduce pending pod limit for Spark on K8s

2021-07-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36052: --- Description: Introduce a new configuration to limit the number of pending PODs for S

[jira] [Created] (SPARK-36052) Introduce pending pod limit for Spark on K8s

2021-07-08 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-36052: -- Summary: Introduce pending pod limit for Spark on K8s Key: SPARK-36052 URL: https://issues.apache.org/jira/browse/SPARK-36052 Project: Spark Issu

[jira] [Resolved] (SPARK-36043) Add end-to-end tests with default timestamp type as TIMESTAMP_NTZ

2021-07-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36043. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33259 [https:

[jira] [Commented] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377318#comment-17377318 ] Apache Spark commented on SPARK-36051: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36051: Assignee: (was: Apache Spark) > Remove automatic update of documentation build in the

[jira] [Commented] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377316#comment-17377316 ] Apache Spark commented on SPARK-36051: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36051: Assignee: Apache Spark > Remove automatic update of documentation build in the guides > -

[jira] [Updated] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36051: - Description: At https://github.com/apache/spark/tree/master/docs#automatically-rebuilding-api-d

[jira] [Updated] (SPARK-36051) Remove automatic update of documentation build in the guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36051: - Summary: Remove automatic update of documentation build in the guides (was: Add the detection o

[jira] [Commented] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377287#comment-17377287 ] Apache Spark commented on SPARK-36049: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36049: Assignee: Apache Spark > Remove IntervalUnit in code > --- > >

[jira] [Commented] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377289#comment-17377289 ] Apache Spark commented on SPARK-36049: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36049) Remove IntervalUnit in code

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36049: Assignee: (was: Apache Spark) > Remove IntervalUnit in code > ---

[jira] [Updated] (SPARK-36051) Add the detection of .rst files into documentation build guides

2021-07-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36051: - Priority: Trivial (was: Major) > Add the detection of .rst files into documentation build guide

[jira] [Created] (SPARK-36051) Add the detection of .rst files into documentation build guides

2021-07-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-36051: Summary: Add the detection of .rst files into documentation build guides Key: SPARK-36051 URL: https://issues.apache.org/jira/browse/SPARK-36051 Project: Spark

[jira] [Assigned] (SPARK-36050) Spark doesn’t support reading/writing TIMESTAMP_NTZ with ORC

2021-07-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36050: Assignee: Gengliang Wang (was: Apache Spark) > Spark doesn’t support reading/writing TIM

  1   2   >