[jira] [Assigned] (SPARK-38470) Use error classes in org.apache.spark.partial

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38470: Assignee: (was: Apache Spark) > Use error classes in org.apache.spark.partial >

[jira] [Commented] (SPARK-38470) Use error classes in org.apache.spark.partial

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536956#comment-17536956 ] Apache Spark commented on SPARK-38470: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-38470) Use error classes in org.apache.spark.partial

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38470: Assignee: Apache Spark > Use error classes in org.apache.spark.partial >

[jira] [Updated] (SPARK-39173) The error message is different if disable broadcast join

2022-05-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39173: Description: How to reproduce this issue: {code:scala} sql( """ |CREATE TABLE

[jira] [Updated] (SPARK-39185) Convert *AlreadyExistsException to use error classes

2022-05-13 Thread Serge Rielau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-39185: - Summary: Convert *AlreadyExistsException to use error classes (was: t *AlreadyExistsException

[jira] [Created] (SPARK-39185) t *AlreadyExistsException to use error classes

2022-05-13 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-39185: Summary: t *AlreadyExistsException to use error classes Key: SPARK-39185 URL: https://issues.apache.org/jira/browse/SPARK-39185 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-05-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536913#comment-17536913 ] Bruce Robbins commented on SPARK-39184: --- I will take a stab at fixing this when the fix for

[jira] [Created] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

2022-05-13 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39184: - Summary: ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones Key: SPARK-39184 URL: https://issues.apache.org/jira/browse/SPARK-39184

[jira] [Assigned] (SPARK-37544) sequence over dates with month interval is producing incorrect results

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37544: Assignee: (was: Apache Spark) > sequence over dates with month interval is producing

[jira] [Assigned] (SPARK-37544) sequence over dates with month interval is producing incorrect results

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37544: Assignee: Apache Spark > sequence over dates with month interval is producing incorrect

[jira] [Commented] (SPARK-37544) sequence over dates with month interval is producing incorrect results

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536910#comment-17536910 ] Apache Spark commented on SPARK-37544: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-37544) sequence over dates with month interval is producing incorrect results

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536911#comment-17536911 ] Apache Spark commented on SPARK-37544: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39168: Assignee: Apache Spark > Consider all values in a python list when inferring schema >

[jira] [Assigned] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39168: Assignee: (was: Apache Spark) > Consider all values in a python list when inferring

[jira] [Commented] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536889#comment-17536889 ] Apache Spark commented on SPARK-39168: -- User 'physinet' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Brian Schaefer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536627#comment-17536627 ] Brian Schaefer edited comment on SPARK-39168 at 5/13/22 8:32 PM: - Thanks

[jira] [Comment Edited] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Brian Schaefer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536627#comment-17536627 ] Brian Schaefer edited comment on SPARK-39168 at 5/13/22 8:32 PM: - Thanks

[jira] [Resolved] (SPARK-38739) Test the error class: INVALID_INPUT_SYNTAX_FOR_NUMERIC_TYPE

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38739. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36493

[jira] [Assigned] (SPARK-38739) Test the error class: INVALID_INPUT_SYNTAX_FOR_NUMERIC_TYPE

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38739: Assignee: panbingkun > Test the error class: INVALID_INPUT_SYNTAX_FOR_NUMERIC_TYPE >

[jira] [Commented] (SPARK-37544) sequence over dates with month interval is producing incorrect results

2022-05-13 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536865#comment-17536865 ] Bruce Robbins commented on SPARK-37544: --- Reproduction of the bug depends on your time zone. It all

[jira] [Resolved] (SPARK-39182) Upgrade to Arrow 8.0.0

2022-05-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39182. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36543

[jira] [Assigned] (SPARK-39182) Upgrade to Arrow 8.0.0

2022-05-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39182: - Assignee: Dongjoon Hyun > Upgrade to Arrow 8.0.0 > -- > >

[jira] [Commented] (SPARK-39182) Upgrade to Arrow 8.0.0

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536801#comment-17536801 ] Apache Spark commented on SPARK-39182: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39182) Upgrade to Arrow 8.0.0

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39182: Assignee: (was: Apache Spark) > Upgrade to Arrow 8.0.0 > -- > >

[jira] [Assigned] (SPARK-39182) Upgrade to Arrow 8.0.0

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39182: Assignee: Apache Spark > Upgrade to Arrow 8.0.0 > -- > >

[jira] [Assigned] (SPARK-39183) Upgrade Apache Xerces Java to 2.12.2

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39183: Assignee: (was: Apache Spark) > Upgrade Apache Xerces Java to 2.12.2 >

[jira] [Commented] (SPARK-39183) Upgrade Apache Xerces Java to 2.12.2

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536800#comment-17536800 ] Apache Spark commented on SPARK-39183: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Commented] (SPARK-39183) Upgrade Apache Xerces Java to 2.12.2

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536797#comment-17536797 ] Apache Spark commented on SPARK-39183: -- User 'bjornjorgensen' has created a pull request for this

[jira] [Commented] (SPARK-39182) Upgrade to Arrow 8.0.0

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536798#comment-17536798 ] Apache Spark commented on SPARK-39182: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39183) Upgrade Apache Xerces Java to 2.12.2

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39183: Assignee: Apache Spark > Upgrade Apache Xerces Java to 2.12.2 >

[jira] [Assigned] (SPARK-39181) SessionCatalog.reset should not drop temp functions twice

2022-05-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39181: - Assignee: Wenchen Fan > SessionCatalog.reset should not drop temp functions twice >

[jira] [Resolved] (SPARK-39181) SessionCatalog.reset should not drop temp functions twice

2022-05-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39181. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36542

[jira] [Created] (SPARK-39182) Upgrade to Arrow 8.0.0

2022-05-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39182: - Summary: Upgrade to Arrow 8.0.0 Key: SPARK-39182 URL: https://issues.apache.org/jira/browse/SPARK-39182 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-39183) Upgrade Apache Xerces Java to 2.12.2

2022-05-13 Thread Jira
Bjørn Jørgensen created SPARK-39183: --- Summary: Upgrade Apache Xerces Java to 2.12.2 Key: SPARK-39183 URL: https://issues.apache.org/jira/browse/SPARK-39183 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-38751) Test the error class: UNRECOGNIZED_SQL_TYPE

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38751. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36463

[jira] [Assigned] (SPARK-38751) Test the error class: UNRECOGNIZED_SQL_TYPE

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38751: Assignee: panbingkun > Test the error class: UNRECOGNIZED_SQL_TYPE >

[jira] [Assigned] (SPARK-39138) Add ANSI general value specification and function -user

2022-05-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-39138: Assignee: Kent Yao > Add ANSI general value specification and function -user >

[jira] [Resolved] (SPARK-39138) Add ANSI general value specification and function -user

2022-05-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-39138. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36497

[jira] [Comment Edited] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Brian Schaefer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536627#comment-17536627 ] Brian Schaefer edited comment on SPARK-39168 at 5/13/22 3:23 PM: - Thanks

[jira] [Assigned] (SPARK-39181) SessionCatalog.reset should not drop temp functions twice

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39181: Assignee: (was: Apache Spark) > SessionCatalog.reset should not drop temp functions

[jira] [Assigned] (SPARK-39181) SessionCatalog.reset should not drop temp functions twice

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39181: Assignee: Apache Spark > SessionCatalog.reset should not drop temp functions twice >

[jira] [Commented] (SPARK-39181) SessionCatalog.reset should not drop temp functions twice

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536712#comment-17536712 ] Apache Spark commented on SPARK-39181: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-39181) SessionCatalog.reset should not drop temp functions twice

2022-05-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-39181: --- Summary: SessionCatalog.reset should not drop temp functions twice Key: SPARK-39181 URL: https://issues.apache.org/jira/browse/SPARK-39181 Project: Spark

[jira] [Resolved] (SPARK-39157) H2Dialect should override getJDBCType so as make the data type is correct

2022-05-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39157. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36516

[jira] [Assigned] (SPARK-39157) H2Dialect should override getJDBCType so as make the data type is correct

2022-05-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39157: --- Assignee: jiaan.geng > H2Dialect should override getJDBCType so as make the data type is

[jira] [Assigned] (SPARK-39180) Simplify the planning of limit and offset

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39180: Assignee: Apache Spark > Simplify the planning of limit and offset >

[jira] [Commented] (SPARK-39180) Simplify the planning of limit and offset

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536658#comment-17536658 ] Apache Spark commented on SPARK-39180: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39180) Simplify the planning of limit and offset

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39180: Assignee: (was: Apache Spark) > Simplify the planning of limit and offset >

[jira] [Resolved] (SPARK-39178) When throw SparkFatalException, should show root cause too.

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39178. -- Fix Version/s: 3.3.0 Resolution: Fixed > When throw SparkFatalException, should show root

[jira] [Commented] (SPARK-39178) When throw SparkFatalException, should show root cause too.

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536648#comment-17536648 ] Max Gekk commented on SPARK-39178: -- Resolved by https://github.com/apache/spark/pull/36539 > When

[jira] [Created] (SPARK-39180) Simplify the planning of limit and offset

2022-05-13 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-39180: --- Summary: Simplify the planning of limit and offset Key: SPARK-39180 URL: https://issues.apache.org/jira/browse/SPARK-39180 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-39177) Provide query context on map key not exists error when WSCG is off

2022-05-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39177. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36538

[jira] [Updated] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39164: - Fix Version/s: 3.3.0 > Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in >

[jira] [Updated] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39164: - Affects Version/s: 3.3.0 > Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in >

[jira] [Comment Edited] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Brian Schaefer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536627#comment-17536627 ] Brian Schaefer edited comment on SPARK-39168 at 5/13/22 1:22 PM: - Thanks

[jira] [Comment Edited] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Brian Schaefer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536627#comment-17536627 ] Brian Schaefer edited comment on SPARK-39168 at 5/13/22 1:22 PM: - Thanks

[jira] [Assigned] (SPARK-38466) Use error classes in org.apache.spark.mapred

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38466: Assignee: (was: Apache Spark) > Use error classes in org.apache.spark.mapred >

[jira] [Commented] (SPARK-38466) Use error classes in org.apache.spark.mapred

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536632#comment-17536632 ] Apache Spark commented on SPARK-38466: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-38466) Use error classes in org.apache.spark.mapred

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38466: Assignee: Apache Spark > Use error classes in org.apache.spark.mapred >

[jira] [Commented] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-13 Thread Brian Schaefer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536627#comment-17536627 ] Brian Schaefer commented on SPARK-39168: Thanks for your support. I'm working on a PR, but need

[jira] [Resolved] (SPARK-39097) Improve the test coverage for pyspark/taskcontext.py

2022-05-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39097. -- Resolution: Won't Fix > Improve the test coverage for pyspark/taskcontext.py >

[jira] [Updated] (SPARK-39179) Improve the test coverage for pyspark/shuffle.py

2022-05-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39179: - Fix Version/s: (was: 3.4.0) > Improve the test coverage for pyspark/shuffle.py >

[jira] [Created] (SPARK-39179) Improve the test coverage for pyspark/shuffle.py

2022-05-13 Thread pralabhkumar (Jira)
pralabhkumar created SPARK-39179: Summary: Improve the test coverage for pyspark/shuffle.py Key: SPARK-39179 URL: https://issues.apache.org/jira/browse/SPARK-39179 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39179) Improve the test coverage for pyspark/shuffle.py

2022-05-13 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536555#comment-17536555 ] pralabhkumar commented on SPARK-39179: -- I am working on this .  > Improve the test coverage for

[jira] [Updated] (SPARK-39179) Improve the test coverage for pyspark/shuffle.py

2022-05-13 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pralabhkumar updated SPARK-39179: - Description: Improve the test coverage of shuffle.py (was: Improve the test coverage of

[jira] [Commented] (SPARK-39178) When throw SparkFatalException, should show root cause too.

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536540#comment-17536540 ] Apache Spark commented on SPARK-39178: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-39178) When throw SparkFatalException, should show root cause too.

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39178: Assignee: (was: Apache Spark) > When throw SparkFatalException, should show root

[jira] [Commented] (SPARK-39178) When throw SparkFatalException, should show root cause too.

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536539#comment-17536539 ] Apache Spark commented on SPARK-39178: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-39178) When throw SparkFatalException, should show root cause too.

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39178: Assignee: Apache Spark > When throw SparkFatalException, should show root cause too. >

[jira] [Created] (SPARK-39178) When throw SparkFatalException, should show root cause too.

2022-05-13 Thread angerszhu (Jira)
angerszhu created SPARK-39178: - Summary: When throw SparkFatalException, should show root cause too. Key: SPARK-39178 URL: https://issues.apache.org/jira/browse/SPARK-39178 Project: Spark Issue

[jira] [Updated] (SPARK-39165) Replace sys.error by IllegalStateException in Spark SQL

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39165: - Affects Version/s: 3.3.0 > Replace sys.error by IllegalStateException in Spark SQL >

[jira] [Updated] (SPARK-39165) Replace sys.error by IllegalStateException in Spark SQL

2022-05-13 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39165: - Fix Version/s: 3.3.0 > Replace sys.error by IllegalStateException in Spark SQL >

[jira] [Resolved] (SPARK-39175) Provide runtime error query context for Cast when WSCG is off

2022-05-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39175. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36535

[jira] [Updated] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer updated SPARK-39176: --- Labels: 3.0.1 PySpark WIndows datetime (was: ) > Pyspark failed to serialize dates before

[jira] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176 ] AnywalkerGISer deleted comment on SPARK-39176: was (Author: JIRAUSER289430): https://github.com/apache/spark/pull/36537 > Pyspark failed to serialize dates before 1970 in windows >

[jira] [Commented] (SPARK-39177) Provide query context on map key not exists error when WSCG is off

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536514#comment-17536514 ] Apache Spark commented on SPARK-39177: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536515#comment-17536515 ] Apache Spark commented on SPARK-39176: -- User 'AnywalkerGiser' has created a pull request for this

[jira] [Assigned] (SPARK-39177) Provide query context on map key not exists error when WSCG is off

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39177: Assignee: Apache Spark (was: Gengliang Wang) > Provide query context on map key not

[jira] [Assigned] (SPARK-39177) Provide query context on map key not exists error when WSCG is off

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39177: Assignee: Gengliang Wang (was: Apache Spark) > Provide query context on map key not

[jira] [Commented] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536511#comment-17536511 ] AnywalkerGISer commented on SPARK-39176: https://github.com/apache/spark/pull/36537 > Pyspark

[jira] [Resolved] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer resolved SPARK-39176. Resolution: Fixed > Pyspark failed to serialize dates before 1970 in windows >

[jira] [Reopened] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer reopened SPARK-39176: > Pyspark failed to serialize dates before 1970 in windows >

[jira] [Resolved] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer resolved SPARK-39176. Resolution: Fixed > Pyspark failed to serialize dates before 1970 in windows >

[jira] [Created] (SPARK-39177) Provide query context on map key not exists error when WSCG is off

2022-05-13 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39177: -- Summary: Provide query context on map key not exists error when WSCG is off Key: SPARK-39177 URL: https://issues.apache.org/jira/browse/SPARK-39177 Project:

[jira] [Updated] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer updated SPARK-39176: --- Description: h3. Fix problems with pyspark in Windows # Fixed datetime conversion to

[jira] [Comment Edited] (SPARK-27314) Deduplicate exprIds for Union.

2022-05-13 Thread tenglei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536503#comment-17536503 ] tenglei edited comment on SPARK-27314 at 5/13/22 8:33 AM: -- I note that this pr

[jira] [Commented] (SPARK-27314) Deduplicate exprIds for Union.

2022-05-13 Thread tenglei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536503#comment-17536503 ] tenglei commented on SPARK-27314: - I note that this pr refers to a temporary issue,but I'm not clear the

[jira] [Updated] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer updated SPARK-39176: --- Description: h3. Fix problems with pyspark in Windowns # Fixed datetime conversion to

[jira] [Updated] (SPARK-39176) Pyspark failed to serialize dates before 1970 in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer updated SPARK-39176: --- Summary: Pyspark failed to serialize dates before 1970 in windows (was: Fixed a problem

[jira] [Updated] (SPARK-39176) Fixed a problem with pyspark serializing pre-1970 datetime in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer updated SPARK-39176: --- Description: h3. Fix problems with pyspark in Windowns # Fixed datetime conversion to

[jira] [Resolved] (SPARK-39176) Fixed a problem with pyspark serializing pre-1970 datetime in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer resolved SPARK-39176. Resolution: Fixed > Fixed a problem with pyspark serializing pre-1970 datetime in windows

[jira] [Reopened] (SPARK-39176) Fixed a problem with pyspark serializing pre-1970 datetime in windows

2022-05-13 Thread AnywalkerGISer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AnywalkerGISer reopened SPARK-39176: > Fixed a problem with pyspark serializing pre-1970 datetime in windows >

[jira] [Created] (SPARK-39176) Fixed a problem with pyspark serializing pre-1970 datetime in windows

2022-05-13 Thread AnywalkerGISer (Jira)
AnywalkerGISer created SPARK-39176: -- Summary: Fixed a problem with pyspark serializing pre-1970 datetime in windows Key: SPARK-39176 URL: https://issues.apache.org/jira/browse/SPARK-39176 Project:

[jira] [Assigned] (SPARK-39159) Add new Dataset API for Offset

2022-05-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39159: --- Assignee: jiaan.geng > Add new Dataset API for Offset > -- > >

[jira] [Resolved] (SPARK-39159) Add new Dataset API for Offset

2022-05-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39159. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36519

[jira] [Assigned] (SPARK-39174) Catalogs loading swallows missing classname for ClassNotFoundException

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39174: Assignee: Apache Spark > Catalogs loading swallows missing classname for

[jira] [Assigned] (SPARK-39171) Unify the Cast expression

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39171: Assignee: Apache Spark > Unify the Cast expression > - > >

[jira] [Commented] (SPARK-39174) Catalogs loading swallows missing classname for ClassNotFoundException

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536470#comment-17536470 ] Apache Spark commented on SPARK-39174: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39174) Catalogs loading swallows missing classname for ClassNotFoundException

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39174: Assignee: (was: Apache Spark) > Catalogs loading swallows missing classname for

[jira] [Commented] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions

2022-05-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536471#comment-17536471 ] Apache Spark commented on SPARK-39164: -- User 'MaxGekk' has created a pull request for this issue:

  1   2   >