[jira] [Resolved] (SPARK-39166) Provide runtime error query context for Binary Arithmetic when WSCG is off

2022-05-12 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39166. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36525

[jira] [Assigned] (SPARK-39172) Remove outer join if all output come from streamed side and buffered side keys exist unique key

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39172: Assignee: (was: Apache Spark) > Remove outer join if all output come from streamed

[jira] [Commented] (SPARK-39172) Remove outer join if all output come from streamed side and buffered side keys exist unique key

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536428#comment-17536428 ] Apache Spark commented on SPARK-39172: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-39172) Remove outer join if all output come from streamed side and buffered side keys exist unique key

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39172: Assignee: Apache Spark > Remove outer join if all output come from streamed side and

[jira] [Updated] (SPARK-39173) The error message is different if disable broadcast join

2022-05-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39173: Description: How to reproduce this issue: {code:scala} Seq(-1, 10L).foreach {

[jira] [Updated] (SPARK-39173) The error message is different if disable broadcast join

2022-05-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39173: Description: How to reproduce this issue: {code:scala} Seq(-1, 10L).foreach {

[jira] [Created] (SPARK-39173) The error message is different if disable broadcast join

2022-05-12 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39173: --- Summary: The error message is different if disable broadcast join Key: SPARK-39173 URL: https://issues.apache.org/jira/browse/SPARK-39173 Project: Spark Issue

[jira] [Assigned] (SPARK-28516) Data Type Formatting Functions: `to_char`

2022-05-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28516: --- Assignee: Daniel > Data Type Formatting Functions: `to_char` >

[jira] [Resolved] (SPARK-28516) Data Type Formatting Functions: `to_char`

2022-05-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28516. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36365

[jira] [Updated] (SPARK-39172) Remove outer join if all output come from streamed side and buffered side keys exist unique key

2022-05-12 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-39172: -- Summary: Remove outer join if all output come from streamed side and buffered side keys exist unique

[jira] [Assigned] (SPARK-39102) Replace the usage of guava's Files.createTempDir() with java.nio.file.Files.createTempDirectory()

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39102: Assignee: Apache Spark > Replace the usage of guava's Files.createTempDir() with >

[jira] [Assigned] (SPARK-39102) Replace the usage of guava's Files.createTempDir() with java.nio.file.Files.createTempDirectory()

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39102: Assignee: (was: Apache Spark) > Replace the usage of guava's Files.createTempDir()

[jira] [Created] (SPARK-39172) Remove outer join if all output come from streamed side and buffered side keys exist unique

2022-05-12 Thread XiDuo You (Jira)
XiDuo You created SPARK-39172: - Summary: Remove outer join if all output come from streamed side and buffered side keys exist unique Key: SPARK-39172 URL: https://issues.apache.org/jira/browse/SPARK-39172

[jira] [Commented] (SPARK-39102) Replace the usage of guava's Files.createTempDir() with java.nio.file.Files.createTempDirectory()

2022-05-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536413#comment-17536413 ] Yang Jie commented on SPARK-39102: -- Give a pr https://github.com/apache/spark/pull/36529 > Replace the

[jira] [Updated] (SPARK-39171) Unify the Cast expression

2022-05-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39171: --- Issue Type: Improvement (was: New Feature) > Unify the Cast expression > -

[jira] [Created] (SPARK-39171) Unify the Cast expression

2022-05-12 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39171: -- Summary: Unify the Cast expression Key: SPARK-39171 URL: https://issues.apache.org/jira/browse/SPARK-39171 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-39041) Mapping Spark Query ResultSet/Schema to TRowSet/TTableSchema directly

2022-05-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-39041. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36373

[jira] [Assigned] (SPARK-39041) Mapping Spark Query ResultSet/Schema to TRowSet/TTableSchema directly

2022-05-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-39041: Assignee: Kent Yao > Mapping Spark Query ResultSet/Schema to TRowSet/TTableSchema directly >

[jira] [Resolved] (SPARK-38850) Upgrade Kafka to 3.2.0

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38850. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36526

[jira] [Assigned] (SPARK-38850) Upgrade Kafka to 3.2.0

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38850: - Assignee: Dongjoon Hyun > Upgrade Kafka to 3.2.0 > -- > >

[jira] [Created] (SPARK-39170) ImportError when creating pyspark.pandas document "Supported APIs" if pandas version is low.

2022-05-12 Thread Hyunwoo Park (Jira)
Hyunwoo Park created SPARK-39170: Summary: ImportError when creating pyspark.pandas document "Supported APIs" if pandas version is low. Key: SPARK-39170 URL: https://issues.apache.org/jira/browse/SPARK-39170

[jira] [Updated] (SPARK-39144) Nested subquery expressions deduplicate relations should be done bottom up

2022-05-12 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-39144: - Description: When we have nested subquery expressions, there is a chance that deduplicate relations

[jira] [Updated] (SPARK-39144) Nested subquery expressions deduplicate relations should be done bottom up

2022-05-12 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-39144: - Summary: Nested subquery expressions deduplicate relations should be done bottom up (was: Spark SQL

[jira] [Assigned] (SPARK-39169) Optimize FIRST when used as a single aggregate function

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39169: Assignee: Apache Spark > Optimize FIRST when used as a single aggregate function >

[jira] [Commented] (SPARK-39169) Optimize FIRST when used as a single aggregate function

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536390#comment-17536390 ] Apache Spark commented on SPARK-39169: -- User 'vli-databricks' has created a pull request for this

[jira] [Assigned] (SPARK-39169) Optimize FIRST when used as a single aggregate function

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39169: Assignee: (was: Apache Spark) > Optimize FIRST when used as a single aggregate

[jira] [Commented] (SPARK-39142) Type overloads in `pandas_udf`

2022-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536388#comment-17536388 ] Hyukjin Kwon commented on SPARK-39142: -- [~tigerhawkvok], Are you interested in submitting a PR?

[jira] [Updated] (SPARK-38397) Support Kueue: K8s-native Job Queueing

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38397: -- Description: There are several ways to run Spark on K8s including vanilla `spark-submit`

[jira] [Updated] (SPARK-38850) Upgrade Kafka to 3.2.0

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38850: -- Affects Version/s: 3.4.0 (was: 3.3.0) > Upgrade Kafka to 3.2.0 >

[jira] [Commented] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536385#comment-17536385 ] Hyukjin Kwon commented on SPARK-39168: -- Sounds making sense to me. Are you interested in submitting

[jira] [Updated] (SPARK-39169) Optimize FIRST when used as a single aggregate function

2022-05-12 Thread Vitalii Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Li updated SPARK-39169: --- Summary: Optimize FIRST when used as a single aggregate function (was: Optimize FIRST when used as

[jira] [Updated] (SPARK-39169) Optimize FIRST when used as non-aggregate

2022-05-12 Thread Vitalii Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Li updated SPARK-39169: --- Description: When `FIRST` is a single aggregate function in `Aggregate` we could either rewrite

[jira] [Commented] (SPARK-38850) Upgrade Kafka to 3.2.0

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536381#comment-17536381 ] Apache Spark commented on SPARK-38850: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39169) Optimize FIRST when used as non-aggregate

2022-05-12 Thread Vitalii Li (Jira)
Vitalii Li created SPARK-39169: -- Summary: Optimize FIRST when used as non-aggregate Key: SPARK-39169 URL: https://issues.apache.org/jira/browse/SPARK-39169 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-34930) Install PyArrow and pandas on Jenkins

2022-05-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34930. -- Resolution: Invalid We dropped Jenkins. > Install PyArrow and pandas on Jenkins >

[jira] [Updated] (SPARK-38850) Upgrade Kafka to 3.1.1

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38850: -- Issue Type: Improvement (was: Bug) > Upgrade Kafka to 3.1.1 > -- > >

[jira] [Updated] (SPARK-38850) Upgrade Kafka to 3.2.0

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38850: -- Summary: Upgrade Kafka to 3.2.0 (was: Upgrade Kafka to 3.1.1) > Upgrade Kafka to 3.2.0 >

[jira] [Resolved] (SPARK-39160) Remove workaround for ARROW-1948

2022-05-12 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-39160. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36518

[jira] [Assigned] (SPARK-39160) Remove workaround for ARROW-1948

2022-05-12 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-39160: Assignee: Cheng Pan > Remove workaround for ARROW-1948 >

[jira] [Resolved] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions

2022-05-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39164. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36500

[jira] [Updated] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-12 Thread Brian Schaefer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Schaefer updated SPARK-39168: --- Description: Schema inference fails on the following case: {code:python} >>> data = [{"a":

[jira] [Resolved] (SPARK-39145) CLONE - SPIP: Public APIs for extended Columnar Processing Support

2022-05-12 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved SPARK-39145. - Resolution: Duplicate Closing this as a duplicate.. > CLONE - SPIP: Public APIs for extended

[jira] [Resolved] (SPARK-39161) Upgrade rocksdbjni to 7.2.2

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39161. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36522

[jira] [Assigned] (SPARK-39161) Upgrade rocksdbjni to 7.2.2

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39161: - Assignee: Yang Jie > Upgrade rocksdbjni to 7.2.2 > --- > >

[jira] [Updated] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36837: -- Parent: (was: SPARK-33772) Issue Type: Improvement (was: Sub-task) > Upgrade

[jira] [Updated] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36837: -- Fix Version/s: 3.4.0 (was: 3.3.0) > Upgrade Kafka to 3.1.0 >

[jira] [Updated] (SPARK-36837) Upgrade Kafka to 3.1.0

2022-05-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36837: -- Affects Version/s: 3.4.0 (was: 3.3.0) > Upgrade Kafka to 3.1.0 >

[jira] [Created] (SPARK-39167) Throw an exception w/ an error class for multiple rows from a subquery used as an expression

2022-05-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-39167: Summary: Throw an exception w/ an error class for multiple rows from a subquery used as an expression Key: SPARK-39167 URL: https://issues.apache.org/jira/browse/SPARK-39167

[jira] [Created] (SPARK-39168) Consider all values in a python list when inferring schema

2022-05-12 Thread Brian Schaefer (Jira)
Brian Schaefer created SPARK-39168: -- Summary: Consider all values in a python list when inferring schema Key: SPARK-39168 URL: https://issues.apache.org/jira/browse/SPARK-39168 Project: Spark

[jira] [Resolved] (SPARK-39165) Replace sys.error by IllegalStateException in Spark SQL

2022-05-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39165. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36524

[jira] [Assigned] (SPARK-39165) Replace sys.error by IllegalStateException in Spark SQL

2022-05-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39165: Assignee: Max Gekk > Replace sys.error by IllegalStateException in Spark SQL >

[jira] [Updated] (SPARK-39166) Provide runtime error query context for Binary Arithmetic when WSCG is off

2022-05-12 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39166: --- Description: Currently, for most of the cases, the project

[jira] [Commented] (SPARK-39166) Provide runtime error query context for Binary Arithmetic when WSCG is off

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536175#comment-17536175 ] Apache Spark commented on SPARK-39166: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-39166) Provide runtime error query context for Binary Arithmetic when WSCG is off

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536174#comment-17536174 ] Apache Spark commented on SPARK-39166: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-39166) Provide runtime error query context for Binary Arithmetic when WSCG is off

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39166: Assignee: Apache Spark (was: Gengliang Wang) > Provide runtime error query context for

[jira] [Assigned] (SPARK-39166) Provide runtime error query context for Binary Arithmetic when WSCG is off

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39166: Assignee: Gengliang Wang (was: Apache Spark) > Provide runtime error query context for

[jira] [Created] (SPARK-39166) Provide runtime error query context for Binary Arithmetic when WSCG is off

2022-05-12 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39166: -- Summary: Provide runtime error query context for Binary Arithmetic when WSCG is off Key: SPARK-39166 URL: https://issues.apache.org/jira/browse/SPARK-39166

[jira] [Assigned] (SPARK-39165) Replace sys.error by IllegalStateException in Spark SQL

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39165: Assignee: (was: Apache Spark) > Replace sys.error by IllegalStateException in Spark

[jira] [Assigned] (SPARK-39165) Replace sys.error by IllegalStateException in Spark SQL

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39165: Assignee: Apache Spark > Replace sys.error by IllegalStateException in Spark SQL >

[jira] [Commented] (SPARK-39165) Replace sys.error by IllegalStateException in Spark SQL

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536101#comment-17536101 ] Apache Spark commented on SPARK-39165: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-39165) Replace sys.error by IllegalStateException in Spark SQL

2022-05-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-39165: Summary: Replace sys.error by IllegalStateException in Spark SQL Key: SPARK-39165 URL: https://issues.apache.org/jira/browse/SPARK-39165 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536047#comment-17536047 ] Apache Spark commented on SPARK-39164: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39164: Assignee: Apache Spark (was: Max Gekk) > Wrap asserts/illegal state exceptions by the

[jira] [Assigned] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39164: Assignee: Max Gekk (was: Apache Spark) > Wrap asserts/illegal state exceptions by the

[jira] [Commented] (SPARK-37956) Add Java and Python examples to the Parquet encryption feature documentation

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536046#comment-17536046 ] Apache Spark commented on SPARK-37956: -- User 'andersonm-ibm' has created a pull request for this

[jira] [Commented] (SPARK-37956) Add Java and Python examples to the Parquet encryption feature documentation

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536045#comment-17536045 ] Apache Spark commented on SPARK-37956: -- User 'andersonm-ibm' has created a pull request for this

[jira] [Updated] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions

2022-05-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39164: - Summary: Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception in actions (was: Wrap

[jira] [Created] (SPARK-39164) Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception

2022-05-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-39164: Summary: Wrap asserts/illegal state exceptions by the INTERNAL_ERROR exception Key: SPARK-39164 URL: https://issues.apache.org/jira/browse/SPARK-39164 Project: Spark

[jira] [Updated] (SPARK-39163) Throw an exception w/ error class for an invalid bucket file

2022-05-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39163: - Description: Replace IllegalStateException by Spark's exception w/ an error class there

[jira] [Created] (SPARK-39163) Throw an exception w/ error class for an invalid bucket file

2022-05-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-39163: Summary: Throw an exception w/ error class for an invalid bucket file Key: SPARK-39163 URL: https://issues.apache.org/jira/browse/SPARK-39163 Project: Spark Issue

[jira] [Commented] (SPARK-39161) Upgrade rocksdbjni to 7.2.2

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536020#comment-17536020 ] Apache Spark commented on SPARK-39161: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39161) Upgrade rocksdbjni to 7.2.2

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39161: Assignee: Apache Spark > Upgrade rocksdbjni to 7.2.2 > --- > >

[jira] [Assigned] (SPARK-39161) Upgrade rocksdbjni to 7.2.2

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39161: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.2.2 >

[jira] [Assigned] (SPARK-39162) Jdbc dialect should decide which function could be pushed down.

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39162: Assignee: Apache Spark > Jdbc dialect should decide which function could be pushed down.

[jira] [Assigned] (SPARK-39162) Jdbc dialect should decide which function could be pushed down.

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39162: Assignee: (was: Apache Spark) > Jdbc dialect should decide which function could be

[jira] [Commented] (SPARK-39162) Jdbc dialect should decide which function could be pushed down.

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17536016#comment-17536016 ] Apache Spark commented on SPARK-39162: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-39162) Jdbc dialect should decide which function could be pushed down.

2022-05-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39162: --- Description: Regardless of whether the functions are ANSI or not, most databases are actually

[jira] [Created] (SPARK-39162) Jdbc dialect should decide which function could be pushed down.

2022-05-12 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39162: -- Summary: Jdbc dialect should decide which function could be pushed down. Key: SPARK-39162 URL: https://issues.apache.org/jira/browse/SPARK-39162 Project: Spark

[jira] [Created] (SPARK-39161) Upgrade rocksdbjni to 7.2.2

2022-05-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-39161: Summary: Upgrade rocksdbjni to 7.2.2 Key: SPARK-39161 URL: https://issues.apache.org/jira/browse/SPARK-39161 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38633) Support push down Cast to JDBC data source V2

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17535941#comment-17535941 ] Apache Spark commented on SPARK-38633: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-39159) Add new Dataset API for Offset

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17535909#comment-17535909 ] Apache Spark commented on SPARK-39159: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-39159) Add new Dataset API for Offset

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17535908#comment-17535908 ] Apache Spark commented on SPARK-39159: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39159) Add new Dataset API for Offset

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39159: Assignee: (was: Apache Spark) > Add new Dataset API for Offset >

[jira] [Commented] (SPARK-39160) Remove workaround for ARROW-1948

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17535907#comment-17535907 ] Apache Spark commented on SPARK-39160: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39159) Add new Dataset API for Offset

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39159: Assignee: Apache Spark > Add new Dataset API for Offset > --

[jira] [Assigned] (SPARK-39160) Remove workaround for ARROW-1948

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39160: Assignee: Apache Spark > Remove workaround for ARROW-1948 >

[jira] [Assigned] (SPARK-39160) Remove workaround for ARROW-1948

2022-05-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39160: Assignee: (was: Apache Spark) > Remove workaround for ARROW-1948 >

[jira] [Created] (SPARK-39160) Remove workaround for ARROW-1948

2022-05-12 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-39160: - Summary: Remove workaround for ARROW-1948 Key: SPARK-39160 URL: https://issues.apache.org/jira/browse/SPARK-39160 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-39086) Support UDT in Spark Parquet vectorized reader

2022-05-12 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-39086. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36427

[jira] [Assigned] (SPARK-39086) Support UDT in Spark Parquet vectorized reader

2022-05-12 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-39086: Assignee: Ivan Sadikov > Support UDT in Spark Parquet vectorized reader >

[jira] [Created] (SPARK-39159) Add new Dataset API for Offset

2022-05-12 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39159: -- Summary: Add new Dataset API for Offset Key: SPARK-39159 URL: https://issues.apache.org/jira/browse/SPARK-39159 Project: Spark Issue Type: New Feature