[jira] (SPARK-29211) Second invocation of custom UDF results in exception (when invoked from shell)

[ https://issues.apache.org/jira/browse/SPARK-29211 ] zuotingbing deleted comment on SPARK-29211: - was (Author: zuo.tingbing9): I tried with 3.4.1 and see the same issue. Is there any progress? > Second invocation of custom UDF results in excep

[jira] [Created] (SPARK-50686) Memory footprint reduction in the fallback from hash aggregation to the sort

Artem Kupchinskiy created SPARK-50686: - Summary: Memory footprint reduction in the fallback from hash aggregation to the sort Key: SPARK-50686 URL: https://issues.apache.org/jira/browse/SPARK-50686

[jira] [Updated] (SPARK-50685) Improve Py4J performance by leveraging getattr

[ https://issues.apache.org/jira/browse/SPARK-50685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50685: --- Labels: pull-request-available (was: ) > Improve Py4J performance by leveraging getattr > -

[jira] [Updated] (SPARK-50684) Improve Py4J performance in DataFrameQueryContext

[ https://issues.apache.org/jira/browse/SPARK-50684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50684: --- Labels: pull-request-available (was: ) > Improve Py4J performance in DataFrameQueryContext

[jira] [Created] (SPARK-50684) Improve Py4J performance in DataFrameQueryContext

Hyukjin Kwon created SPARK-50684: Summary: Improve Py4J performance in DataFrameQueryContext Key: SPARK-50684 URL: https://issues.apache.org/jira/browse/SPARK-50684 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-50682) inner Alias should be canonicalized

[ https://issues.apache.org/jira/browse/SPARK-50682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50682. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49309 [https://gi

[jira] [Updated] (SPARK-50683) Inline the common expression in With if used once

[ https://issues.apache.org/jira/browse/SPARK-50683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50683: --- Labels: pull-request-available (was: ) > Inline the common expression in With if used once

[jira] [Assigned] (SPARK-50681) Cache the parsed schema for MapInXXX and ApplyInXXX

[ https://issues.apache.org/jira/browse/SPARK-50681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50681: - Assignee: Ruifeng Zheng > Cache the parsed schema for MapInXXX and ApplyInXXX > ---

[jira] [Resolved] (SPARK-50681) Cache the parsed schema for MapInXXX and ApplyInXXX

[ https://issues.apache.org/jira/browse/SPARK-50681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50681. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49305 [https://

[jira] [Resolved] (SPARK-50679) duplicated common expressions in different With should be projected only once

[ https://issues.apache.org/jira/browse/SPARK-50679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50679. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49303 [https://gith

[jira] [Assigned] (SPARK-50679) duplicated common expressions in different With should be projected only once

[ https://issues.apache.org/jira/browse/SPARK-50679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50679: --- Assignee: Wenchen Fan > duplicated common expressions in different With should be projected

[jira] [Created] (SPARK-50683) Inline the common expression in With if used once

Mingliang Zhu created SPARK-50683: - Summary: Inline the common expression in With if used once Key: SPARK-50683 URL: https://issues.apache.org/jira/browse/SPARK-50683 Project: Spark Issue Typ

[jira] [Updated] (SPARK-50682) inner Alias should be canonicalized

[ https://issues.apache.org/jira/browse/SPARK-50682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50682: --- Labels: pull-request-available (was: ) > inner Alias should be canonicalized >

[jira] [Created] (SPARK-50682) inner Alias should be canonicalized

Wenchen Fan created SPARK-50682: --- Summary: inner Alias should be canonicalized Key: SPARK-50682 URL: https://issues.apache.org/jira/browse/SPARK-50682 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-50622) RocksDB refactor

[ https://issues.apache.org/jira/browse/SPARK-50622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50622. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49242 [https://gi

[jira] [Updated] (SPARK-50681) Cache the parsed schema for MapInXXX and ApplyInXXX

[ https://issues.apache.org/jira/browse/SPARK-50681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50681: --- Labels: pull-request-available (was: ) > Cache the parsed schema for MapInXXX and ApplyInXX

[jira] [Resolved] (SPARK-50573) Adding State Schema ID to State Rows to schema evolution

[ https://issues.apache.org/jira/browse/SPARK-50573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50573. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49171 [https://gi

[jira] [Assigned] (SPARK-50573) Adding State Schema ID to State Rows to schema evolution

[ https://issues.apache.org/jira/browse/SPARK-50573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-50573: Assignee: Eric Marnadi > Adding State Schema ID to State Rows to schema evolution > -

[jira] [Created] (SPARK-50681) Cache the parsed schema for MapInXXX and ApplyInXXX

Ruifeng Zheng created SPARK-50681: - Summary: Cache the parsed schema for MapInXXX and ApplyInXXX Key: SPARK-50681 URL: https://issues.apache.org/jira/browse/SPARK-50681 Project: Spark Issue T

[jira] [Resolved] (SPARK-50677) Upgrade jupiter-interface to 0.13.3 and Junit5 to 5.11.4

[ https://issues.apache.org/jira/browse/SPARK-50677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50677. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49301 [https://gi

[jira] [Resolved] (SPARK-50294) Refactor docker image for testing

[ https://issues.apache.org/jira/browse/SPARK-50294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50294. --- Resolution: Fixed > Refactor docker image for testing > - >

[jira] [Assigned] (SPARK-50669) Allow long values for timestamp add expression

[ https://issues.apache.org/jira/browse/SPARK-50669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-50669: Assignee: Stevo Mitric > Allow long values for timestamp add expression > ---

[jira] [Resolved] (SPARK-50669) Allow long values for timestamp add expression

[ https://issues.apache.org/jira/browse/SPARK-50669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50669. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49291 [https://gi

[jira] [Updated] (SPARK-50655) Fix metric for tracking total state rows as logical entities in transformWithState

[ https://issues.apache.org/jira/browse/SPARK-50655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50655: --- Labels: pull-request-available (was: ) > Fix metric for tracking total state rows as logica

[jira] [Resolved] (SPARK-50673) Avoid traversing model twice in Word2VecModel constructor

[ https://issues.apache.org/jira/browse/SPARK-50673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50673. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49298 [https://

[jira] [Updated] (SPARK-50680) DELETE fails with INTERNAL_ERROR on tables with CHAR(N) columns

[ https://issues.apache.org/jira/browse/SPARK-50680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chungmin Lee updated SPARK-50680: - Summary: DELETE fails with INTERNAL_ERROR on tables with CHAR(N) columns (was: DELETE fails on

[jira] [Created] (SPARK-50680) DELETE fails on tables with CHAR(N) columns

Chungmin Lee created SPARK-50680: Summary: DELETE fails on tables with CHAR(N) columns Key: SPARK-50680 URL: https://issues.apache.org/jira/browse/SPARK-50680 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-50578) Add support for new version of state metadata for TransformWithStateInPandas

[ https://issues.apache.org/jira/browse/SPARK-50578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-50578: Assignee: Jing Zhan > Add support for new version of state metadata for TransformWithStat

[jira] [Resolved] (SPARK-50578) Add support for new version of state metadata for TransformWithStateInPandas

[ https://issues.apache.org/jira/browse/SPARK-50578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50578. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49156 [https://gi

[jira] [Updated] (SPARK-50575) Modifying OperatorStateMetadataV2 to enable schema evolution

[ https://issues.apache.org/jira/browse/SPARK-50575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50575: --- Labels: pull-request-available (was: ) > Modifying OperatorStateMetadataV2 to enable schema

[jira] [Updated] (SPARK-50636) Extend CTESubstitution.scala to make it aware of recursion

[ https://issues.apache.org/jira/browse/SPARK-50636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50636: --- Labels: pull-request-available (was: ) > Extend CTESubstitution.scala to make it aware of r

[jira] [Updated] (SPARK-50679) duplicated common expressions in different With should be projected only once

[ https://issues.apache.org/jira/browse/SPARK-50679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50679: --- Labels: pull-request-available (was: ) > duplicated common expressions in different With sh

[jira] [Created] (SPARK-50679) duplicated common expressions in different With should be projected only once

Wenchen Fan created SPARK-50679: --- Summary: duplicated common expressions in different With should be projected only once Key: SPARK-50679 URL: https://issues.apache.org/jira/browse/SPARK-50679 Project:

[jira] [Updated] (SPARK-50671) Error compiling spark-protobuf module using user-defined protoc

[ https://issues.apache.org/jira/browse/SPARK-50671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] morvenhuang updated SPARK-50671: Description: I'm using user-defined protoc since default version of protoc and protoc-gen-grpc-ja

[jira] [Resolved] (SPARK-50672) Make openpyxl optional in PySpark Tests

[ https://issues.apache.org/jira/browse/SPARK-50672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50672. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49294 [https://

[jira] [Updated] (SPARK-50678) Clean up outdated style check rules related to Guava

[ https://issues.apache.org/jira/browse/SPARK-50678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50678: --- Labels: pull-request-available (was: ) > Clean up outdated style check rules related to Gua

[jira] [Created] (SPARK-50678) Clean up outdated style check rules related to Guava

Yang Jie created SPARK-50678: Summary: Clean up outdated style check rules related to Guava Key: SPARK-50678 URL: https://issues.apache.org/jira/browse/SPARK-50678 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-50677) Upgrade jupiter-interface to 0.13.3 and Junit5 to 5.11.4

[ https://issues.apache.org/jira/browse/SPARK-50677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50677: --- Labels: pull-request-available (was: ) > Upgrade jupiter-interface to 0.13.3 and Junit5 to

[jira] [Created] (SPARK-50677) Upgrade jupiter-interface to 0.13.3 and Junit5 to 5.11.4

Yang Jie created SPARK-50677: Summary: Upgrade jupiter-interface to 0.13.3 and Junit5 to 5.11.4 Key: SPARK-50677 URL: https://issues.apache.org/jira/browse/SPARK-50677 Project: Spark Issue Type:

[jira] [Updated] (SPARK-50676) Remove unused `private lazy val mapValueContainsNull` from `ElementAt`

[ https://issues.apache.org/jira/browse/SPARK-50676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50676: --- Labels: pull-request-available (was: ) > Remove unused `private lazy val mapValueContainsNu

[jira] [Created] (SPARK-50676) Remove unused `private lazy val mapValueContainsNull` from `ElementAt`

Yang Jie created SPARK-50676: Summary: Remove unused `private lazy val mapValueContainsNull` from `ElementAt` Key: SPARK-50676 URL: https://issues.apache.org/jira/browse/SPARK-50676 Project: Spark

[jira] [Resolved] (SPARK-50675) Support for table and view level collations

[ https://issues.apache.org/jira/browse/SPARK-50675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50675. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49084 [https://gith

[jira] [Assigned] (SPARK-50675) Support for table and view level collations

[ https://issues.apache.org/jira/browse/SPARK-50675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50675: --- Assignee: Dejan Krakovic > Support for table and view level collations > --

[jira] [Created] (SPARK-50675) Support for table and view level collations

Dejan Krakovic created SPARK-50675: -- Summary: Support for table and view level collations Key: SPARK-50675 URL: https://issues.apache.org/jira/browse/SPARK-50675 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-50674) Fix check for ‘terminate’ method existence in UDTF evaluation

[ https://issues.apache.org/jira/browse/SPARK-50674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50674: --- Labels: pull-request-available (was: ) > Fix check for ‘terminate’ method existence in UDTF

[jira] [Created] (SPARK-50674) Fix check for ‘terminate’ method existence in UDTF evaluation

Xinrong Meng created SPARK-50674: Summary: Fix check for ‘terminate’ method existence in UDTF evaluation Key: SPARK-50674 URL: https://issues.apache.org/jira/browse/SPARK-50674 Project: Spark

[jira] [Updated] (SPARK-50673) Avoid traversing model twice in Word2VecModel constructor

[ https://issues.apache.org/jira/browse/SPARK-50673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50673: --- Labels: pull-request-available (was: ) > Avoid traversing model twice in Word2VecModel cons