[jira] [Created] (SPARK-49919) SpecialLimits strategy doesn't work when return the content of the Dataset as a Dataset of JSON strings

Lantao Jin created SPARK-49919: -- Summary: SpecialLimits strategy doesn't work when return the content of the Dataset as a Dataset of JSON strings Key: SPARK-49919 URL: https://issues.apache.org/jira/browse/SPARK-4991

[jira] [Updated] (SPARK-49919) SpecialLimits strategy doesn't work when return the content of the Dataset as a Dataset of JSON strings

[ https://issues.apache.org/jira/browse/SPARK-49919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-49919: --- Description: `CollectLimitExec` is used when a logical `Limit` and/or `Offset` operation is the fin

[jira] [Resolved] (SPARK-49782) ResolveDataFrameDropColumns rule mistakenly handles UnresolvedAttribute

[ https://issues.apache.org/jira/browse/SPARK-49782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49782. - Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-49918) Use read-only access to conf in SparkContext where appropriate

[ https://issues.apache.org/jira/browse/SPARK-49918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49918. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48402 [https://gith

[jira] [Updated] (SPARK-49918) Use read-only access to conf in SparkContext where appropriate

[ https://issues.apache.org/jira/browse/SPARK-49918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49918: --- Labels: pull-request-available (was: ) > Use read-only access to conf in SparkContext where

[jira] [Created] (SPARK-49918) Use read-only access to conf in SparkContext where appropriate

Wenchen Fan created SPARK-49918: --- Summary: Use read-only access to conf in SparkContext where appropriate Key: SPARK-49918 URL: https://issues.apache.org/jira/browse/SPARK-49918 Project: Spark

[jira] [Updated] (SPARK-49829) Issues with optimization on adding input to state store in stream-stream join

[ https://issues.apache.org/jira/browse/SPARK-49829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49829: --- Labels: correctness pull-request-available (was: correctness) > Issues with optimization on

[jira] [Updated] (SPARK-48669) K8s resource name prefix follows DNS Subdomain Names rule

[ https://issues.apache.org/jira/browse/SPARK-48669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48669: --- Labels: pull-request-available (was: ) > K8s resource name prefix follows DNS Subdomain Nam

[jira] [Updated] (SPARK-48667) Arrow python UDFS didn't support UDT as output type

[ https://issues.apache.org/jira/browse/SPARK-48667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48667: --- Labels: pull-request-available (was: ) > Arrow python UDFS didn't support UDT as output typ

[jira] [Updated] (SPARK-48696) Also truncate the schema row for show function

[ https://issues.apache.org/jira/browse/SPARK-48696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48696: --- Labels: pull-request-available (was: ) > Also truncate the schema row for show function > -

[jira] [Updated] (SPARK-48739) Disable writing collated data to file formats that don't support them in non managed tables

[ https://issues.apache.org/jira/browse/SPARK-48739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48739: --- Labels: pull-request-available (was: ) > Disable writing collated data to file formats that

[jira] [Updated] (SPARK-49917) Enable hash join rewrite rule for collated strings

[ https://issues.apache.org/jira/browse/SPARK-49917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49917: --- Labels: pull-request-available (was: ) > Enable hash join rewrite rule for collated strings

[jira] [Created] (SPARK-49917) Enable hash join rewrite rule for collated strings

Uroš Bojanić created SPARK-49917: Summary: Enable hash join rewrite rule for collated strings Key: SPARK-49917 URL: https://issues.apache.org/jira/browse/SPARK-49917 Project: Spark Issue Type

[jira] [Updated] (SPARK-49917) Enable hash join rewrite rule for collated strings

[ https://issues.apache.org/jira/browse/SPARK-49917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-49917: - Issue Type: Task (was: Bug) > Enable hash join rewrite rule for collated strings >

[jira] [Updated] (SPARK-42838) Assign a name to the error class _LEGACY_ERROR_TEMP_2000

[ https://issues.apache.org/jira/browse/SPARK-42838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42838: --- Labels: pull-request-available starter (was: starter) > Assign a name to the error class _L

[jira] [Updated] (SPARK-49615) Feature transformers are case sensitive when unintented

[ https://issues.apache.org/jira/browse/SPARK-49615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49615: --- Labels: pull-request-available (was: ) > Feature transformers are case sensitive when unint

[jira] [Updated] (SPARK-49916) Throw appropriate Exception for type mismatch between ColumnType and data type in some rows

[ https://issues.apache.org/jira/browse/SPARK-49916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49916: --- Labels: pull-request-available (was: ) > Throw appropriate Exception for type mismatch betw

[jira] [Updated] (SPARK-49856) Refactor the compileExpression of JdbcDialect for simplify the subclass

[ https://issues.apache.org/jira/browse/SPARK-49856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49856: --- Labels: pull-request-available (was: ) > Refactor the compileExpression of JdbcDialect for

[jira] [Resolved] (SPARK-49873) Assign proper error class for _LEGACY_ERROR_TEMP_1325

[ https://issues.apache.org/jira/browse/SPARK-49873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49873. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48346 [https://github.com

[jira] [Assigned] (SPARK-49873) Assign proper error class for _LEGACY_ERROR_TEMP_1325

[ https://issues.apache.org/jira/browse/SPARK-49873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49873: Assignee: Haejoon Lee > Assign proper error class for _LEGACY_ERROR_TEMP_1325 > -

[jira] [Updated] (SPARK-49892) Assign proper error class for _LEGACY_ERROR_TEMP_1136

[ https://issues.apache.org/jira/browse/SPARK-49892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49892: --- Labels: pull-request-available (was: ) > Assign proper error class for _LEGACY_ERROR_TEMP_1

[jira] [Created] (SPARK-49916) Throw appropriate Exception for type mismatch between ColumnType and data type in some rows

Stefan Kandic created SPARK-49916: - Summary: Throw appropriate Exception for type mismatch between ColumnType and data type in some rows Key: SPARK-49916 URL: https://issues.apache.org/jira/browse/SPARK-49916

[jira] [Resolved] (SPARK-49418) Active/default ThreadLocals for shared SparkSession

[ https://issues.apache.org/jira/browse/SPARK-49418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-49418. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48374 [

[jira] [Updated] (SPARK-49418) Active/default ThreadLocals for shared SparkSession

[ https://issues.apache.org/jira/browse/SPARK-49418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49418: --- Labels: pull-request-available (was: ) > Active/default ThreadLocals for shared SparkSessio

[jira] [Updated] (SPARK-49909) Fix the pretty name of some expressions

[ https://issues.apache.org/jira/browse/SPARK-49909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-49909: - Fix Version/s: 3.5.4 > Fix the pretty name of some expressions > ---

[jira] [Updated] (SPARK-49915) Handle zeros and ones in ReorderAssociativeOperator

[ https://issues.apache.org/jira/browse/SPARK-49915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49915: --- Labels: pull-request-available (was: ) > Handle zeros and ones in ReorderAssociativeOperato

[jira] [Created] (SPARK-49915) Handle zeros and ones in ReorderAssociativeOperator

Kent Yao created SPARK-49915: Summary: Handle zeros and ones in ReorderAssociativeOperator Key: SPARK-49915 URL: https://issues.apache.org/jira/browse/SPARK-49915 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-49913) [M1] Unique label names

David Milicevic created SPARK-49913: --- Summary: [M1] Unique label names Key: SPARK-49913 URL: https://issues.apache.org/jira/browse/SPARK-49913 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-49912) [M1] CASE statement improvemnts

David Milicevic created SPARK-49912: --- Summary: [M1] CASE statement improvemnts Key: SPARK-49912 URL: https://issues.apache.org/jira/browse/SPARK-49912 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-49912) [M1] CASE statement improvements

[ https://issues.apache.org/jira/browse/SPARK-49912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-49912: Summary: [M1] CASE statement improvements (was: [M1] CASE statement improvemnts) > [M1]

[jira] [Updated] (SPARK-48353) [M1] Exception handling

[ https://issues.apache.org/jira/browse/SPARK-48353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48353: Summary: [M1] Exception handling (was: [M0] Exception handling) > [M1] Exception handling

[jira] [Assigned] (SPARK-49549) Assign a name to the error conditions _LEGACY_ERROR_TEMP_3055, 3146

[ https://issues.apache.org/jira/browse/SPARK-49549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49549: -- Assignee: (was: Apache Spark) > Assign a name to the error conditions _LEGACY_ERR

[jira] [Assigned] (SPARK-49549) Assign a name to the error conditions _LEGACY_ERROR_TEMP_3055, 3146

[ https://issues.apache.org/jira/browse/SPARK-49549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49549: -- Assignee: Apache Spark > Assign a name to the error conditions _LEGACY_ERROR_TEMP_305

[jira] [Assigned] (SPARK-49661) Trim sensitivity support

[ https://issues.apache.org/jira/browse/SPARK-49661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49661: -- Assignee: Apache Spark > Trim sensitivity support > > >

[jira] [Assigned] (SPARK-49661) Trim sensitivity support

[ https://issues.apache.org/jira/browse/SPARK-49661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49661: -- Assignee: (was: Apache Spark) > Trim sensitivity support > --

[jira] [Resolved] (SPARK-48452) [M0] Spark Connect investigation

[ https://issues.apache.org/jira/browse/SPARK-48452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic resolved SPARK-48452. - Resolution: Fixed We have figured out the initial design for the Spark Connect. There ar

[jira] [Updated] (SPARK-48530) [M1] Support for local variables

[ https://issues.apache.org/jira/browse/SPARK-48530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48530: Summary: [M1] Support for local variables (was: [M0] Support for local variables) > [M1]

[jira] [Commented] (SPARK-49482) refactor V2 parquet datasource to simplify it's extension

[ https://issues.apache.org/jira/browse/SPARK-49482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887840#comment-17887840 ] Avi minsky commented on SPARK-49482: [https://github.com/apache/spark/pull/47947]  c

[jira] [Updated] (SPARK-48344) [M1] SQL Script execution

[ https://issues.apache.org/jira/browse/SPARK-48344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48344: Description: Implement changes to sql() API to support SQL script execution: * SparkSessi

[jira] [Updated] (SPARK-48344) [M1] SQL Script execution

[ https://issues.apache.org/jira/browse/SPARK-48344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48344: Summary: [M1] SQL Script execution (was: [M0] Changes to sql() API) > [M1] SQL Script exe

[jira] [Created] (SPARK-49911) Fix semantic behind "supportsBinaryEquality" in Collation to make it more extendable.

Jovan Pavlovic created SPARK-49911: -- Summary: Fix semantic behind "supportsBinaryEquality" in Collation to make it more extendable. Key: SPARK-49911 URL: https://issues.apache.org/jira/browse/SPARK-49911

[jira] [Updated] (SPARK-49873) Assign proper error class for _LEGACY_ERROR_TEMP_1325

[ https://issues.apache.org/jira/browse/SPARK-49873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49873: --- Labels: pull-request-available (was: ) > Assign proper error class for _LEGACY_ERROR_TEMP_1

[jira] [Updated] (SPARK-49891) Assign proper error class for _LEGACY_ERROR_TEMP_2271

[ https://issues.apache.org/jira/browse/SPARK-49891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49891: --- Labels: pull-request-available (was: ) > Assign proper error class for _LEGACY_ERROR_TEMP_2

[jira] [Updated] (SPARK-49902) RegExpReplace does not catch runtime errors when it fails on certain rows

[ https://issues.apache.org/jira/browse/SPARK-49902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49902: --- Labels: pull-request-available (was: ) > RegExpReplace does not catch runtime errors when i

[jira] [Reopened] (SPARK-49808) Fix a deadlock in subquery execution due to lazy vals

[ https://issues.apache.org/jira/browse/SPARK-49808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reopened SPARK-49808: --- > Fix a deadlock in subquery execution due to lazy vals > --

[jira] [Created] (SPARK-49910) spark TLS connection (+ kerberos) to hive metastore

Stefano Bovina created SPARK-49910: -- Summary: spark TLS connection (+ kerberos) to hive metastore Key: SPARK-49910 URL: https://issues.apache.org/jira/browse/SPARK-49910 Project: Spark Issue

[jira] [Resolved] (SPARK-49909) Fix the pretty name of some expressions

[ https://issues.apache.org/jira/browse/SPARK-49909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-49909. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48385 [https://github.com

[jira] [Assigned] (SPARK-49909) Fix the pretty name of some expressions

[ https://issues.apache.org/jira/browse/SPARK-49909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-49909: Assignee: BingKun Pan > Fix the pretty name of some expressions > ---

[jira] [Updated] (SPARK-49909) Fix the pretty name of some expressions

[ https://issues.apache.org/jira/browse/SPARK-49909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49909: --- Labels: pull-request-available (was: ) > Fix the pretty name of some expressions >

[jira] [Commented] (SPARK-49559) Set operations

[ https://issues.apache.org/jira/browse/SPARK-49559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887804#comment-17887804 ] Wenchen Fan commented on SPARK-49559: - https://github.com/apache/spark/pull/48359 >

[jira] [Updated] (SPARK-37178) Add Target Encoding to ml.feature

[ https://issues.apache.org/jira/browse/SPARK-37178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-37178: --- Labels: pull-request-available (was: ) > Add Target Encoding to ml.feature > --

[jira] [Resolved] (SPARK-49559) Set operations

[ https://issues.apache.org/jira/browse/SPARK-49559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49559. - Fix Version/s: 4.0.0 Assignee: Daniel Resolution: Fixed > Set operations > -

[jira] [Updated] (SPARK-49908) Assign proper error condition for _LEGACY_ERROR_TEMP_0044

[ https://issues.apache.org/jira/browse/SPARK-49908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49908: --- Labels: pull-request-available (was: ) > Assign proper error condition for _LEGACY_ERROR_TE

[jira] [Updated] (SPARK-49904) Assign proper error condition for _LEGACY_ERROR_TEMP_2140

[ https://issues.apache.org/jira/browse/SPARK-49904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49904: --- Labels: pull-request-available (was: ) > Assign proper error condition for _LEGACY_ERROR_TE