[jira] [Created] (SPARK-47776) State store operation cannot work properly with binary inequality collation

Jungtaek Lim created SPARK-47776: Summary: State store operation cannot work properly with binary inequality collation Key: SPARK-47776 URL: https://issues.apache.org/jira/browse/SPARK-47776 Project:

[jira] [Commented] (SPARK-47718) .sql() does not recognize watermark defined upstream

[ https://issues.apache.org/jira/browse/SPARK-47718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835175#comment-17835175 ] Jungtaek Lim commented on SPARK-47718: -- I've lowered down to major - this is neithe

[jira] [Updated] (SPARK-47718) .sql() does not recognize watermark defined upstream

[ https://issues.apache.org/jira/browse/SPARK-47718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-47718: - Priority: Major (was: Blocker) > .sql() does not recognize watermark defined upstream > ---

[jira] [Commented] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835171#comment-17835171 ] Ke Jia commented on SPARK-47773: [~viirya] Great, I have added comment permissions in th

[jira] [Commented] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835168#comment-17835168 ] L. C. Hsieh commented on SPARK-47773: - Can you open comment on the SPIP doc? > Enha

[jira] [Updated] (SPARK-47736) Add support for AbstractArrayType

[ https://issues.apache.org/jira/browse/SPARK-47736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47736: --- Labels: pull-request-available (was: ) > Add support for AbstractArrayType > --

[jira] [Updated] (SPARK-47736) Add support for AbstractArrayType

[ https://issues.apache.org/jira/browse/SPARK-47736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47736: -- Summary: Add support for AbstractArrayType (was: Add support for AbstractArrayType(St

[jira] [Updated] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47240: --- Labels: pull-request-available (was: ) > SPIP: Structured Logging Framework for Apache Spar

[jira] [Updated] (SPARK-47765) Add SET COLLATION to parser rules

[ https://issues.apache.org/jira/browse/SPARK-47765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47765: --- Labels: pull-request-available (was: ) > Add SET COLLATION to parser rules > --

[jira] [Resolved] (SPARK-47581) SQL catalyst: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47581. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45904 [https:

[jira] [Resolved] (SPARK-47754) Postgres: Support reading multidimensional arrays

[ https://issues.apache.org/jira/browse/SPARK-47754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47754. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45917 [https://

[jira] [Resolved] (SPARK-47771) Make max_by, min_by doctests deterministic

[ https://issues.apache.org/jira/browse/SPARK-47771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47771. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45939 [https://

[jira] [Updated] (SPARK-47775) Support remaining scalar types in the variant spec.

[ https://issues.apache.org/jira/browse/SPARK-47775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47775: --- Labels: pull-request-available (was: ) > Support remaining scalar types in the variant spec

[jira] [Created] (SPARK-47775) Support remaining scalar types in the variant spec.

Chenhao Li created SPARK-47775: -- Summary: Support remaining scalar types in the variant spec. Key: SPARK-47775 URL: https://issues.apache.org/jira/browse/SPARK-47775 Project: Spark Issue Type: S

[jira] [Updated] (SPARK-47774) Remove redundant rules from `MimaExcludes`

[ https://issues.apache.org/jira/browse/SPARK-47774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47774: --- Labels: pull-request-available (was: ) > Remove redundant rules from `MimaExcludes` > -

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: SPIP doc: https://docs.google.com/document/d/1v7sndtIHIBdzc4YvLPI8InXxhI7SnnAQ5HvmM2DGjVE/edit

[jira] [Created] (SPARK-47774) Remove redundant rules from `MimaExcludes`

Dongjoon Hyun created SPARK-47774: - Summary: Remove redundant rules from `MimaExcludes` Key: SPARK-47774 URL: https://issues.apache.org/jira/browse/SPARK-47774 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This [SPIP|https://docs.google.com/document/d/1v7sndtIHIBdzc4YvLPI8InXxhI7SnnAQ5HvmM2DGjVE/edi

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This [SPIP|https://docs.google.com/document/d/1v7sndtIHIBdzc4YvLPI8InXxhI7SnnAQ5HvmM2DGjVE/edi

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This [SPIP|https://docs.google.com/document/d/1v7sndtIHIBdzc4YvLPI8InXxhI7SnnAQ5HvmM2DGjVE/edi

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This [SPIP|https://docs.google.com/document/d/1v7sndtIHIBdzc4YvLPI8InXxhI7SnnAQ5HvmM2DGjVE/edit

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This SPIP outlines the integration of Gluten's physical plan conversion, validation, and fallba

[jira] [Created] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

Ke Jia created SPARK-47773: -- Summary: Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines Key: SPARK-47773 URL: https://issues.apache.org/jira/browse/SPARK-47773

[jira] [Updated] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47770: -- Fix Version/s: 3.5.2 3.4.3 > Fix `GenerateMIMAIgnore.isPackagePrivateModule

[jira] [Commented] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835136#comment-17835136 ] Bo Xiong commented on SPARK-47759: -- I've submitted [a fix|https://github.com/apache/spa

[jira] [Resolved] (SPARK-47682) Support cast from variant.

[ https://issues.apache.org/jira/browse/SPARK-47682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47682. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45807 [https://gith

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Fix Version/s: 3.5.2 3.5.1 Affects Version/s: 3.5.1

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected s

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string (was: Ap

[jira] [Updated] (SPARK-47759) Apps being stuck with an unexpected stack trace when reading/parsing a time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected s

[jira] [Updated] (SPARK-47759) Apps being stuck with an unexpected stack trace when reading/parsing a legitimate time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: Apps being stuck with an unexpected stack trace when reading/parsing a legitimate time string

[jira] [Resolved] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47770. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45938 [https://github.com

[jira] [Updated] (SPARK-47772) Fix the doctest of mode function

[ https://issues.apache.org/jira/browse/SPARK-47772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47772: --- Labels: pull-request-available (was: ) > Fix the doctest of mode function > ---

[jira] [Updated] (SPARK-47771) Make max_by, min_by doctests deterministic

[ https://issues.apache.org/jira/browse/SPARK-47771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47771: --- Labels: pull-request-available (was: ) > Make max_by, min_by doctests deterministic > -

[jira] [Created] (SPARK-47771) Make max_by, min_by doctests deterministic

Ruifeng Zheng created SPARK-47771: - Summary: Make max_by, min_by doctests deterministic Key: SPARK-47771 URL: https://issues.apache.org/jira/browse/SPARK-47771 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47770: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix `GenerateMIMAIgnore.isPacka

[jira] [Assigned] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47770: - Assignee: Dongjoon Hyun > Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return fal

[jira] [Updated] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47770: --- Labels: pull-request-available (was: ) > Fix `GenerateMIMAIgnore.isPackagePrivateModule` to

[jira] [Created] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

Dongjoon Hyun created SPARK-47770: - Summary: Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing Key: SPARK-47770 URL: https://issues.apache.org/jira/browse/SPARK-47770

[jira] [Resolved] (SPARK-47589) Hive-thriftserver: Migrate logError with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47589. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45936 [https:

[jira] [Commented] (SPARK-47588) Hive module: Migrate logInfo with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835080#comment-17835080 ] Gengliang Wang commented on SPARK-47588: I am working on this one > Hive module

[jira] [Assigned] (SPARK-47587) Hive module: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47587: -- Assignee: BingKun Pan > Hive module: Migrate logWarn with variables to structured log

[jira] [Assigned] (SPARK-47586) Hive module: Migrate logError with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47586: -- Assignee: Haejoon Lee > Hive module: Migrate logError with variables to structured lo

[jira] [Assigned] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47591: -- Assignee: Haejoon Lee > Hive-thriftserver: Migrate logInfo with variables to structur

[jira] [Updated] (SPARK-47589) Hive-thriftserver: Migrate logError with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47589: --- Labels: pull-request-available (was: ) > Hive-thriftserver: Migrate logError with variables

[jira] [Updated] (SPARK-47769) Add schema_of_variant_agg expression.

[ https://issues.apache.org/jira/browse/SPARK-47769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47769: --- Labels: pull-request-available (was: ) > Add schema_of_variant_agg expression. > --

[jira] [Created] (SPARK-47769) Add schema_of_variant_agg expression.

Chenhao Li created SPARK-47769: -- Summary: Add schema_of_variant_agg expression. Key: SPARK-47769 URL: https://issues.apache.org/jira/browse/SPARK-47769 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47417) Ascii, Chr, Base64, UnBase64 (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47417: --- Labels: pull-request-available (was: ) > Ascii, Chr, Base64, UnBase64 (all collations) > --

[jira] [Updated] (SPARK-47410) refactor UTF8String and CollationFactory

[ https://issues.apache.org/jira/browse/SPARK-47410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47410: - Summary: refactor UTF8String and CollationFactory (was: Refactor UTF8String and CollationFactor

[jira] [Updated] (SPARK-47410) Refactor UTF8String and CollationFactory

[ https://issues.apache.org/jira/browse/SPARK-47410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47410: - Summary: Refactor UTF8String and CollationFactory (was: StringTrimLeft, StringTrimRight (all co

[jira] [Resolved] (SPARK-47737) Bump PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47737. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45892 [https://

[jira] [Updated] (SPARK-47737) Bump PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47737: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Bump PyArrow to 10.0.0 > --

[jira] [Assigned] (SPARK-47737) Bump PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47737: - Assignee: Haejoon Lee > Bump PyArrow to 10.0.0 > -- > >

[jira] [Assigned] (SPARK-47725) Set up the CI for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47725: - Assignee: Hyukjin Kwon > Set up the CI for pyspark-connect package > --

[jira] [Resolved] (SPARK-47725) Set up the CI for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47725. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45870 [https://

[jira] [Updated] (SPARK-47767) Show offset value in TakeOrderedAndProjectExec

[ https://issues.apache.org/jira/browse/SPARK-47767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47767: --- Labels: pull-request-available (was: ) > Show offset value in TakeOrderedAndProjectExec > -

[jira] [Updated] (SPARK-47767) Show offset value in TakeOrderedAndProjectExec

[ https://issues.apache.org/jira/browse/SPARK-47767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guihuawen updated SPARK-47767: -- Description: Show the offset value in TakeOrderedAndProjectExec.   For example:   explain select *

[jira] [Created] (SPARK-47768) Data Source names unavailable when using Delta Share and Kafka SQL

David Perkins created SPARK-47768: - Summary: Data Source names unavailable when using Delta Share and Kafka SQL Key: SPARK-47768 URL: https://issues.apache.org/jira/browse/SPARK-47768 Project: Spark

[jira] [Created] (SPARK-47767) Show offset value in TakeOrderedAndProjectExec

guihuawen created SPARK-47767: - Summary: Show offset value in TakeOrderedAndProjectExec Key: SPARK-47767 URL: https://issues.apache.org/jira/browse/SPARK-47767 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-47766) Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0

[ https://issues.apache.org/jira/browse/SPARK-47766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-47766: Description: We have some HIGH CVEs which are coming from hadoop-client-runtime 3.3.4 and hence w

[jira] [Created] (SPARK-47766) Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0

Ramakrishna created SPARK-47766: --- Summary: Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0 Key: SPARK-47766 URL: https://issues.apache.org/jira/browse/SPARK-47766 Proj

[jira] [Commented] (SPARK-47318) AuthEngine key exchange needs additional KDF round

[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834987#comment-17834987 ] Dongjoon Hyun commented on SPARK-47318: --- I added a target version (3.4.3) based on

[jira] [Updated] (SPARK-47318) AuthEngine key exchange needs additional KDF round

[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47318: -- Target Version/s: 3.4.3 > AuthEngine key exchange needs additional KDF round > --

[jira] [Resolved] (SPARK-47504) Resolve AbstractDataType simpleStrings for StringTypeCollated

[ https://issues.apache.org/jira/browse/SPARK-47504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47504. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45694 [https://gith

[jira] [Resolved] (SPARK-47681) Add schema_of_variant expression.

[ https://issues.apache.org/jira/browse/SPARK-47681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47681. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45806 [https://gith

[jira] [Created] (SPARK-47765) Add SET COLLATION to parser rules

Mihailo Milosevic created SPARK-47765: - Summary: Add SET COLLATION to parser rules Key: SPARK-47765 URL: https://issues.apache.org/jira/browse/SPARK-47765 Project: Spark Issue Type: New F

[jira] [Updated] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions

[ https://issues.apache.org/jira/browse/SPARK-47764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47764: --- Labels: pull-request-available (was: ) > Cleanup shuffle dependencies for Spark Connect SQL

[jira] [Created] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions

Bo Zhang created SPARK-47764: Summary: Cleanup shuffle dependencies for Spark Connect SQL executions Key: SPARK-47764 URL: https://issues.apache.org/jira/browse/SPARK-47764 Project: Spark Issue

[jira] [Resolved] (SPARK-47286) IN operator support

[ https://issues.apache.org/jira/browse/SPARK-47286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandar Tomic resolved SPARK-47286. -- Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed > IN o

[jira] [Created] (SPARK-47763) Reeanble Protobuf function doctests

Hyukjin Kwon created SPARK-47763: Summary: Reeanble Protobuf function doctests Key: SPARK-47763 URL: https://issues.apache.org/jira/browse/SPARK-47763 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47746) Use column ordinals instead of prefix ordering columns in the range scan encoder

[ https://issues.apache.org/jira/browse/SPARK-47746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47746. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45905 [https://gi

[jira] [Updated] (SPARK-47587) Hive module: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47587: --- Labels: pull-request-available (was: ) > Hive module: Migrate logWarn with variables to str

[jira] [Updated] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47591: --- Labels: pull-request-available (was: ) > Hive-thriftserver: Migrate logInfo with variables

[jira] [Updated] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

[ https://issues.apache.org/jira/browse/SPARK-47761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47761: --- Labels: pull-request-available (was: ) > Oracle: Support reading AnsiIntervalTypes > --

[jira] [Resolved] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

[ https://issues.apache.org/jira/browse/SPARK-47762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47762. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45924 [https://gi

[jira] [Updated] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

[ https://issues.apache.org/jira/browse/SPARK-47762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47762: - Fix Version/s: 3.5.2 > Add pyspark.sql.connect.protobuf into setup.py >

[jira] [Commented] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834828#comment-17834828 ] Haejoon Lee commented on SPARK-47591: - I'm working on this :)  > Hive-thriftserver:

[jira] [Created] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

Hyukjin Kwon created SPARK-47762: Summary: Add pyspark.sql.connect.protobuf into setup.py Key: SPARK-47762 URL: https://issues.apache.org/jira/browse/SPARK-47762 Project: Spark Issue Type: Bu

[jira] [Created] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

Kent Yao created SPARK-47761: Summary: Oracle: Support reading AnsiIntervalTypes Key: SPARK-47761 URL: https://issues.apache.org/jira/browse/SPARK-47761 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834804#comment-17834804 ] Uroš Bojanić commented on SPARK-47413: -- [~gpgp] Thank you, of course! Take a look a

[jira] [Commented] (SPARK-47412) StringLPad, StringRPad (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834803#comment-17834803 ] Uroš Bojanić commented on SPARK-47412: -- [~gpgp] Thank you for your hard work on [S