[jira] [Resolved] (SPARK-47581) SQL catalyst: Migrate logWarn with variables to structured logging framework

2024-04-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47581. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45904

[jira] [Resolved] (SPARK-47754) Postgres: Support reading multidimensional arrays

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47754. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45917

[jira] [Resolved] (SPARK-47771) Make max_by, min_by doctests deterministic

2024-04-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47771. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45939

[jira] [Updated] (SPARK-47775) Support remaining scalar types in the variant spec.

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47775: --- Labels: pull-request-available (was: ) > Support remaining scalar types in the variant

[jira] [Created] (SPARK-47775) Support remaining scalar types in the variant spec.

2024-04-08 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47775: -- Summary: Support remaining scalar types in the variant spec. Key: SPARK-47775 URL: https://issues.apache.org/jira/browse/SPARK-47775 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47774) Remove redundant rules from `MimaExcludes`

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47774: --- Labels: pull-request-available (was: ) > Remove redundant rules from `MimaExcludes` >

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-08 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: SPIP doc:

[jira] [Created] (SPARK-47774) Remove redundant rules from `MimaExcludes`

2024-04-08 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47774: - Summary: Remove redundant rules from `MimaExcludes` Key: SPARK-47774 URL: https://issues.apache.org/jira/browse/SPARK-47774 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-08 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-08 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-08 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-08 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-08 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: This SPIP outlines the integration of Gluten's physical plan conversion, validation, and

[jira] [Created] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-08 Thread Ke Jia (Jira)
Ke Jia created SPARK-47773: -- Summary: Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines Key: SPARK-47773 URL: https://issues.apache.org/jira/browse/SPARK-47773

[jira] [Updated] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47770: -- Fix Version/s: 3.5.2 3.4.3 > Fix

[jira] [Commented] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835136#comment-17835136 ] Bo Xiong commented on SPARK-47759: -- I've submitted [a fix|https://github.com/apache/spark/pull/45942].  

[jira] [Resolved] (SPARK-47682) Support cast from variant.

2024-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47682. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45807

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Fix Version/s: 3.5.2 3.5.1 Affects Version/s: 3.5.1

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string (was:

[jira] [Updated] (SPARK-47759) Apps being stuck with an unexpected stack trace when reading/parsing a time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47759) Apps being stuck with an unexpected stack trace when reading/parsing a legitimate time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: Apps being stuck with an unexpected stack trace when reading/parsing a legitimate time string

[jira] [Resolved] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

2024-04-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47770. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45938

[jira] [Updated] (SPARK-47772) Fix the doctest of mode function

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47772: --- Labels: pull-request-available (was: ) > Fix the doctest of mode function >

[jira] [Updated] (SPARK-47771) Make max_by, min_by doctests deterministic

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47771: --- Labels: pull-request-available (was: ) > Make max_by, min_by doctests deterministic >

[jira] [Created] (SPARK-47771) Make max_by, min_by doctests deterministic

2024-04-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47771: - Summary: Make max_by, min_by doctests deterministic Key: SPARK-47771 URL: https://issues.apache.org/jira/browse/SPARK-47771 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47770: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix

[jira] [Assigned] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47770: - Assignee: Dongjoon Hyun > Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return

[jira] [Updated] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47770: --- Labels: pull-request-available (was: ) > Fix `GenerateMIMAIgnore.isPackagePrivateModule`

[jira] [Created] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing

2024-04-08 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47770: - Summary: Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing Key: SPARK-47770 URL: https://issues.apache.org/jira/browse/SPARK-47770

[jira] [Resolved] (SPARK-47589) Hive-thriftserver: Migrate logError with variables to structured logging framework

2024-04-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47589. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45936

[jira] [Commented] (SPARK-47588) Hive module: Migrate logInfo with variables to structured logging framework

2024-04-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835080#comment-17835080 ] Gengliang Wang commented on SPARK-47588: I am working on this one > Hive module: Migrate

[jira] [Assigned] (SPARK-47587) Hive module: Migrate logWarn with variables to structured logging framework

2024-04-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47587: -- Assignee: BingKun Pan > Hive module: Migrate logWarn with variables to structured

[jira] [Assigned] (SPARK-47586) Hive module: Migrate logError with variables to structured logging framework

2024-04-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47586: -- Assignee: Haejoon Lee > Hive module: Migrate logError with variables to structured

[jira] [Assigned] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

2024-04-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47591: -- Assignee: Haejoon Lee > Hive-thriftserver: Migrate logInfo with variables to

[jira] [Updated] (SPARK-47589) Hive-thriftserver: Migrate logError with variables to structured logging framework

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47589: --- Labels: pull-request-available (was: ) > Hive-thriftserver: Migrate logError with

[jira] [Updated] (SPARK-47769) Add schema_of_variant_agg expression.

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47769: --- Labels: pull-request-available (was: ) > Add schema_of_variant_agg expression. >

[jira] [Created] (SPARK-47769) Add schema_of_variant_agg expression.

2024-04-08 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47769: -- Summary: Add schema_of_variant_agg expression. Key: SPARK-47769 URL: https://issues.apache.org/jira/browse/SPARK-47769 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47417) Ascii, Chr, Base64, UnBase64 (all collations)

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47417: --- Labels: pull-request-available (was: ) > Ascii, Chr, Base64, UnBase64 (all collations) >

[jira] [Updated] (SPARK-47410) refactor UTF8String and CollationFactory

2024-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47410: - Summary: refactor UTF8String and CollationFactory (was: Refactor UTF8String and

[jira] [Updated] (SPARK-47410) Refactor UTF8String and CollationFactory

2024-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47410: - Summary: Refactor UTF8String and CollationFactory (was: StringTrimLeft, StringTrimRight (all

[jira] [Resolved] (SPARK-47737) Bump PyArrow to 10.0.0

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47737. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45892

[jira] [Updated] (SPARK-47737) Bump PyArrow to 10.0.0

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47737: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Bump PyArrow to 10.0.0 >

[jira] [Assigned] (SPARK-47737) Bump PyArrow to 10.0.0

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47737: - Assignee: Haejoon Lee > Bump PyArrow to 10.0.0 > -- > >

[jira] [Assigned] (SPARK-47725) Set up the CI for pyspark-connect package

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47725: - Assignee: Hyukjin Kwon > Set up the CI for pyspark-connect package >

[jira] [Resolved] (SPARK-47725) Set up the CI for pyspark-connect package

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47725. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45870

[jira] [Updated] (SPARK-47767) Show offset value in TakeOrderedAndProjectExec

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47767: --- Labels: pull-request-available (was: ) > Show offset value in TakeOrderedAndProjectExec >

[jira] [Updated] (SPARK-47767) Show offset value in TakeOrderedAndProjectExec

2024-04-08 Thread guihuawen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guihuawen updated SPARK-47767: -- Description: Show the offset value in TakeOrderedAndProjectExec.   For example:   explain select

[jira] [Created] (SPARK-47768) Data Source names unavailable when using Delta Share and Kafka SQL

2024-04-08 Thread David Perkins (Jira)
David Perkins created SPARK-47768: - Summary: Data Source names unavailable when using Delta Share and Kafka SQL Key: SPARK-47768 URL: https://issues.apache.org/jira/browse/SPARK-47768 Project: Spark

[jira] [Created] (SPARK-47767) Show offset value in TakeOrderedAndProjectExec

2024-04-08 Thread guihuawen (Jira)
guihuawen created SPARK-47767: - Summary: Show offset value in TakeOrderedAndProjectExec Key: SPARK-47767 URL: https://issues.apache.org/jira/browse/SPARK-47767 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47766) Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0

2024-04-08 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna updated SPARK-47766: Description: We have some HIGH CVEs which are coming from hadoop-client-runtime 3.3.4 and hence

[jira] [Created] (SPARK-47766) Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0

2024-04-08 Thread Ramakrishna (Jira)
Ramakrishna created SPARK-47766: --- Summary: Extend spark 3.5.1 to support hadoop-client-api 3.4.0, hadoop-client-runtime-3.4.0 Key: SPARK-47766 URL: https://issues.apache.org/jira/browse/SPARK-47766

[jira] [Commented] (SPARK-47318) AuthEngine key exchange needs additional KDF round

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834987#comment-17834987 ] Dongjoon Hyun commented on SPARK-47318: --- I added a target version (3.4.3) based on the dev mailing

[jira] [Updated] (SPARK-47318) AuthEngine key exchange needs additional KDF round

2024-04-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47318: -- Target Version/s: 3.4.3 > AuthEngine key exchange needs additional KDF round >

[jira] [Resolved] (SPARK-47504) Resolve AbstractDataType simpleStrings for StringTypeCollated

2024-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47504. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45694

[jira] [Resolved] (SPARK-47681) Add schema_of_variant expression.

2024-04-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47681. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45806

[jira] [Created] (SPARK-47765) Add SET COLLATION to parser rules

2024-04-08 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-47765: - Summary: Add SET COLLATION to parser rules Key: SPARK-47765 URL: https://issues.apache.org/jira/browse/SPARK-47765 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47764: --- Labels: pull-request-available (was: ) > Cleanup shuffle dependencies for Spark Connect

[jira] [Created] (SPARK-47764) Cleanup shuffle dependencies for Spark Connect SQL executions

2024-04-08 Thread Bo Zhang (Jira)
Bo Zhang created SPARK-47764: Summary: Cleanup shuffle dependencies for Spark Connect SQL executions Key: SPARK-47764 URL: https://issues.apache.org/jira/browse/SPARK-47764 Project: Spark Issue

[jira] [Resolved] (SPARK-47286) IN operator support

2024-04-08 Thread Aleksandar Tomic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandar Tomic resolved SPARK-47286. -- Fix Version/s: 4.0.0 Target Version/s: 4.0.0 Resolution: Fixed > IN

[jira] [Created] (SPARK-47763) Reeanble Protobuf function doctests

2024-04-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47763: Summary: Reeanble Protobuf function doctests Key: SPARK-47763 URL: https://issues.apache.org/jira/browse/SPARK-47763 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47746) Use column ordinals instead of prefix ordering columns in the range scan encoder

2024-04-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47746. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45905

[jira] [Updated] (SPARK-47587) Hive module: Migrate logWarn with variables to structured logging framework

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47587: --- Labels: pull-request-available (was: ) > Hive module: Migrate logWarn with variables to

[jira] [Updated] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47591: --- Labels: pull-request-available (was: ) > Hive-thriftserver: Migrate logInfo with variables

[jira] [Updated] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47761: --- Labels: pull-request-available (was: ) > Oracle: Support reading AnsiIntervalTypes >

[jira] [Resolved] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

2024-04-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47762. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45924

[jira] [Updated] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

2024-04-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47762: - Fix Version/s: 3.5.2 > Add pyspark.sql.connect.protobuf into setup.py >

[jira] [Commented] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

2024-04-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834828#comment-17834828 ] Haejoon Lee commented on SPARK-47591: - I'm working on this :)  > Hive-thriftserver: Migrate logInfo

[jira] [Created] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py

2024-04-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47762: Summary: Add pyspark.sql.connect.protobuf into setup.py Key: SPARK-47762 URL: https://issues.apache.org/jira/browse/SPARK-47762 Project: Spark Issue Type:

[jira] [Created] (SPARK-47761) Oracle: Support reading AnsiIntervalTypes

2024-04-08 Thread Kent Yao (Jira)
Kent Yao created SPARK-47761: Summary: Oracle: Support reading AnsiIntervalTypes Key: SPARK-47761 URL: https://issues.apache.org/jira/browse/SPARK-47761 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834804#comment-17834804 ] Uroš Bojanić commented on SPARK-47413: -- [~gpgp] Thank you, of course! Take a look at

[jira] [Commented] (SPARK-47412) StringLPad, StringRPad (all collations)

2024-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834803#comment-17834803 ] Uroš Bojanić commented on SPARK-47412: -- [~gpgp] Thank you for your hard work on

[jira] [Commented] (SPARK-46143) pyspark.pandas read_excel implementation at version 3.4.1

2024-04-08 Thread comet (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834802#comment-17834802 ] comet commented on SPARK-46143: --- voted for this issue. > pyspark.pandas read_excel implementation at

[jira] [Updated] (SPARK-47412) StringLPad, StringRPad (all collations)

2024-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47412: - Description: Enable collation support for the *StringLPad* & *StringRPad* built-in string

[jira] [Updated] (SPARK-47412) StringLPad, StringRPad (all collations)

2024-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47412: - Summary: StringLPad, StringRPad (all collations) (was: StringLPad, BinaryPad, StringRPad (all

[jira] [Updated] (SPARK-47412) StringLPad, BinaryPad, StringRPad (all collations)

2024-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47412: - Description: Enable collation support for the *Substring* built-in string function in Spark

[jira] [Commented] (SPARK-40782) Upgrade Jackson-databind to 2.13.4.1

2024-04-08 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834801#comment-17834801 ] Ramakrishna commented on SPARK-40782: - Hi this seems to be an issue still as transitive dependency

[jira] [Commented] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-08 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834800#comment-17834800 ] Gideon P commented on SPARK-47413: -- [~uros-db] can you find me an additional ticket to work on, for

[jira] [Updated] (SPARK-47759) Apps being stuck with an unexpected stack trace when reading/parsing a time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47759) Apps being stuck with an unexpected stack trace when reading/parsing a time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47759) App being stuck with an unexpected stack trace when reading/parsing a time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: App being stuck with an unexpected stack trace when reading/parsing a time string (was: A

[jira] [Updated] (SPARK-47759) Apps being stuck with an unexpected stack trace when reading/parsing a time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: Apps being stuck with an unexpected stack trace when reading/parsing a time string (was: App

[jira] [Updated] (SPARK-47759) A Spark app being stuck with an unexpected stack trace when reading/parsing a time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47759) A Spark app being stuck with an unexpected stack trace when reading/parsing a time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47759) A Spark app being stuck with an unexpected stack trace when reading/parsing a time string

2024-04-08 Thread Bo Xiong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Created] (SPARK-47760) Reeanble Avro function doctests

2024-04-08 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47760: Summary: Reeanble Avro function doctests Key: SPARK-47760 URL: https://issues.apache.org/jira/browse/SPARK-47760 Project: Spark Issue Type: Sub-task