[jira] [Updated] (SPARK-47896) Upgrade netty to `4.1.109.Final`

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47896: --- Labels: pull-request-available (was: ) > Upgrade netty to `4.1.109.Final` >

[jira] [Comment Edited] (SPARK-47172) Upgrade Transport block cipher mode to GCM

2024-04-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838474#comment-17838474 ] Mridul Muralidharan edited comment on SPARK-47172 at 4/18/24 5:47 AM:

[jira] [Resolved] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

2024-04-17 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47591. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45926

[jira] [Created] (SPARK-47896) Upgrade netty to `4.1.109.Final`

2024-04-17 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47896: --- Summary: Upgrade netty to `4.1.109.Final` Key: SPARK-47896 URL: https://issues.apache.org/jira/browse/SPARK-47896 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-47172) Upgrade Transport block cipher mode to GCM

2024-04-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838474#comment-17838474 ] Mridul Muralidharan commented on SPARK-47172: - We do not backport features to released

[jira] [Updated] (SPARK-47895) group by all should be idempotent

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47895: --- Labels: pull-request-available (was: ) > group by all should be idempotent >

[jira] [Updated] (SPARK-47895) group by all should be idempotent

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-47895: Summary: group by all should be idempotent (was: group by ordinal should be idempotent) > group

[jira] [Created] (SPARK-47895) group by ordinal should be idempotent

2024-04-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-47895: --- Summary: group by ordinal should be idempotent Key: SPARK-47895 URL: https://issues.apache.org/jira/browse/SPARK-47895 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47882: - Assignee: Kent Yao > createTableColumnTypes need to be mapped to database types

[jira] [Resolved] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47882. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46093

[jira] [Resolved] (SPARK-47894) Add `Environment` page to Master UI

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47894. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46111

[jira] [Assigned] (SPARK-47894) Add `Environment` page to Master UI

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47894: - Assignee: Dongjoon Hyun > Add `Environment` page to Master UI >

[jira] [Assigned] (SPARK-47839) Fix Aggregate bug in RewriteWithExpression

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47839: --- Assignee: Kelvin Jiang > Fix Aggregate bug in RewriteWithExpression >

[jira] [Resolved] (SPARK-47839) Fix Aggregate bug in RewriteWithExpression

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47839. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46034

[jira] [Resolved] (SPARK-47846) Add support for Variant schema in from_json

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47846. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46046

[jira] [Assigned] (SPARK-47846) Add support for Variant schema in from_json

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47846: --- Assignee: Harsh Motwani > Add support for Variant schema in from_json >

[jira] [Comment Edited] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan edited comment on SPARK-47429 at 4/18/24 1:26 AM: -- This will be

[jira] [Comment Edited] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan edited comment on SPARK-47429 at 4/18/24 1:26 AM: -- This will be

[jira] [Commented] (SPARK-47429) Rename errorClass to errorCondition

2024-04-17 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838412#comment-17838412 ] BingKun Pan commented on SPARK-47429: - This will be a very huge task, and I roughly counted almost

[jira] [Resolved] (SPARK-47891) Improve docstring of mapInPandas

2024-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47891. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46108

[jira] [Updated] (SPARK-47894) Add `Environment` page to Master UI

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47894: --- Labels: pull-request-available (was: ) > Add `Environment` page to Master UI >

[jira] [Created] (SPARK-47894) Add `Environment` page to Master UI

2024-04-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47894: - Summary: Add `Environment` page to Master UI Key: SPARK-47894 URL: https://issues.apache.org/jira/browse/SPARK-47894 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47892) XML: Stop ignoring CDATA within rows.

2024-04-17 Thread Yousof Hosny (Jira)
Yousof Hosny created SPARK-47892: Summary: XML: Stop ignoring CDATA within rows. Key: SPARK-47892 URL: https://issues.apache.org/jira/browse/SPARK-47892 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47891) Improve docstring of mapInPandas

2024-04-17 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-47891: - Description: Improve docstring of mapInPandas * "using a Python native function that takes and

[jira] [Updated] (SPARK-47891) Improve docstring of mapInPandas

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47891: --- Labels: pull-request-available (was: ) > Improve docstring of mapInPandas >

[jira] [Commented] (SPARK-47172) Upgrade Transport block cipher mode to GCM

2024-04-17 Thread Steve Weis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838380#comment-17838380 ] Steve Weis commented on SPARK-47172: [~mridulm80] What about 3.x? If we backported TLS support, that

[jira] [Updated] (SPARK-47889) Setup gradle as build tool for operator repository

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47889: --- Labels: pull-request-available (was: ) > Setup gradle as build tool for operator

[jira] [Created] (SPARK-47889) Setup gradle as build tool for operator repository

2024-04-17 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-47889: -- Summary: Setup gradle as build tool for operator repository Key: SPARK-47889 URL: https://issues.apache.org/jira/browse/SPARK-47889 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47584) SQL core: Migrate logWarn with variables to structured logging framework

2024-04-17 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47584. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46057

[jira] [Resolved] (SPARK-47627) MERGE with WITH SCHEMA EVOLUTION keywords

2024-04-17 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47627. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45748

[jira] [Resolved] (SPARK-47360) Overlay, FormatString, Length, BitLength, OctetLength, SoundEx, Luhncheck (all collations)

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47360. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46003

[jira] [Resolved] (SPARK-47726) Document push-based shuffle metrics

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47726. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45872

[jira] [Assigned] (SPARK-47726) Document push-based shuffle metrics

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47726: - Assignee: Luca Canali > Document push-based shuffle metrics >

[jira] [Resolved] (SPARK-47416) Add benchmark for stringpredicate expressions

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47416. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46078

[jira] [Resolved] (SPARK-47886) Postgres: Add test and doc for Postgres special numeric values

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47886. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46102

[jira] [Updated] (SPARK-47887) Remove unused import `spark/connect/common.proto` from `spark/connect/relations.proto`

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47887: --- Labels: pull-request-available (was: ) > Remove unused import `spark/connect/common.proto`

[jira] [Created] (SPARK-47887) Remove unused import `spark/connect/common.proto` from `spark/connect/relations.proto`

2024-04-17 Thread Yang Jie (Jira)
Yang Jie created SPARK-47887: Summary: Remove unused import `spark/connect/common.proto` from `spark/connect/relations.proto` Key: SPARK-47887 URL: https://issues.apache.org/jira/browse/SPARK-47887

[jira] [Resolved] (SPARK-47830) Reeanble ResourceProfileTests for pyspark-connect

2024-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47830. -- Fix Version/s: 4.0.0 Assignee: Hyukjin Kwon Resolution: Fixed fixed in

[jira] [Resolved] (SPARK-47885) Make pyspark.resource compatible with pyspark-connect

2024-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47885. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46100

[jira] [Resolved] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)

2024-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47540. -- Fix Version/s: 4.0.0 Assignee: Hyukjin Kwon Resolution: Done > SPIP: Pure

[jira] [Updated] (SPARK-47351) Between

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47351: - Summary: Between (was: TBD) > Between > --- > > Key: SPARK-47351 >

[jira] [Updated] (SPARK-47408) Distinct

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47408: - Summary: Distinct (was: TBD) > Distinct > > > Key: SPARK-47408 >

[jira] [Updated] (SPARK-47352) Fix Upper, Lower, InitCap collation awareness

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47352: --- Labels: pull-request-available (was: ) > Fix Upper, Lower, InitCap collation awareness >

[jira] [Resolved] (SPARK-47863) endsWith and startsWith don't work correctly for some collations

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47863. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46097

[jira] [Assigned] (SPARK-47863) endsWith and startsWith don't work correctly for some collations

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47863: --- Assignee: Vladimir Golubev > endsWith and startsWith don't work correctly for some

[jira] [Updated] (SPARK-47421) TBD

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: TBD (was: Split, SplitPart (binary & lowercase collation only)) > TBD > --- > >

[jira] [Updated] (SPARK-47353) NullIf

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47353: - Summary: NullIf (was: TBD) > NullIf > -- > > Key: SPARK-47353 >

[jira] [Updated] (SPARK-47355) Min & Max

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47355: - Summary: Min & Max (was: TBD) > Min & Max > - > > Key: SPARK-47355 >

[jira] [Updated] (SPARK-47354) Case

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47354: - Summary: Case (was: TBD) > Case > > > Key: SPARK-47354 >

[jira] [Updated] (SPARK-47421) Coalesce

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: Coalesce (was: TBD) > Coalesce > > > Key: SPARK-47421 >

[jira] [Updated] (SPARK-47350) SplitPart (binary & lowercase collation only)

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47350: - Summary: SplitPart (binary & lowercase collation only) (was: SplitPart (binary & lowercase

[jira] [Updated] (SPARK-47350) SplitPart (binary & lowercase collation)

2024-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47350: - Summary: SplitPart (binary & lowercase collation) (was: TBD) > SplitPart (binary & lowercase

[jira] [Resolved] (SPARK-47884) Switch ANSI SQL CI job to NON-ANSI SQL CI job

2024-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47884. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46099

[jira] [Assigned] (SPARK-47864) Enhance "Installation" page to cover all installable options

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47864: -- Assignee: Apache Spark > Enhance "Installation" page to cover all installable

[jira] [Assigned] (SPARK-47864) Enhance "Installation" page to cover all installable options

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47864: -- Assignee: (was: Apache Spark) > Enhance "Installation" page to cover all

[jira] [Assigned] (SPARK-47864) Enhance "Installation" page to cover all installable options

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47864: -- Assignee: Apache Spark > Enhance "Installation" page to cover all installable

[jira] [Assigned] (SPARK-47864) Enhance "Installation" page to cover all installable options

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47864: -- Assignee: (was: Apache Spark) > Enhance "Installation" page to cover all

[jira] [Updated] (SPARK-47885) Make pyspark.resource compatible with pyspark-connect

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47885: --- Labels: pull-request-available (was: ) > Make pyspark.resource compatible with

[jira] [Updated] (SPARK-47807) Make pyspark.ml compatible with pyspark-connect

2024-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47807: - Summary: Make pyspark.ml compatible with pyspark-connect (was: Make pyspark.ml compatible

[jira] [Created] (SPARK-47885) Make pyspark.resource compatible with pyspark-connect

2024-04-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47885: Summary: Make pyspark.resource compatible with pyspark-connect Key: SPARK-47885 URL: https://issues.apache.org/jira/browse/SPARK-47885 Project: Spark Issue

[jira] [Updated] (SPARK-47884) Switch ANSI SQL CI job to NON-ANSI SQL CI job

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47884: -- Summary: Switch ANSI SQL CI job to NON-ANSI SQL CI job (was: Switch ANSI SQL CI to NON-ANSI

[jira] [Assigned] (SPARK-47884) Switch ANSI SQL CI job to NON-ANSI SQL CI job

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47884: - Assignee: Dongjoon Hyun > Switch ANSI SQL CI job to NON-ANSI SQL CI job >

[jira] [Updated] (SPARK-47884) Switch ANSI SQL CI to NON-ANSI SQL CI

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47884: --- Labels: pull-request-available (was: ) > Switch ANSI SQL CI to NON-ANSI SQL CI >

[jira] [Created] (SPARK-47884) Switch ANSI SQL CI to NON-ANSI SQL CI

2024-04-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47884: - Summary: Switch ANSI SQL CI to NON-ANSI SQL CI Key: SPARK-47884 URL: https://issues.apache.org/jira/browse/SPARK-47884 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44444) Use ANSI mode by default

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-4. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46013

[jira] [Updated] (SPARK-44444) Use ANSI SQL mode by default

2024-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-4: -- Summary: Use ANSI SQL mode by default (was: Use ANSI mode by default) > Use ANSI SQL mode by

[jira] [Assigned] (SPARK-47822) Prohibit Hash expressions from hashing Variant type

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47822: --- Assignee: Harsh Motwani > Prohibit Hash expressions from hashing Variant type >

[jira] [Resolved] (SPARK-47822) Prohibit Hash expressions from hashing Variant type

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47822. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46017

[jira] [Resolved] (SPARK-47821) Add is_variant_null expression

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47821. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46011

[jira] [Resolved] (SPARK-47867) Support Variant in JSON scan.

2024-04-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47867. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46071

[jira] [Updated] (SPARK-47863) endsWith and startsWith don't work correctly for some collations

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47863: --- Labels: pull-request-available (was: ) > endsWith and startsWith don't work correctly for

[jira] [Updated] (SPARK-47864) Enhance "Installation" page to cover all installable options

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47864: --- Labels: pull-request-available (was: ) > Enhance "Installation" page to cover all

[jira] [Updated] (SPARK-47883) Make CollectTailExec execute lazily

2024-04-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47883: --- Labels: pull-request-available (was: ) > Make CollectTailExec execute lazily >

[jira] [Updated] (SPARK-47883) Make CollectTailExec execute lazily

2024-04-17 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47883: -- Summary: Make CollectTailExec execute lazily (was: Make CollectTailExec lazily execute) >

[jira] [Created] (SPARK-47883) Make CollectTailExec lazily execute

2024-04-17 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47883: - Summary: Make CollectTailExec lazily execute Key: SPARK-47883 URL: https://issues.apache.org/jira/browse/SPARK-47883 Project: Spark Issue Type: