[jira] [Created] (SPARK-47947) Add AssertDataFrameEquality util function for scala

2024-04-22 Thread Anh Tuan Pham (Jira)
Anh Tuan Pham created SPARK-47947: - Summary: Add AssertDataFrameEquality util function for scala Key: SPARK-47947 URL: https://issues.apache.org/jira/browse/SPARK-47947 Project: Spark Issue

[jira] [Assigned] (SPARK-47943) Add Operator CI Task for Java Build and Test

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47943: - Assignee: Zhou JIANG > Add Operator CI Task for Java Build and Test >

[jira] [Resolved] (SPARK-47943) Add Operator CI Task for Java Build and Test

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47943. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 7

[jira] [Resolved] (SPARK-47929) Setup Static Analysis for Operator

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47929. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 6

[jira] [Resolved] (SPARK-47938) MsSQLServer: Cannot find data type BYTE error

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47938. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46164

[jira] [Resolved] (SPARK-47600) MLLib: Migrate logInfo with variables to structured logging framework

2024-04-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47600. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46151

[jira] [Assigned] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

2024-04-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47933: Assignee: Hyukjin Kwon > Parent Column class for Spark Connect and Spark Classic >

[jira] [Resolved] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

2024-04-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47933. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46155

[jira] [Created] (SPARK-47946) Nested field's nullable value could be invalid after extracted using GetStructField

2024-04-22 Thread Junyoung Cho (Jira)
Junyoung Cho created SPARK-47946: Summary: Nested field's nullable value could be invalid after extracted using GetStructField Key: SPARK-47946 URL: https://issues.apache.org/jira/browse/SPARK-47946

[jira] [Updated] (SPARK-47899) StageFailed event should attach the exception chain

2024-04-22 Thread Arjun Sahoo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arjun Sahoo updated SPARK-47899: Affects Version/s: 3.5.1 > StageFailed event should attach the exception chain >

[jira] [Updated] (SPARK-47943) Add Operator CI Task for Java Build and Test

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47943: --- Labels: pull-request-available (was: ) > Add Operator CI Task for Java Build and Test >

[jira] [Updated] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47945: --- Labels: pull-request-available (was: ) > MsSQLServer: Document Mapping Spark SQL Data

[jira] [Created] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests

2024-04-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47945: Summary: MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests Key: SPARK-47945 URL: https://issues.apache.org/jira/browse/SPARK-47945

[jira] [Resolved] (SPARK-47937) Fix docstring of `hll_sketch_agg`

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47937. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46163

[jira] [Assigned] (SPARK-47937) Fix docstring of `hll_sketch_agg`

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47937: - Assignee: Ruifeng Zheng > Fix docstring of `hll_sketch_agg` >

[jira] [Commented] (SPARK-47903) Add remaining scalar types to the Python variant library

2024-04-22 Thread Harsh Motwani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839897#comment-17839897 ] Harsh Motwani commented on SPARK-47903: --- Follow Up: Some changes from another branch were

[jira] [Created] (SPARK-47943) Add Operator CI Task for Java Build and Test

2024-04-22 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-47943: -- Summary: Add Operator CI Task for Java Build and Test Key: SPARK-47943 URL: https://issues.apache.org/jira/browse/SPARK-47943 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47903) Add remaining scalar types to the Python variant library

2024-04-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47903. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46122

[jira] [Assigned] (SPARK-47903) Add remaining scalar types to the Python variant library

2024-04-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47903: Assignee: Harsh Motwani > Add remaining scalar types to the Python variant library >

[jira] [Resolved] (SPARK-47904) Preserve case in Avro schema when using enableStableIdentifiersForUnionType

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47904. --- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46169

[jira] [Updated] (SPARK-47904) Preserve case in Avro schema when using enableStableIdentifiersForUnionType

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47904: -- Fix Version/s: 4.0.0 > Preserve case in Avro schema when using

[jira] [Assigned] (SPARK-47904) Preserve case in Avro schema when using enableStableIdentifiersForUnionType

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47904: - Assignee: Ivan Sadikov > Preserve case in Avro schema when using

[jira] [Resolved] (SPARK-47942) Drop K8s v1.26 Support

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47942. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46168

[jira] [Assigned] (SPARK-47942) Drop K8s v1.26 Support

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47942: - Assignee: Dongjoon Hyun > Drop K8s v1.26 Support > -- > >

[jira] [Assigned] (SPARK-47907) Put removal of '!' as a synonym for 'NOT' on a keyword level under a config

2024-04-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-47907: -- Assignee: Serge Rielau > Put removal of '!' as a synonym for 'NOT' on a keyword

[jira] [Resolved] (SPARK-47907) Put removal of '!' as a synonym for 'NOT' on a keyword level under a config

2024-04-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-47907. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46138

[jira] [Updated] (SPARK-47942) Drop K8s v1.26 Support

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47942: --- Labels: pull-request-available (was: ) > Drop K8s v1.26 Support > -- >

[jira] [Created] (SPARK-47942) Drop K8s v1.26 Support

2024-04-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47942: - Summary: Drop K8s v1.26 Support Key: SPARK-47942 URL: https://issues.apache.org/jira/browse/SPARK-47942 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47940) Upgrade `guava` dependency to `33.1.0-jre` in Docker IT

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47940: -- Reporter: Cheng Pan (was: Dongjoon Hyun) > Upgrade `guava` dependency to `33.1.0-jre` in

[jira] [Resolved] (SPARK-47940) Upgrade `guava` dependency to `33.1.0-jre` in Docker IT

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47940. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46167

[jira] [Updated] (SPARK-47941) Propagate ForeachBatch worker initialization errors to users for PySpark

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47941: --- Labels: pull-request-available (was: ) > Propagate ForeachBatch worker initialization

[jira] [Updated] (SPARK-47941) Propagate ForeachBatch worker initialization errors to users for PySpark

2024-04-22 Thread Eric Marnadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Marnadi updated SPARK-47941: - Summary: Propagate ForeachBatch worker initialization errors to users for PySpark (was:

[jira] [Updated] (SPARK-47940) Upgrade `guava` dependency to `33.1.0-jre` in Docker IT

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47940: --- Labels: pull-request-available (was: ) > Upgrade `guava` dependency to `33.1.0-jre` in

[jira] [Created] (SPARK-47940) Upgrade `guava` dependency to `33.1.0-jre` in Docker IT

2024-04-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47940: - Summary: Upgrade `guava` dependency to `33.1.0-jre` in Docker IT Key: SPARK-47940 URL: https://issues.apache.org/jira/browse/SPARK-47940 Project: Spark

[jira] [Assigned] (SPARK-47935) Pin pandas==2.0.3 for pypy3.8

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47935: - Assignee: Ruifeng Zheng > Pin pandas==2.0.3 for pypy3.8 >

[jira] [Resolved] (SPARK-47935) Pin pandas==2.0.3 for pypy3.8

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47935. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46159

[jira] [Commented] (SPARK-47010) Kubernetes: support csi driver for volume type

2024-04-22 Thread Oleg Frenkel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839707#comment-17839707 ] Oleg Frenkel commented on SPARK-47010: -- Posted question on Stackoverflow:

[jira] [Commented] (SPARK-47869) Upgrade built in hive to Hive-4.0

2024-04-22 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839669#comment-17839669 ] Cheng Pan commented on SPARK-47869: --- cross link SPARK-44114 > Upgrade built in hive to Hive-4.0 >

[jira] [Created] (SPARK-47939) Parameterized queries fail for DESCRIBE & EXPLAIN w/ UNBOUND_SQL_PARAMETER error

2024-04-22 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-47939: Summary: Parameterized queries fail for DESCRIBE & EXPLAIN w/ UNBOUND_SQL_PARAMETER error Key: SPARK-47939 URL: https://issues.apache.org/jira/browse/SPARK-47939

[jira] [Assigned] (SPARK-47411) StringInstr, FindInSet (all collations)

2024-04-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47411: --- Assignee: Milan Dankovic > StringInstr, FindInSet (all collations) >

[jira] [Resolved] (SPARK-47411) StringInstr, FindInSet (all collations)

2024-04-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47411. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45643

[jira] [Updated] (SPARK-47938) MsSQLServer: Cannot find data type BYTE error

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47938: --- Labels: pull-request-available (was: ) > MsSQLServer: Cannot find data type BYTE error >

[jira] [Created] (SPARK-47938) MsSQLServer: Cannot find data type BYTE error

2024-04-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47938: Summary: MsSQLServer: Cannot find data type BYTE error Key: SPARK-47938 URL: https://issues.apache.org/jira/browse/SPARK-47938 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

2024-04-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47928. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46150

[jira] [Assigned] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

2024-04-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-47928: Assignee: Cheng Pan > Speed up test "Add jar support Ivy URI in SQL" >

[jira] [Updated] (SPARK-47351) StringToMap & Mask (all collations)

2024-04-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47351: - Summary: StringToMap & Mask (all collations) (was: StringToMap (all collations)) >

[jira] [Updated] (SPARK-47421) TBD

2024-04-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: TBD (was: Mask (all collations)) > TBD > --- > > Key: SPARK-47421 >

[jira] [Updated] (SPARK-47937) Fix docstring of `hll_sketch_agg`

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47937: --- Labels: pull-request-available (was: ) > Fix docstring of `hll_sketch_agg` >

[jira] [Created] (SPARK-47937) Fix docstring of `hll_sketch_agg`

2024-04-22 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47937: - Summary: Fix docstring of `hll_sketch_agg` Key: SPARK-47937 URL: https://issues.apache.org/jira/browse/SPARK-47937 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47936: -- Assignee: (was: Apache Spark) > Improve `toUpperCase` & `toLowerCase` with

[jira] [Assigned] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47936: -- Assignee: (was: Apache Spark) > Improve `toUpperCase` & `toLowerCase` with

[jira] [Updated] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47936: --- Labels: pull-request-available (was: ) > Improve `toUpperCase` & `toLowerCase` with

[jira] [Assigned] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47936: -- Assignee: Apache Spark > Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT`

[jira] [Assigned] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47936: -- Assignee: Apache Spark > Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT`

[jira] [Assigned] (SPARK-47873) Write collated strings to hive as regular strings

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47873: -- Assignee: (was: Apache Spark) > Write collated strings to hive as regular

[jira] [Assigned] (SPARK-47873) Write collated strings to hive as regular strings

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47873: -- Assignee: Apache Spark > Write collated strings to hive as regular strings >

[jira] [Created] (SPARK-47936) Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules

2024-04-22 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-47936: --- Summary: Improve `toUpperCase` & `toLowerCase` with `Locale.ROOT` rules Key: SPARK-47936 URL: https://issues.apache.org/jira/browse/SPARK-47936 Project: Spark

[jira] [Commented] (SPARK-47351) StringToMap (all collations)

2024-04-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839550#comment-17839550 ] Uroš Bojanić commented on SPARK-47351: -- working on this > StringToMap (all collations) >

[jira] [Updated] (SPARK-47935) Pin pandas==2.0.3 for pypy3.8

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47935: --- Labels: pull-request-available (was: ) > Pin pandas==2.0.3 for pypy3.8 >

[jira] [Created] (SPARK-47935) Pin pandas==2.0.3 for pypy3.8

2024-04-22 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-47935: - Summary: Pin pandas==2.0.3 for pypy3.8 Key: SPARK-47935 URL: https://issues.apache.org/jira/browse/SPARK-47935 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47350) SplitPart (binary & lowercase collation only)

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47350: --- Labels: pull-request-available (was: ) > SplitPart (binary & lowercase collation only) >

[jira] [Resolved] (SPARK-47900) Fix check for implicit collation

2024-04-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47900. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46116

[jira] [Resolved] (SPARK-47930) Upgrade RoaringBitmap to 1.0.6

2024-04-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47930. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46152

[jira] [Updated] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47934: --- Labels: pull-request-available (was: ) > Inefficient Redirect Handling Due to Missing

[jira] [Resolved] (SPARK-47890) Add python and scala dataframe variant expression aliases.

2024-04-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47890. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46123

[jira] [Assigned] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47413: --- Assignee: Gideon P > Substring, Right, Left (all collations) >

[jira] [Resolved] (SPARK-47413) Substring, Right, Left (all collations)

2024-04-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47413. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46040

[jira] [Updated] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

2024-04-22 Thread huangzhir (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangzhir updated SPARK-47934: -- Attachment: image-2024-04-22-15-14-13-468.png > Inefficient Redirect Handling Due to Missing Trailing

[jira] [Updated] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

2024-04-22 Thread huangzhir (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangzhir updated SPARK-47934: -- Description: *Summary:* The current implementation of URL redirection in Spark's history web UI does

[jira] [Updated] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

2024-04-22 Thread huangzhir (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huangzhir updated SPARK-47934: -- Description: {*}{{*}}Summary:{{*}}{*} The current implementation of URL redirection in Spark's

[jira] [Created] (SPARK-47934) Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection

2024-04-22 Thread huangzhir (Jira)
huangzhir created SPARK-47934: - Summary: Inefficient Redirect Handling Due to Missing Trailing Slashes in URL Redirection Key: SPARK-47934 URL: https://issues.apache.org/jira/browse/SPARK-47934 Project:

[jira] [Updated] (SPARK-47927) Nullability after join not respected in UDF

2024-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47927: --- Labels: pull-request-available (was: ) > Nullability after join not respected in UDF >

[jira] [Resolved] (SPARK-47932) Avoid using legacy commons-lang

2024-04-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47932. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46154

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-22 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: SPIP doc:

[jira] [Comment Edited] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-22 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839497#comment-17839497 ] Ke Jia edited comment on SPARK-47773 at 4/22/24 6:22 AM: - We have refined the

[jira] [Comment Edited] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-22 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839497#comment-17839497 ] Ke Jia edited comment on SPARK-47773 at 4/22/24 6:22 AM: - We have refined the

[jira] [Commented] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

2024-04-22 Thread Ke Jia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839497#comment-17839497 ] Ke Jia commented on SPARK-47773: We have refined the above