[jira] [Assigned] (SPARK-43944) Add string functions to Scala and Python - part 2

[ https://issues.apache.org/jira/browse/SPARK-43944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43944: - Assignee: BingKun Pan > Add string functions to Scala and Python - part 2 > ---

[jira] [Resolved] (SPARK-43944) Add string functions to Scala and Python - part 2

[ https://issues.apache.org/jira/browse/SPARK-43944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43944. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41594 [https://

[jira] [Created] (SPARK-44092) Fix UtilsSuite Failure in Java 21

Dongjoon Hyun created SPARK-44092: - Summary: Fix UtilsSuite Failure in Java 21 Key: SPARK-44092 URL: https://issues.apache.org/jira/browse/SPARK-44092 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44067) Warning for the pandas-related behavior changes in next major release

[ https://issues.apache.org/jira/browse/SPARK-44067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-44067. - Fix Version/s: 3.5.0 Resolution: Fixed This is resolved by https://github.com/apache/spar

[jira] [Reopened] (SPARK-42618) Support pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-42618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reopened SPARK-42618: - > Support pandas 2.0.0. > - > > Key: SPARK-42618 >

[jira] [Resolved] (SPARK-44085) Update some maven plugins to newest version

[ https://issues.apache.org/jira/browse/SPARK-44085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44085. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41641 [https://

[jira] [Assigned] (SPARK-44085) Update some maven plugins to newest version

[ https://issues.apache.org/jira/browse/SPARK-44085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44085: - Assignee: BingKun Pan > Update some maven plugins to newest version > -

[jira] [Resolved] (SPARK-44088) Remove jdk.incubator.foreign usage in Java 21

[ https://issues.apache.org/jira/browse/SPARK-44088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44088. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41646 [https://

[jira] [Assigned] (SPARK-44088) Remove jdk.incubator.foreign usage in Java 21

[ https://issues.apache.org/jira/browse/SPARK-44088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44088: - Assignee: Dongjoon Hyun > Remove jdk.incubator.foreign usage in Java 21 > -

[jira] [Assigned] (SPARK-43835) Add `build_java21.yml` Github Action Daily Job

[ https://issues.apache.org/jira/browse/SPARK-43835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43835: - Assignee: Dongjoon Hyun > Add `build_java21.yml` Github Action Daily Job >

[jira] [Resolved] (SPARK-43835) Add `build_java21.yml` Github Action Daily Job

[ https://issues.apache.org/jira/browse/SPARK-43835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43835. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41645 [https://

[jira] [Updated] (SPARK-44091) Yarn module test failed on MacOs/Apple Slicon

[ https://issues.apache.org/jira/browse/SPARK-44091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44091: - Description: When I run  ``` build/sbt "yarn/test" -Pyarn -Dtest.exclude.tags=org.apache.spark.tags.Ex

[jira] [Created] (SPARK-44091) Yarn module test failed on MacOs/Apple Slicon

Yang Jie created SPARK-44091: Summary: Yarn module test failed on MacOs/Apple Slicon Key: SPARK-44091 URL: https://issues.apache.org/jira/browse/SPARK-44091 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-44090) Add a Java 21 build task in `build_and_test.yml`

Yang Jie created SPARK-44090: Summary: Add a Java 21 build task in `build_and_test.yml` Key: SPARK-44090 URL: https://issues.apache.org/jira/browse/SPARK-44090 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-44088) Remove jdk.incubator.foreign usage in Java 21

[ https://issues.apache.org/jira/browse/SPARK-44088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733847#comment-17733847 ] Snoot.io commented on SPARK-44088: -- User 'dongjoon-hyun' has created a pull request for

[jira] [Commented] (SPARK-44089) Remove the ignore Annotation from `AlterTableRenamePartitionSuite`

[ https://issues.apache.org/jira/browse/SPARK-44089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733848#comment-17733848 ] Snoot.io commented on SPARK-44089: -- User 'LuciferYang' has created a pull request for t

[jira] [Commented] (SPARK-44088) Remove jdk.incubator.foreign usage in Java 21

[ https://issues.apache.org/jira/browse/SPARK-44088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733846#comment-17733846 ] Snoot.io commented on SPARK-44088: -- User 'dongjoon-hyun' has created a pull request for

[jira] [Created] (SPARK-44089) Remove the ignore Annotation from `AlterTableRenamePartitionSuite`

Yang Jie created SPARK-44089: Summary: Remove the ignore Annotation from `AlterTableRenamePartitionSuite` Key: SPARK-44089 URL: https://issues.apache.org/jira/browse/SPARK-44089 Project: Spark I

[jira] [Created] (SPARK-44088) Remove jdk.incubator.foreign in Java 21

Dongjoon Hyun created SPARK-44088: - Summary: Remove jdk.incubator.foreign in Java 21 Key: SPARK-44088 URL: https://issues.apache.org/jira/browse/SPARK-44088 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-44088) Remove jdk.incubator.foreign usage in Java 21

[ https://issues.apache.org/jira/browse/SPARK-44088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44088: -- Summary: Remove jdk.incubator.foreign usage in Java 21 (was: Remove jdk.incubator.foreign in

[jira] [Commented] (SPARK-40497) Upgrade Scala to 2.13.11

[ https://issues.apache.org/jira/browse/SPARK-40497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733845#comment-17733845 ] Snoot.io commented on SPARK-40497: -- User 'LuciferYang' has created a pull request for t

[jira] [Commented] (SPARK-40497) Upgrade Scala to 2.13.11

[ https://issues.apache.org/jira/browse/SPARK-40497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733844#comment-17733844 ] Snoot.io commented on SPARK-40497: -- User 'LuciferYang' has created a pull request for t

[jira] [Commented] (SPARK-43835) Add `build_java21.yml` Github Action Daily Job

[ https://issues.apache.org/jira/browse/SPARK-43835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733843#comment-17733843 ] Snoot.io commented on SPARK-43835: -- User 'dongjoon-hyun' has created a pull request for

[jira] [Assigned] (SPARK-44086) Move `DataFrameFunctionsSuite` to `sql - slow`

[ https://issues.apache.org/jira/browse/SPARK-44086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44086: - Assignee: Ruifeng Zheng > Move `DataFrameFunctionsSuite` to `sql - slow` >

[jira] [Resolved] (SPARK-44086) Move `DataFrameFunctionsSuite` to `sql - slow`

[ https://issues.apache.org/jira/browse/SPARK-44086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44086. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41643 [https://

[jira] [Assigned] (SPARK-43832) Upgrade Scala to 2.12.18

[ https://issues.apache.org/jira/browse/SPARK-43832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43832: - Assignee: Yang Jie > Upgrade Scala to 2.12.18 > > >

[jira] [Resolved] (SPARK-43832) Upgrade Scala to 2.12.18

[ https://issues.apache.org/jira/browse/SPARK-43832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43832. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41627 [https://

[jira] [Updated] (SPARK-44087) pyspark sql

[ https://issues.apache.org/jira/browse/SPARK-44087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Shen updated SPARK-44087: -- Attachment: kafka.py > pyspark sql > --- > > Key: SPARK-44087 >

[jira] [Updated] (SPARK-44087) pyspark sql

[ https://issues.apache.org/jira/browse/SPARK-44087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Shen updated SPARK-44087: -- Description: h3. Background I am new to Spark and I am trying to use PySpark to read data from a Kafk

[jira] [Updated] (SPARK-44087) pyspark sql

[ https://issues.apache.org/jira/browse/SPARK-44087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Shen updated SPARK-44087: -- Attachment: (was: kafka.py) > pyspark sql > --- > > Key: SPARK-44087 >

[jira] [Updated] (SPARK-44024) Change to use `map` where `unzip` used to extract a single element

[ https://issues.apache.org/jira/browse/SPARK-44024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44024: - Priority: Trivial (was: Minor) > Change to use `map` where `unzip` used to extract a single ele

[jira] [Commented] (SPARK-43339) LEFT JOIN is treated as INNER JOIN when being in a middle of double join

[ https://issues.apache.org/jira/browse/SPARK-43339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733780#comment-17733780 ] Yuming Wang commented on SPARK-43339: - This is not a bug. The final result is correc

[jira] [Commented] (SPARK-43339) LEFT JOIN is treated as INNER JOIN when being in a middle of double join

[ https://issues.apache.org/jira/browse/SPARK-43339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733769#comment-17733769 ] Leonid Chistov commented on SPARK-43339: [~yumwang]  Sorry, but I don't underst

[jira] [Updated] (SPARK-44087) pyspark sql

[ https://issues.apache.org/jira/browse/SPARK-44087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Shen updated SPARK-44087: -- Attachment: kafka.py > pyspark sql > --- > > Key: SPARK-44087 >

[jira] [Created] (SPARK-44087) pyspark sql

Eric Shen created SPARK-44087: - Summary: pyspark sql Key: SPARK-44087 URL: https://issues.apache.org/jira/browse/SPARK-44087 Project: Spark Issue Type: Bug Components: PySpark Affec

[jira] [Updated] (SPARK-44086) Move `DataFrameFunctionsSuite` to `sql - slow`

[ https://issues.apache.org/jira/browse/SPARK-44086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44086: -- Summary: Move `DataFrameFunctionsSuite` to `sql - slow` (was: Move `DataFrameFunctionsSuite`

[jira] [Created] (SPARK-44086) Move `DataFrameFunctionsSuite` to `sql_slow`

Ruifeng Zheng created SPARK-44086: - Summary: Move `DataFrameFunctionsSuite` to `sql_slow` Key: SPARK-44086 URL: https://issues.apache.org/jira/browse/SPARK-44086 Project: Spark Issue Type: Te

[jira] [Updated] (SPARK-44085) Update some maven plugins to newest version

[ https://issues.apache.org/jira/browse/SPARK-44085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44085: Description: include: * versions-maven-plugin from 2.15.0 to 2.16.0 * maven-source-plugin from 3

[jira] [Created] (SPARK-44085) Update some maven plugins to newest version

BingKun Pan created SPARK-44085: --- Summary: Update some maven plugins to newest version Key: SPARK-44085 URL: https://issues.apache.org/jira/browse/SPARK-44085 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-43928) Add bit operations to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733725#comment-17733725 ] ASF GitHub Bot commented on SPARK-43928: User 'LuciferYang' has created a pull r

[jira] [Commented] (SPARK-43944) Add string functions to Scala and Python - part 2

[ https://issues.apache.org/jira/browse/SPARK-43944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733723#comment-17733723 ] ASF GitHub Bot commented on SPARK-43944: User 'panbingkun' has created a pull re

[jira] [Commented] (SPARK-43944) Add string functions to Scala and Python - part 2

[ https://issues.apache.org/jira/browse/SPARK-43944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733724#comment-17733724 ] ASF GitHub Bot commented on SPARK-43944: User 'panbingkun' has created a pull re

[jira] [Commented] (SPARK-43832) Upgrade Scala to 2.12.18

[ https://issues.apache.org/jira/browse/SPARK-43832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733721#comment-17733721 ] ASF GitHub Bot commented on SPARK-43832: User 'LuciferYang' has created a pull r