[jira] [Updated] (SPARK-42905) pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties.

2023-03-22 Thread dronzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dronzer updated SPARK-42905: Labels: correctness (was: ) > pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect

[jira] [Updated] (SPARK-42905) pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties.

2023-03-22 Thread dronzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dronzer updated SPARK-42905: Attachment: image-2023-03-23-10-55-26-879.png > pyspark.ml.stat.Correlation - Spearman Correlation method

[jira] [Updated] (SPARK-42905) pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties.

2023-03-22 Thread dronzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dronzer updated SPARK-42905: Description: pyspark.ml.stat.Correlation Following is the Scenario where the Correlation function fails

[jira] [Updated] (SPARK-42905) pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties.

2023-03-22 Thread dronzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dronzer updated SPARK-42905: Attachment: image-2023-03-23-10-53-37-461.png > pyspark.ml.stat.Correlation - Spearman Correlation method

[jira] [Updated] (SPARK-42905) pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties.

2023-03-22 Thread dronzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dronzer updated SPARK-42905: Attachment: image-2023-03-23-10-52-49-392.png > pyspark.ml.stat.Correlation - Spearman Correlation method

[jira] [Updated] (SPARK-42905) pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties.

2023-03-22 Thread dronzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dronzer updated SPARK-42905: Attachment: image-2023-03-23-10-52-11-481.png > pyspark.ml.stat.Correlation - Spearman Correlation method

[jira] [Updated] (SPARK-42905) pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties.

2023-03-22 Thread dronzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dronzer updated SPARK-42905: Attachment: image-2023-03-23-10-51-28-420.png > pyspark.ml.stat.Correlation - Spearman Correlation method

[jira] [Created] (SPARK-42905) pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties.

2023-03-22 Thread dronzer (Jira)
dronzer created SPARK-42905: --- Summary: pyspark.ml.stat.Correlation - Spearman Correlation method giving incorrect and inconsistent results for the same DataFrame if it has huge amount of Ties. Key: SPARK-42905 URL:

[jira] [Created] (SPARK-42904) Char/Varchar Support for JDBC Catalog

2023-03-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-42904: Summary: Char/Varchar Support for JDBC Catalog Key: SPARK-42904 URL: https://issues.apache.org/jira/browse/SPARK-42904 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42903) Avoid documenting None as as a return value in docstring

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42903: - Priority: Trivial (was: Major) > Avoid documenting None as as a return value in docstring >

[jira] [Resolved] (SPARK-42863) Review and fix issues in PySpark API docs

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42863. -- Resolution: Done > Review and fix issues in PySpark API docs >

[jira] [Created] (SPARK-42903) Avoid documenting None as as a return value in docstring

2023-03-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-42903: Summary: Avoid documenting None as as a return value in docstring Key: SPARK-42903 URL: https://issues.apache.org/jira/browse/SPARK-42903 Project: Spark

[jira] [Resolved] (SPARK-42901) Should move message StorageLevel from `base.proto` to a separate file

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42901. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40518

[jira] [Assigned] (SPARK-42901) Should move message StorageLevel from `base.proto` to a separate file

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42901: Assignee: Yang Jie > Should move message StorageLevel from `base.proto` to a separate

[jira] [Created] (SPARK-42902) CVE-2020-13936 request for upgrading version of Velocity

2023-03-22 Thread JacobZheng (Jira)
JacobZheng created SPARK-42902: -- Summary: CVE-2020-13936 request for upgrading version of Velocity Key: SPARK-42902 URL: https://issues.apache.org/jira/browse/SPARK-42902 Project: Spark Issue

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from `base.proto` to a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move message StorageLevel from `base.proto` to a separate file (was: Should move

[jira] [Resolved] (SPARK-41500) auto generate concat as Double when string minus an INTERVAL type

2023-03-22 Thread JacobZheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JacobZheng resolved SPARK-41500. Resolution: Won't Fix > auto generate concat as Double when string minus an INTERVAL type >

[jira] [Resolved] (SPARK-42899) DataFrame.to(schema) fails when it contains non-nullable nested field in nullable field

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42899. -- Fix Version/s: 3.4.1 Assignee: Takuya Ueshin Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from `base.proto` into a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move message StorageLevel from `base.proto` into a separate file (was: Should move

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from into a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move message StorageLevel from into a separate file (was: Should move StorageLevel

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from into a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Description: [https://github.com/apache/spark/pull/40510] introduce `message StorageLevel` to

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from `base.proto` to a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move message StorageLevel from `base.proto` to a separate file (was: Should move

[jira] [Updated] (SPARK-42901) Should move StorageLevel into a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move StorageLevel into a separate file (was: Move StorageLevel into a separate file to

[jira] [Created] (SPARK-42901) Move StorageLevel into a separate file to avoid potential file recursively imports

2023-03-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-42901: Summary: Move StorageLevel into a separate file to avoid potential file recursively imports Key: SPARK-42901 URL: https://issues.apache.org/jira/browse/SPARK-42901 Project:

[jira] [Commented] (SPARK-42895) ValueError when invoking any session operations on a stopped Spark session

2023-03-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703815#comment-17703815 ] Rui Wang commented on SPARK-42895: -- Of course though it probably need a better error message locally.

[jira] [Resolved] (SPARK-42748) Server-side Artifact Management

2023-03-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42748. --- Fix Version/s: 3.5.0 Resolution: Fixed > Server-side Artifact Management >

[jira] [Commented] (SPARK-42895) ValueError when invoking any session operations on a stopped Spark session

2023-03-22 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703814#comment-17703814 ] Rui Wang commented on SPARK-42895: -- In fact spark.stop() does not stop the remote spark session but

[jira] [Created] (SPARK-42900) Fix createDataFrame to respect both type inference and column names.

2023-03-22 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-42900: - Summary: Fix createDataFrame to respect both type inference and column names. Key: SPARK-42900 URL: https://issues.apache.org/jira/browse/SPARK-42900 Project:

[jira] [Updated] (SPARK-42899) DataFrame.to(schema) fails when it contains non-nullable nested field in nullable field

2023-03-22 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-42899: -- Summary: DataFrame.to(schema) fails when it contains non-nullable nested field in nullable

[jira] [Updated] (SPARK-42899) DataFrame.to(schema) fails with the schema of itself.

2023-03-22 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-42899: -- Description: {{DataFrame.to(schema)}} fails when it contains non-nullable nested field in

[jira] [Created] (SPARK-42899) DataFrame.to(schema) fails with the schema of itself.

2023-03-22 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-42899: - Summary: DataFrame.to(schema) fails with the schema of itself. Key: SPARK-42899 URL: https://issues.apache.org/jira/browse/SPARK-42899 Project: Spark

[jira] [Resolved] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-22 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42892. --- Fix Version/s: 3.5.0 Resolution: Fixed > Move sameType and relevant methods

[jira] [Resolved] (SPARK-42832) Remove repartition if it is the child of LocalLimit

2023-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42832. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40462

[jira] [Assigned] (SPARK-42832) Remove repartition if it is the child of LocalLimit

2023-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42832: - Assignee: Yuming Wang > Remove repartition if it is the child of LocalLimit >

[jira] [Assigned] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42894: - Assignee: Yang Jie > Implement cache, persist, unpersist, and storageLevel >

[jira] [Resolved] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42894. --- Fix Version/s: 3.4.1 Resolution: Fixed Issue resolved by pull request 40516

[jira] [Assigned] (SPARK-42898) Cast from string to date and date to string say timezone is needed, but it is not used

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42898: Assignee: (was: Apache Spark) > Cast from string to date and date to string say

[jira] [Commented] (SPARK-42898) Cast from string to date and date to string say timezone is needed, but it is not used

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703720#comment-17703720 ] Apache Spark commented on SPARK-42898: -- User 'revans2' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42898) Cast from string to date and date to string say timezone is needed, but it is not used

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42898: Assignee: Apache Spark > Cast from string to date and date to string say timezone is

[jira] [Created] (SPARK-42898) Cast from string to date and date to string say timezone is needed, but it is not used

2023-03-22 Thread Robert Joseph Evans (Jira)
Robert Joseph Evans created SPARK-42898: --- Summary: Cast from string to date and date to string say timezone is needed, but it is not used Key: SPARK-42898 URL:

[jira] [Assigned] (SPARK-42815) Subexpression elimination support shortcut expression

2023-03-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42815: --- Assignee: XiDuo You > Subexpression elimination support shortcut expression >

[jira] [Commented] (SPARK-42897) Avoid evaluate more than once for the variables from the left side in the FullOuter SMJ condition

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703686#comment-17703686 ] Apache Spark commented on SPARK-42897: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42897) Avoid evaluate more than once for the variables from the left side in the FullOuter SMJ condition

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42897: Assignee: Apache Spark > Avoid evaluate more than once for the variables from the left

[jira] [Assigned] (SPARK-42897) Avoid evaluate more than once for the variables from the left side in the FullOuter SMJ condition

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42897: Assignee: (was: Apache Spark) > Avoid evaluate more than once for the variables from

[jira] [Resolved] (SPARK-42815) Subexpression elimination support shortcut expression

2023-03-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42815. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40446

[jira] [Created] (SPARK-42897) Avoid evaluate more than once for the variables from the left side in the FullOuter SMJ condition

2023-03-22 Thread Wan Kun (Jira)
Wan Kun created SPARK-42897: --- Summary: Avoid evaluate more than once for the variables from the left side in the FullOuter SMJ condition Key: SPARK-42897 URL: https://issues.apache.org/jira/browse/SPARK-42897

[jira] [Commented] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703677#comment-17703677 ] Apache Spark commented on SPARK-42101: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-42896) Make `mapInPandas` / mapInArrow` support barrier mode execution

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703637#comment-17703637 ] Apache Spark commented on SPARK-42896: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-42896) Make `mapInPandas` / mapInArrow` support barrier mode execution

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42896: Assignee: (was: Apache Spark) > Make `mapInPandas` / mapInArrow` support barrier

[jira] [Assigned] (SPARK-42896) Make `mapInPandas` / mapInArrow` support barrier mode execution

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42896: Assignee: Apache Spark > Make `mapInPandas` / mapInArrow` support barrier mode execution

[jira] [Created] (SPARK-42896) Make `mapInPandas` / mapInArrow` support barrier mode execution

2023-03-22 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-42896: -- Summary: Make `mapInPandas` / mapInArrow` support barrier mode execution Key: SPARK-42896 URL: https://issues.apache.org/jira/browse/SPARK-42896 Project: Spark

[jira] [Commented] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703615#comment-17703615 ] Apache Spark commented on SPARK-42864: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703614#comment-17703614 ] Apache Spark commented on SPARK-42864: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-42895) ValueError when invoking any session operations on a stopped Spark session

2023-03-22 Thread Allison Wang (Jira)
Allison Wang created SPARK-42895: Summary: ValueError when invoking any session operations on a stopped Spark session Key: SPARK-42895 URL: https://issues.apache.org/jira/browse/SPARK-42895 Project:

[jira] [Commented] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703541#comment-17703541 ] Apache Spark commented on SPARK-42889: -- User 'LuciferYang' has created a pull request for this

[jira] [Resolved] (SPARK-42874) Enable new golden file test framework for analysis for all input files

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42874. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40496

[jira] [Assigned] (SPARK-42874) Enable new golden file test framework for analysis for all input files

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42874: Assignee: Daniel > Enable new golden file test framework for analysis for all input

[jira] [Assigned] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42893: Assignee: Xinrong Meng > Block Arrow-optimized Python UDFs >

[jira] [Resolved] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42893. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40513

[jira] [Assigned] (SPARK-41233) High-order function: array_prepend

2023-03-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41233: Assignee: Takuya Ueshin > High-order function: array_prepend >

[jira] [Commented] (SPARK-42508) Extract the common .ml classes to `mllib-common`

2023-03-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703503#comment-17703503 ] Apache Spark commented on SPARK-42508: -- User 'zhengruifeng' has created a pull request for this

[jira] [Resolved] (SPARK-40082) DAGScheduler may not schduler new stage in condition of push-based shuffle enabled

2023-03-22 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40082. - Fix Version/s: 3.5.0 Assignee: Fencheng Mei Resolution: Fixed >