[jira] [Resolved] (SPARK-36506) Improve test coverage for series.py and indexes/*.py.

[ https://issues.apache.org/jira/browse/SPARK-36506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36506. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33844

[jira] [Assigned] (SPARK-36506) Improve test coverage for series.py and indexes/*.py.

[ https://issues.apache.org/jira/browse/SPARK-36506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36506: Assignee: Haejoon Lee > Improve test coverage for series.py and indexes/*.py. >

[jira] [Resolved] (SPARK-36782) Deadlock between map-output-dispatcher and dispatcher-BlockManagerMaster upon migrating shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-36782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36782. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34043

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36791: - Fix Version/s: (was: 3.2.0) 3.2.1 > this is a spelling mistakes in

[jira] [Assigned] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36791: Assignee: qingbo jiao > this is a spelling mistakes in running-on-yarn.md file where

[jira] [Resolved] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36791. -- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution:

[jira] [Commented] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418913#comment-17418913 ] Haejoon Lee commented on SPARK-36438: - [~hyukjin.kwon] Sorry, it was delayed due to work on a

[jira] [Commented] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade

[ https://issues.apache.org/jira/browse/SPARK-27780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418909#comment-17418909 ] Shyam commented on SPARK-27780: --- [~comma337] Can you please let me know where is the suffle service

[jira] [Assigned] (SPARK-36707) Support to specify index type and name in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-36707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36707: Assignee: (was: Hyukjin Kwon) > Support to specify index type and name in pandas API

[jira] [Assigned] (SPARK-36707) Support to specify index type and name in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-36707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36707: Assignee: Hyukjin Kwon > Support to specify index type and name in pandas API on Spark >

[jira] [Resolved] (SPARK-36824) Add sec and csc as R functions

[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36824. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34067

[jira] [Assigned] (SPARK-36824) Add sec and csc as R functions

[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36824: Assignee: Yuto Akutsu > Add sec and csc as R functions > --

[jira] [Assigned] (SPARK-36708) Support numpy.typing for annotating ArrayType

[ https://issues.apache.org/jira/browse/SPARK-36708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36708: Assignee: Hyukjin Kwon > Support numpy.typing for annotating ArrayType >

[jira] [Resolved] (SPARK-36708) Support numpy.typing for annotating ArrayType

[ https://issues.apache.org/jira/browse/SPARK-36708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36708. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34028

[jira] [Commented] (SPARK-33573) Server side metrics related to push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418869#comment-17418869 ] Apache Spark commented on SPARK-33573: -- User 'rmcyang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33573) Server side metrics related to push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33573: Assignee: (was: Apache Spark) > Server side metrics related to push-based shuffle >

[jira] [Commented] (SPARK-33573) Server side metrics related to push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418868#comment-17418868 ] Apache Spark commented on SPARK-33573: -- User 'rmcyang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33573) Server side metrics related to push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33573: Assignee: Apache Spark > Server side metrics related to push-based shuffle >

[jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418860#comment-17418860 ] Yongjun Zhang commented on SPARK-31646: --- HI [~mauzhang], BTW, in order ro do something like

[jira] [Updated] (SPARK-36760) Add interface SupportsPushDownV2Filters

[ https://issues.apache.org/jira/browse/SPARK-36760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36760: --- Description: Add interface SupportsPushDownV2Filters (was: Add V1 Filter.toV2 and V2Filter.toV1

[jira] [Updated] (SPARK-36760) Add interface SupportsPushDownV2Filters

[ https://issues.apache.org/jira/browse/SPARK-36760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36760: --- Summary: Add interface SupportsPushDownV2Filters (was: Add V1 Filter.toV2 and V2Filter.toV1

[jira] [Commented] (SPARK-36760) Add V1 Filter.toV2 and V2Filter.toV1 methods

[ https://issues.apache.org/jira/browse/SPARK-36760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418856#comment-17418856 ] Apache Spark commented on SPARK-36760: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36760) Add V1 Filter.toV2 and V2Filter.toV1 methods

[ https://issues.apache.org/jira/browse/SPARK-36760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418855#comment-17418855 ] Apache Spark commented on SPARK-36760: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418849#comment-17418849 ] Kohki Nishio commented on SPARK-36827: -- i still need to ramp up the process for getting a PR, but i

[jira] [Commented] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418842#comment-17418842 ] Sean R. Owen commented on SPARK-36827: -- Looks promising yeah. This loop seems like it could instead

[jira] [Updated] (SPARK-36828) Remove Guava from Spark binary distribution

[ https://issues.apache.org/jira/browse/SPARK-36828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-36828: - Issue Type: Improvement (was: Bug) > Remove Guava from Spark binary distribution >

[jira] [Created] (SPARK-36828) Remove Guava from Spark binary distribution

Chao Sun created SPARK-36828: Summary: Remove Guava from Spark binary distribution Key: SPARK-36828 URL: https://issues.apache.org/jira/browse/SPARK-36828 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418832#comment-17418832 ] Kohki Nishio edited comment on SPARK-36827 at 9/22/21, 9:04 PM: this

[jira] [Commented] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418832#comment-17418832 ] Kohki Nishio commented on SPARK-36827: -- this line

[jira] [Commented] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418829#comment-17418829 ] Kohki Nishio commented on SPARK-36827: -- I do have multiple heap dumps, however it won't help the

[jira] [Commented] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418813#comment-17418813 ] Sean R. Owen commented on SPARK-36827: -- Those are stack dumps not heap dumps. Do you know anything

[jira] [Resolved] (SPARK-36818) Fix filtering a Series by a boolean Series

[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36818. --- Fix Version/s: 3.3.0 3.2.0 Assignee: Xinrong Meng

[jira] [Updated] (SPARK-36753) array_except should handle Double.NaN and Float.NaN

[ https://issues.apache.org/jira/browse/SPARK-36753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36753: -- Labels: correctness (was: ) > array_except should handle Double.NaN and Float.NaN >

[jira] [Updated] (SPARK-36792) Inset should handle Double.NaN and Float.NaN

[ https://issues.apache.org/jira/browse/SPARK-36792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36792: -- Labels: correctness (was: ) > Inset should handle Double.NaN and Float.NaN >

[jira] [Updated] (SPARK-36755) array_overlap should handle Double.NaN and Float.NaN

[ https://issues.apache.org/jira/browse/SPARK-36755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36755: -- Labels: correctness (was: ) > array_overlap should handle Double.NaN and Float.NaN >

[jira] [Updated] (SPARK-36754) array_intersect should handle Double.NaN and Float.NaN

[ https://issues.apache.org/jira/browse/SPARK-36754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36754: -- Labels: correctness (was: ) > array_intersect should handle Double.NaN and Float.NaN >

[jira] [Updated] (SPARK-36767) ArrayMin/ArrayMax/SortArray/ArraySort add comment and UT

[ https://issues.apache.org/jira/browse/SPARK-36767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36767: -- Labels: correctness (was: ) > ArrayMin/ArrayMax/SortArray/ArraySort add comment and UT >

[jira] [Updated] (SPARK-36740) collection operators should handle duplicated NaN

[ https://issues.apache.org/jira/browse/SPARK-36740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36740: -- Labels: correctness (was: ) > collection operators should handle duplicated NaN >

[jira] [Updated] (SPARK-36741) array_distinct should not return duplicated NaN

[ https://issues.apache.org/jira/browse/SPARK-36741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36741: -- Labels: correctness (was: ) > array_distinct should not return duplicated NaN >

[jira] [Updated] (SPARK-36702) array_union should not produce duplicated result

[ https://issues.apache.org/jira/browse/SPARK-36702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36702: -- Labels: correctness (was: ) > array_union should not produce duplicated result >

[jira] [Updated] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohki Nishio updated SPARK-36827: - Description: Noticing memory-leak like behavior, steady increase of heap after GC and

[jira] [Updated] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohki Nishio updated SPARK-36827: - Description: Noticing memory-leak like behavior, steady increase of heap after GC and

[jira] [Commented] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418742#comment-17418742 ] Kohki Nishio commented on SPARK-36827: -- one thread shows slightly different codepoint {code}

[jira] [Updated] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohki Nishio updated SPARK-36827: - Attachment: mem1.txt > Task/Stage/Job data remain in memory leads memory leak >

[jira] [Updated] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kohki Nishio updated SPARK-36827: - Attachment: worker.txt > Task/Stage/Job data remain in memory leads memory leak >

[jira] [Created] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

Kohki Nishio created SPARK-36827: Summary: Task/Stage/Job data remain in memory leads memory leak Key: SPARK-36827 URL: https://issues.apache.org/jira/browse/SPARK-36827 Project: Spark Issue

[jira] [Assigned] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36815: --- Assignee: gaoyajun02 > Found duplicate rewrite attributes >

[jira] [Resolved] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36815. - Resolution: Fixed > Found duplicate rewrite attributes > -- > >

[jira] [Commented] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418703#comment-17418703 ] L. C. Hsieh commented on SPARK-36815: - It was resolved by

[jira] [Assigned] (SPARK-36753) array_except should handle Double.NaN and Float.NaN

[ https://issues.apache.org/jira/browse/SPARK-36753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36753: --- Assignee: angerszhu > array_except should handle Double.NaN and Float.NaN >

[jira] [Resolved] (SPARK-36753) array_except should handle Double.NaN and Float.NaN

[ https://issues.apache.org/jira/browse/SPARK-36753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36753. - Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fixed

[jira] [Comment Edited] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challengi

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418643#comment-17418643 ] Rafael Hernandez Murcia edited comment on SPARK-34591 at 9/22/21, 2:52 PM:

[jira] [Commented] (SPARK-34591) Pyspark undertakes pruning of decision trees and random forests outside the control of the user, leading to undesirable and unexpected outcomes that are challenging to

[ https://issues.apache.org/jira/browse/SPARK-34591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418643#comment-17418643 ] Rafael Hernandez Murcia commented on SPARK-34591: - I noticed this behavior of the

[jira] [Assigned] (SPARK-36680) Supports Dynamic Table Options for Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-36680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36680: Assignee: (was: Apache Spark) > Supports Dynamic Table Options for Spark SQL >

[jira] [Commented] (SPARK-36680) Supports Dynamic Table Options for Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-36680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418569#comment-17418569 ] Apache Spark commented on SPARK-36680: -- User 'wang-zhun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36680) Supports Dynamic Table Options for Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-36680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36680: Assignee: Apache Spark > Supports Dynamic Table Options for Spark SQL >

[jira] [Created] (SPARK-36826) CVEs in libraries used in bundled jars

Carlos Rodríguez Hernández created SPARK-36826: -- Summary: CVEs in libraries used in bundled jars Key: SPARK-36826 URL: https://issues.apache.org/jira/browse/SPARK-36826 Project: Spark

[jira] [Commented] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418543#comment-17418543 ] Hyukjin Kwon commented on SPARK-36438: -- [~itholic] is there any update on this? > Support

[jira] [Assigned] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

[ https://issues.apache.org/jira/browse/SPARK-36825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36825: Assignee: Max Gekk (was: Apache Spark) > Read/write dataframes with ANSI intervals

[jira] [Assigned] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

[ https://issues.apache.org/jira/browse/SPARK-36825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36825: Assignee: Apache Spark (was: Max Gekk) > Read/write dataframes with ANSI intervals

[jira] [Commented] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

[ https://issues.apache.org/jira/browse/SPARK-36825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418533#comment-17418533 ] Apache Spark commented on SPARK-36825: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

[ https://issues.apache.org/jira/browse/SPARK-36825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418532#comment-17418532 ] Apache Spark commented on SPARK-36825: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

Max Gekk created SPARK-36825: Summary: Read/write dataframes with ANSI intervals from/to parquet files Key: SPARK-36825 URL: https://issues.apache.org/jira/browse/SPARK-36825 Project: Spark

[jira] [Commented] (SPARK-36825) Read/write dataframes with ANSI intervals from/to parquet files

[ https://issues.apache.org/jira/browse/SPARK-36825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418530#comment-17418530 ] Max Gekk commented on SPARK-36825: -- I am working on this. > Read/write dataframes with ANSI intervals

[jira] [Assigned] (SPARK-36803) ClassCastException: optional int32 col-0 is not a group when reading legacy Parquet files

[ https://issues.apache.org/jira/browse/SPARK-36803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36803: --- Assignee: Ivan > ClassCastException: optional int32 col-0 is not a group when reading

[jira] [Resolved] (SPARK-36803) ClassCastException: optional int32 col-0 is not a group when reading legacy Parquet files

[ https://issues.apache.org/jira/browse/SPARK-36803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36803. - Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fixed

[jira] [Assigned] (SPARK-36822) BroadcastNestedLoopJoinExec should use all condition instead of non-equi condition

[ https://issues.apache.org/jira/browse/SPARK-36822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36822: --- Assignee: XiDuo You > BroadcastNestedLoopJoinExec should use all condition instead of

[jira] [Resolved] (SPARK-36822) BroadcastNestedLoopJoinExec should use all condition instead of non-equi condition

[ https://issues.apache.org/jira/browse/SPARK-36822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36822. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34065

[jira] [Resolved] (SPARK-36760) Add V1 Filter.toV2 and V2Filter.toV1 methods

[ https://issues.apache.org/jira/browse/SPARK-36760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36760. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34001

[jira] [Assigned] (SPARK-36760) Add V1 Filter.toV2 and V2Filter.toV1 methods

[ https://issues.apache.org/jira/browse/SPARK-36760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36760: --- Assignee: Huaxin Gao > Add V1 Filter.toV2 and V2Filter.toV1 methods >

[jira] [Assigned] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh`

[ https://issues.apache.org/jira/browse/SPARK-36168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36168: Assignee: (was: Apache Spark) > Support Scala 2.13 in `dev/test-dependencies.sh` >

[jira] [Assigned] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh`

[ https://issues.apache.org/jira/browse/SPARK-36168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36168: Assignee: Apache Spark > Support Scala 2.13 in `dev/test-dependencies.sh` >

[jira] [Commented] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh`

[ https://issues.apache.org/jira/browse/SPARK-36168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418479#comment-17418479 ] Apache Spark commented on SPARK-36168: -- User 'slothspot' has created a pull request for this issue:

[jira] [Updated] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaoyajun02 updated SPARK-36815: --- Description: We are using Spark version 3.0.2 in production and some ETLs contain multi-level CTEs

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Affects Version/s: (was: 3.1.2) > this is a spelling mistakes in running-on-yarn.md file

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Target Version/s: (was: 3.1.2, 3.2.0) > this is a spelling mistakes in running-on-yarn.md file

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Fix Version/s: (was: 3.1.2) (was: 3.2.0) > this is a spelling mistakes

[jira] [Resolved] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36820. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34064

[jira] [Assigned] (SPARK-36820) Disable LZ4 test for Hadoop 2.7 profile

[ https://issues.apache.org/jira/browse/SPARK-36820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36820: --- Assignee: Chao Sun > Disable LZ4 test for Hadoop 2.7 profile >

[jira] [Commented] (SPARK-36818) Fix filtering a Series by a boolean Series

[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418446#comment-17418446 ] L. C. Hsieh commented on SPARK-36818: - For JIRA, it is better to fill some description there. I

[jira] [Updated] (SPARK-36818) Fix filtering a Series by a boolean Series

[ https://issues.apache.org/jira/browse/SPARK-36818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36818: Description: There is an error when filtering a Series using a condition from a DataFrame

[jira] [Assigned] (SPARK-36823) Support broadcast nested loop join hint for equi-join

[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36823: Assignee: Apache Spark > Support broadcast nested loop join hint for equi-join >

[jira] [Commented] (SPARK-36823) Support broadcast nested loop join hint for equi-join

[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418443#comment-17418443 ] Apache Spark commented on SPARK-36823: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-36823) Support broadcast nested loop join hint for equi-join

[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36823: Assignee: (was: Apache Spark) > Support broadcast nested loop join hint for

[jira] [Commented] (SPARK-36823) Support broadcast nested loop join hint for equi-join

[ https://issues.apache.org/jira/browse/SPARK-36823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418444#comment-17418444 ] Apache Spark commented on SPARK-36823: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418429#comment-17418429 ] Apache Spark commented on SPARK-36815: -- User 'gaoyajun02' has created a pull request for this

[jira] [Assigned] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36815: Assignee: (was: Apache Spark) > Found duplicate rewrite attributes >

[jira] [Assigned] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36815: Assignee: Apache Spark > Found duplicate rewrite attributes >

[jira] [Commented] (SPARK-36815) Found duplicate rewrite attributes

[ https://issues.apache.org/jira/browse/SPARK-36815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418427#comment-17418427 ] Apache Spark commented on SPARK-36815: -- User 'gaoyajun02' has created a pull request for this

[jira] [Commented] (SPARK-33272) prune the attributes mapping in QueryPlan.transformUpWithNewOutput

[ https://issues.apache.org/jira/browse/SPARK-33272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418426#comment-17418426 ] Apache Spark commented on SPARK-33272: -- User 'gaoyajun02' has created a pull request for this

[jira] [Commented] (SPARK-36824) Add sec and csc as R functions

[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418423#comment-17418423 ] Apache Spark commented on SPARK-36824: -- User 'yutoacts' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36824) Add sec and csc as R functions

[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36824: Assignee: Apache Spark > Add sec and csc as R functions > --

[jira] [Assigned] (SPARK-36824) Add sec and csc as R functions

[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36824: Assignee: (was: Apache Spark) > Add sec and csc as R functions >

[jira] [Commented] (SPARK-36824) Add sec and csc as R functions

[ https://issues.apache.org/jira/browse/SPARK-36824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418421#comment-17418421 ] Apache Spark commented on SPARK-36824: -- User 'yutoacts' has created a pull request for this issue: