[jira] [Updated] (SPARK-45915) Treat decimal(x, 0) the same as IntegralType in PromoteStrings

2023-11-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-45915: Summary: Treat decimal(x, 0) the same as IntegralType in PromoteStrings (was: Unwrap cast in

[jira] [Updated] (SPARK-45915) Unwrap cast in predicate

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45915: --- Labels: pull-request-available (was: ) > Unwrap cast in predicate >

[jira] [Resolved] (SPARK-45764) Make code block copyable

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45764. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43799

[jira] [Assigned] (SPARK-45764) Make code block copyable

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45764: Assignee: BingKun Pan > Make code block copyable > > >

[jira] [Commented] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786192#comment-17786192 ] Alexander Petrossian (PAF) commented on SPARK-45876: After making ReturnAnswer and

[jira] [Assigned] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43393: --- Assignee: Deepayan Patra > Sequence expression can overflow >

[jira] [Resolved] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43393. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-45932) GROUP BY ordinal should not replicate the grouping expression

2023-11-14 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45932: --- Summary: GROUP BY ordinal should not replicate the grouping expression Key: SPARK-45932 URL: https://issues.apache.org/jira/browse/SPARK-45932 Project: Spark

[jira] [Updated] (SPARK-45931) Refine docstring of `mapInPandas`

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45931: --- Labels: pull-request-available (was: ) > Refine docstring of `mapInPandas` >

[jira] [Created] (SPARK-45931) Refine docstring of `mapInPandas`

2023-11-14 Thread Allison Wang (Jira)
Allison Wang created SPARK-45931: Summary: Refine docstring of `mapInPandas` Key: SPARK-45931 URL: https://issues.apache.org/jira/browse/SPARK-45931 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45930) Allow non-deterministic Python UDFs in MapInPandas/MapInArrow

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45930: --- Labels: pull-request-available (was: ) > Allow non-deterministic Python UDFs in

[jira] [Comment Edited] (SPARK-45720) Upgrade AWS SDK to v2 for Spark Kinesis connector

2023-11-14 Thread junyuc25 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786158#comment-17786158 ] junyuc25 edited comment on SPARK-45720 at 11/15/23 4:08 AM: The upgrade also

[jira] [Commented] (SPARK-45720) Upgrade AWS SDK to v2 for Spark Kinesis connector

2023-11-14 Thread junyuc25 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786158#comment-17786158 ] junyuc25 commented on SPARK-45720: -- The upgrade also requires migrating Kinesis-client-library from 1.x

[jira] [Created] (SPARK-45930) Allow non-deterministic Python UDFs in MapInPandas/MapInArrow

2023-11-14 Thread Allison Wang (Jira)
Allison Wang created SPARK-45930: Summary: Allow non-deterministic Python UDFs in MapInPandas/MapInArrow Key: SPARK-45930 URL: https://issues.apache.org/jira/browse/SPARK-45930 Project: Spark

[jira] [Commented] (SPARK-45866) Reuse of exchange in AQE does not happen when run time filters are pushed down to the underlying Scan ( like iceberg )

2023-11-14 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786155#comment-17786155 ] Asif commented on SPARK-45866: -- Now that the other PRs on which this ticket itself is dependent are

[jira] [Commented] (SPARK-45861) Add user guide for dataframe creation

2023-11-14 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786154#comment-17786154 ] BingKun Pan commented on SPARK-45861: - Okay, Let me to do it. > Add user guide for dataframe

[jira] [Comment Edited] (SPARK-45861) Add user guide for dataframe creation

2023-11-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786147#comment-17786147 ] Ruifeng Zheng edited comment on SPARK-45861 at 11/15/23 3:07 AM: -

[jira] [Commented] (SPARK-45861) Add user guide for dataframe creation

2023-11-14 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786147#comment-17786147 ] Ruifeng Zheng commented on SPARK-45861: --- [~panbingkun]  this guide is expected to be in pyspark

[jira] [Created] (SPARK-45929) support grouping set operation in dataframe api

2023-11-14 Thread JacobZheng (Jira)
JacobZheng created SPARK-45929: -- Summary: support grouping set operation in dataframe api Key: SPARK-45929 URL: https://issues.apache.org/jira/browse/SPARK-45929 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45833) Document state data source - reader

2023-11-14 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-45833: - Priority: Blocker (was: Major) > Document state data source - reader >

[jira] [Resolved] (SPARK-45918) Optimize `MultiIndex.symmetric_difference`

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45918. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43795

[jira] [Updated] (SPARK-45908) write empty parquet file while using partitioned write

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45908: --- Labels: pull-request-available (was: ) > write empty parquet file while using partitioned

[jira] [Resolved] (SPARK-45913) Make the internal attributes private from PySpark errors.

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45913. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43790

[jira] [Assigned] (SPARK-45913) Make the internal attributes private from PySpark errors.

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45913: Assignee: Haejoon Lee > Make the internal attributes private from PySpark errors. >

[jira] [Resolved] (SPARK-45813) Return the observed metrics from commands

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45813. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43690

[jira] [Assigned] (SPARK-45813) Return the observed metrics from commands

2023-11-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45813: Assignee: Takuya Ueshin > Return the observed metrics from commands >

[jira] [Resolved] (SPARK-45511) SPIP: State Data Source - Reader

2023-11-14 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-45511. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43425

[jira] [Assigned] (SPARK-45511) SPIP: State Data Source - Reader

2023-11-14 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45511: Assignee: Jungtaek Lim > SPIP: State Data Source - Reader >

[jira] [Created] (SPARK-45928) Fix schema merging for nested structures

2023-11-14 Thread Shujing Yang (Jira)
Shujing Yang created SPARK-45928: Summary: Fix schema merging for nested structures Key: SPARK-45928 URL: https://issues.apache.org/jira/browse/SPARK-45928 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45927) Update `path` handling in Python data source

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45927: --- Labels: pull-request-available (was: ) > Update `path` handling in Python data source >

[jira] [Updated] (SPARK-45925) SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcastExec causing re-use of exchange not happening in AQE

2023-11-14 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-45925: - Labels: pull-request-available (was: ) > SubqueryBroadcastExec is not equivalent with

[jira] [Updated] (SPARK-45924) Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not equivalent with SubqueryBroadcastExec

2023-11-14 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-45924: - Labels: pull-request-available (was: ) > Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is

[jira] [Updated] (SPARK-45926) The InMemoryV2FilterBatchScan and InMemoryBatchScan are not implementing equals and hashCode correctly

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45926: --- Labels: pull-request-available (was: ) > The InMemoryV2FilterBatchScan and

[jira] [Updated] (SPARK-45927) Update `path` handling in Python data source

2023-11-14 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-45927: - Summary: Update `path` handling in Python data source (was: Remove `path` from data source

[jira] [Created] (SPARK-45927) Remove `path` from data source constructor

2023-11-14 Thread Allison Wang (Jira)
Allison Wang created SPARK-45927: Summary: Remove `path` from data source constructor Key: SPARK-45927 URL: https://issues.apache.org/jira/browse/SPARK-45927 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2023-11-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786077#comment-17786077 ] Mridul Muralidharan edited comment on SPARK-30602 at 11/14/23 8:50 PM:

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2023-11-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786077#comment-17786077 ] Mridul Muralidharan commented on SPARK-30602: - @MasterDDT, currently there is no active

[jira] [Commented] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

2023-11-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786076#comment-17786076 ] Mridul Muralidharan commented on SPARK-44937: - Thanks [~dongjoon] ! Missed out on that :-)

[jira] [Comment Edited] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2023-11-14 Thread Mitesh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785989#comment-17785989 ] Mitesh edited comment on SPARK-30602 at 11/14/23 7:34 PM: -- Is there a plan to

[jira] [Created] (SPARK-45926) The InMemoryV2FilterBatchScan and InMemoryBatchScan are not implementing equals and hashCode correctly

2023-11-14 Thread Asif (Jira)
Asif created SPARK-45926: Summary: The InMemoryV2FilterBatchScan and InMemoryBatchScan are not implementing equals and hashCode correctly Key: SPARK-45926 URL: https://issues.apache.org/jira/browse/SPARK-45926

[jira] [Created] (SPARK-45925) SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcastExec causing re-use of exchange not happening in AQE

2023-11-14 Thread Asif (Jira)
Asif created SPARK-45925: Summary: SubqueryBroadcastExec is not equivalent with SubqueryAdaptiveBroadcastExec causing re-use of exchange not happening in AQE Key: SPARK-45925 URL:

[jira] (SPARK-45658) Canonicalization of DynamicPruningSubquery is broken

2023-11-14 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45658 ] Asif deleted comment on SPARK-45658: -- was (Author: ashahid7): I also think that during canonicalization of DynamicPruningSubquery, the pruning key's canonicalization should be done on the basis of

[jira] [Updated] (SPARK-45924) Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not equivalent with SubqueryBroadcastExec

2023-11-14 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif updated SPARK-45924: - Description: while writing bug test for

[jira] [Created] (SPARK-45924) Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not equivalent with SubqueryBroadcastExec

2023-11-14 Thread Asif (Jira)
Asif created SPARK-45924: Summary: Canonicalization of SubqueryAdaptiveBroadcastExec is broken and is not equivalent with SubqueryBroadcastExec Key: SPARK-45924 URL: https://issues.apache.org/jira/browse/SPARK-45924

[jira] [Commented] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

2023-11-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786017#comment-17786017 ] Dongjoon Hyun commented on SPARK-44937: --- I added a label, `releasenotes`, and linked to

[jira] [Updated] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

2023-11-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44937: -- Labels: releasenotes (was: pull-request-available) > [umbrella] Add SSL/TLS support for RPC

[jira] [Updated] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

2023-11-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44937: -- Summary: Add SSL/TLS support for RPC and Shuffle communications (was: [umbrella] Add SSL/TLS

[jira] [Assigned] (SPARK-45911) [CORE] Make TLS1.3 the default for RPC SSL support

2023-11-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45911: --- Assignee: Hasnain Lakhani > [CORE] Make TLS1.3 the default for RPC SSL

[jira] [Resolved] (SPARK-45911) [CORE] Make TLS1.3 the default for RPC SSL support

2023-11-14 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45911. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-45911) [CORE] Make TLS1.3 the default for RPC SSL support

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45911: --- Labels: pull-request-available (was: ) > [CORE] Make TLS1.3 the default for RPC SSL

[jira] [Created] (SPARK-45923) SPIP: Spark Kubernetes Operator

2023-11-14 Thread Zhou Jiang (Jira)
Zhou Jiang created SPARK-45923: -- Summary: SPIP: Spark Kubernetes Operator Key: SPARK-45923 URL: https://issues.apache.org/jira/browse/SPARK-45923 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

2023-11-14 Thread Mitesh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785989#comment-17785989 ] Mitesh commented on SPARK-30602: Is there a plan to support push-based shuffle on Spark standalone

[jira] [Assigned] (SPARK-45921) Use Hadoop 3.3.5 winutils in AppVeyor build

2023-11-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45921: - Assignee: BingKun Pan > Use Hadoop 3.3.5 winutils in AppVeyor build >

[jira] [Resolved] (SPARK-45921) Use Hadoop 3.3.5 winutils in AppVeyor build

2023-11-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45921. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43777

[jira] [Resolved] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45898. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43771

[jira] [Assigned] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45898: --- Assignee: Yihong He > Rewrite catalog table APIs to use unresolved logical plan >

[jira] [Commented] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785905#comment-17785905 ] Alexander Petrossian (PAF) commented on SPARK-45876: Diving in:

[jira] [Updated] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Petrossian (PAF) updated SPARK-45876: --- Attachment: Снимок экрана 2023-11-14 в 16.58.56.png > Filters are

[jira] [Updated] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Petrossian (PAF) updated SPARK-45876: --- Attachment: Снимок экрана 2023-11-14 в 16.55.31.png > Filters are

[jira] [Updated] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Petrossian (PAF) updated SPARK-45876: --- Attachment: Снимок экрана 2023-11-14 в 16.55.11.png > Filters are

[jira] [Comment Edited] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785897#comment-17785897 ] Alexander Petrossian (PAF) edited comment on SPARK-45876 at 11/14/23 1:51 PM:

[jira] [Comment Edited] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785897#comment-17785897 ] Alexander Petrossian (PAF) edited comment on SPARK-45876 at 11/14/23 1:50 PM:

[jira] [Commented] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785897#comment-17785897 ] Alexander Petrossian (PAF) commented on SPARK-45876: So far localized problem

[jira] [Updated] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Petrossian (PAF) updated SPARK-45876: --- Attachment: Снимок экрана 2023-11-14 в 16.33.48.png > Filters are

[jira] [Updated] (SPARK-45876) Filters are not pushed down across lateral view

2023-11-14 Thread Alexander Petrossian (PAF) (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Petrossian (PAF) updated SPARK-45876: --- Attachment: Снимок экрана 2023-11-14 в 16.35.56.png > Filters are

[jira] [Updated] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-38432: --- Labels: pull-request-available (was: ) > Refactor framework so as JDBC dialect could

[jira] [Updated] (SPARK-45922) Multiple policies follow-up (Python)

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45922: --- Labels: pull-request-available (was: ) > Multiple policies follow-up (Python) >

[jira] [Created] (SPARK-45922) Multiple policies follow-up (Python)

2023-11-14 Thread Alice Sayutina (Jira)
Alice Sayutina created SPARK-45922: -- Summary: Multiple policies follow-up (Python) Key: SPARK-45922 URL: https://issues.apache.org/jira/browse/SPARK-45922 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45882) BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning

2023-11-14 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-45882: -- Fix Version/s: 3.4.2 4.0.0 > BroadcastHashJoinExec propagate partitioning should

[jira] [Resolved] (SPARK-45882) BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning

2023-11-14 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You resolved SPARK-45882. --- Fix Version/s: 3.5.1 Resolution: Fixed Issue resolved by pull request 43792

[jira] [Assigned] (SPARK-45882) BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning

2023-11-14 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You reassigned SPARK-45882: - Assignee: XiDuo You > BroadcastHashJoinExec propagate partitioning should respect >

[jira] [Assigned] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45898: -- Assignee: (was: Apache Spark) > Rewrite catalog table APIs to use unresolved

[jira] [Assigned] (SPARK-45898) Rewrite catalog table APIs to use unresolved logical plan

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45898: -- Assignee: Apache Spark > Rewrite catalog table APIs to use unresolved logical plan >

[jira] [Assigned] (SPARK-45920) group by ordinal should be idempotent

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45920: -- Assignee: (was: Apache Spark) > group by ordinal should be idempotent >

[jira] [Assigned] (SPARK-45764) Make code block copyable

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45764: -- Assignee: Apache Spark > Make code block copyable > > >

[jira] [Assigned] (SPARK-45764) Make code block copyable

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45764: -- Assignee: (was: Apache Spark) > Make code block copyable >

[jira] [Assigned] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43393: -- Assignee: (was: Apache Spark) > Sequence expression can overflow >

[jira] [Assigned] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43393: -- Assignee: Apache Spark > Sequence expression can overflow >

[jira] [Assigned] (SPARK-45920) group by ordinal should be idempotent

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45920: -- Assignee: Apache Spark > group by ordinal should be idempotent >

[jira] [Updated] (SPARK-45764) Make code block copyable

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45764: --- Labels: pull-request-available (was: ) > Make code block copyable >

[jira] [Assigned] (SPARK-45920) group by ordinal should be idempotent

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45920: -- Assignee: (was: Apache Spark) > group by ordinal should be idempotent >

[jira] [Assigned] (SPARK-45920) group by ordinal should be idempotent

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45920: -- Assignee: Apache Spark > group by ordinal should be idempotent >

[jira] [Assigned] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43393: -- Assignee: Apache Spark > Sequence expression can overflow >

[jira] [Assigned] (SPARK-43393) Sequence expression can overflow

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43393: -- Assignee: (was: Apache Spark) > Sequence expression can overflow >

[jira] [Assigned] (SPARK-45920) group by ordinal should be idempotent

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45920: -- Assignee: (was: Apache Spark) > group by ordinal should be idempotent >

[jira] [Assigned] (SPARK-45920) group by ordinal should be idempotent

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45920: -- Assignee: Apache Spark > group by ordinal should be idempotent >

[jira] [Assigned] (SPARK-45920) group by ordinal should be idempotent

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45920: -- Assignee: Apache Spark > group by ordinal should be idempotent >

[jira] [Assigned] (SPARK-45920) group by ordinal should be idempotent

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45920: -- Assignee: (was: Apache Spark) > group by ordinal should be idempotent >

[jira] [Updated] (SPARK-45921) Use Hadoop 3.3.5 winutils in AppVeyor build

2023-11-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45921: --- Labels: pull-request-available (was: ) > Use Hadoop 3.3.5 winutils in AppVeyor build >

[jira] [Updated] (SPARK-45921) Use Hadoop 3.3.5 winutils in AppVeyor build

2023-11-14 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-45921: Summary: Use Hadoop 3.3.5 winutils in AppVeyor build (was: Use hadoop `3.3.5` for appveyor test)

[jira] [Created] (SPARK-45921) Use hadoop `3.3.5` for appveyor test

2023-11-14 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-45921: --- Summary: Use hadoop `3.3.5` for appveyor test Key: SPARK-45921 URL: https://issues.apache.org/jira/browse/SPARK-45921 Project: Spark Issue Type: Improvement