[jira] [Commented] (SPARK-40558) Add Reusable Exchange in Bloom creation side plan

[ https://issues.apache.org/jira/browse/SPARK-40558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609323#comment-17609323 ] Apache Spark commented on SPARK-40558: -- User 'mskapilks' has created a pull request

[jira] [Assigned] (SPARK-40558) Add Reusable Exchange in Bloom creation side plan

[ https://issues.apache.org/jira/browse/SPARK-40558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40558: Assignee: Apache Spark > Add Reusable Exchange in Bloom creation side plan >

[jira] [Commented] (SPARK-40558) Add Reusable Exchange in Bloom creation side plan

[ https://issues.apache.org/jira/browse/SPARK-40558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609321#comment-17609321 ] Apache Spark commented on SPARK-40558: -- User 'mskapilks' has created a pull request

[jira] [Assigned] (SPARK-40558) Add Reusable Exchange in Bloom creation side plan

[ https://issues.apache.org/jira/browse/SPARK-40558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40558: Assignee: (was: Apache Spark) > Add Reusable Exchange in Bloom creation side plan > -

[jira] [Assigned] (SPARK-40557) Re-generate Spark Connect Python protos

[ https://issues.apache.org/jira/browse/SPARK-40557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40557: Assignee: Apache Spark > Re-generate Spark Connect Python protos > --

[jira] [Commented] (SPARK-40557) Re-generate Spark Connect Python protos

[ https://issues.apache.org/jira/browse/SPARK-40557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609314#comment-17609314 ] Apache Spark commented on SPARK-40557: -- User 'grundprinzip' has created a pull requ

[jira] [Created] (SPARK-40558) Add Reusable Exchange in Bloom creation side plan

Kapil Singh created SPARK-40558: --- Summary: Add Reusable Exchange in Bloom creation side plan Key: SPARK-40558 URL: https://issues.apache.org/jira/browse/SPARK-40558 Project: Spark Issue Type: T

[jira] [Created] (SPARK-40557) Re-generate Spark Connect Python protos

Martin Grund created SPARK-40557: Summary: Re-generate Spark Connect Python protos Key: SPARK-40557 URL: https://issues.apache.org/jira/browse/SPARK-40557 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40556) Unpersist the intermediate datasets cached in AttachDistributedSequenceExec

[ https://issues.apache.org/jira/browse/SPARK-40556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-40556: -- Summary: Unpersist the intermediate datasets cached in AttachDistributedSequenceExec (was: Cl

[jira] [Commented] (SPARK-40556) Clean the intermediate cached datasets created in AttachDistributedSequenceExec

[ https://issues.apache.org/jira/browse/SPARK-40556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609304#comment-17609304 ] Apache Spark commented on SPARK-40556: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40556) Clean the intermediate cached datasets created in AttachDistributedSequenceExec

[ https://issues.apache.org/jira/browse/SPARK-40556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40556: Assignee: (was: Apache Spark) > Clean the intermediate cached datasets created in >

[jira] [Assigned] (SPARK-40556) Clean the intermediate cached datasets created in AttachDistributedSequenceExec

[ https://issues.apache.org/jira/browse/SPARK-40556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40556: Assignee: Apache Spark > Clean the intermediate cached datasets created in > AttachDistr

[jira] [Created] (SPARK-40556) Clean the intermediate cached datasets created in AttachDistributedSequenceExec

Ruifeng Zheng created SPARK-40556: - Summary: Clean the intermediate cached datasets created in AttachDistributedSequenceExec Key: SPARK-40556 URL: https://issues.apache.org/jira/browse/SPARK-40556 Pro

[jira] [Assigned] (SPARK-40454) Initial DSL framework for protobuf testing

[ https://issues.apache.org/jira/browse/SPARK-40454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40454: Assignee: Apache Spark > Initial DSL framework for protobuf testing > ---

[jira] [Assigned] (SPARK-40454) Initial DSL framework for protobuf testing

[ https://issues.apache.org/jira/browse/SPARK-40454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40454: Assignee: (was: Apache Spark) > Initial DSL framework for protobuf testing >

[jira] [Commented] (SPARK-40454) Initial DSL framework for protobuf testing

[ https://issues.apache.org/jira/browse/SPARK-40454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609303#comment-17609303 ] Apache Spark commented on SPARK-40454: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-38717) Handle Hive's bucket spec case preserving behaviour

[ https://issues.apache.org/jira/browse/SPARK-38717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38717: --- Assignee: Peter Toth > Handle Hive's bucket spec case preserving behaviour > --

[jira] [Resolved] (SPARK-38717) Handle Hive's bucket spec case preserving behaviour

[ https://issues.apache.org/jira/browse/SPARK-38717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38717. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-40330) Implement `Series.searchsorted`.

[ https://issues.apache.org/jira/browse/SPARK-40330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40330. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37978 [https://gi

[jira] [Resolved] (SPARK-40555) Upgrade rocksdbjni to 7.6.0

[ https://issues.apache.org/jira/browse/SPARK-40555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-40555. -- Resolution: Duplicate > Upgrade rocksdbjni to 7.6.0 > --- > >

[jira] [Created] (SPARK-40555) Upgrade rocksdbjni to 7.6.0

Yang Jie created SPARK-40555: Summary: Upgrade rocksdbjni to 7.6.0 Key: SPARK-40555 URL: https://issues.apache.org/jira/browse/SPARK-40555 Project: Spark Issue Type: Improvement Compone

[jira] [Commented] (SPARK-40554) Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary integers

[ https://issues.apache.org/jira/browse/SPARK-40554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609280#comment-17609280 ] Apache Spark commented on SPARK-40554: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-40554) Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary integers

[ https://issues.apache.org/jira/browse/SPARK-40554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40554: Assignee: (was: Apache Spark) > Make `ddof` in `DataFrame.sem` and `Series.sem` accep

[jira] [Assigned] (SPARK-40554) Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary integers

[ https://issues.apache.org/jira/browse/SPARK-40554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40554: Assignee: Apache Spark > Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary

[jira] [Commented] (SPARK-40554) Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary integers

[ https://issues.apache.org/jira/browse/SPARK-40554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609279#comment-17609279 ] Apache Spark commented on SPARK-40554: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-40554) Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary integers

Ruifeng Zheng created SPARK-40554: - Summary: Make `ddof` in `DataFrame.sem` and `Series.sem` accept arbitary integers Key: SPARK-40554 URL: https://issues.apache.org/jira/browse/SPARK-40554 Project: S

[jira] [Commented] (SPARK-38723) Test the error class: CONCURRENT_QUERY

[ https://issues.apache.org/jira/browse/SPARK-38723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609278#comment-17609278 ] Haejoon Lee commented on SPARK-38723: - I'm working on it :) > Test the error class:

[jira] [Assigned] (SPARK-40492) Perform maintenance of StateStore instances when they become inactive

[ https://issues.apache.org/jira/browse/SPARK-40492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-40492: Assignee: Chaoqin Li > Perform maintenance of StateStore instances when they become inact

[jira] [Resolved] (SPARK-40492) Perform maintenance of StateStore instances when they become inactive

[ https://issues.apache.org/jira/browse/SPARK-40492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-40492. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37935 [https://gi

[jira] [Created] (SPARK-40553) Make `searchsorted` support array-like 'value' and parameter 'sorter'

Ruifeng Zheng created SPARK-40553: - Summary: Make `searchsorted` support array-like 'value' and parameter 'sorter' Key: SPARK-40553 URL: https://issues.apache.org/jira/browse/SPARK-40553 Project: Spar

[jira] [Resolved] (SPARK-40334) Implement `GroupBy.prod`.

[ https://issues.apache.org/jira/browse/SPARK-40334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40334. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37923 [https://

[jira] [Updated] (SPARK-40142) Make pyspark.sql.functions examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40142: - Priority: Minor (was: Major) > Make pyspark.sql.functions examples self-contained > ---

[jira] [Assigned] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40552: Assignee: (was: Apache Spark) > Upgrade protobuf-python from 4.21.5 to 4.21.6 > -

[jira] [Commented] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609226#comment-17609226 ] Apache Spark commented on SPARK-40552: -- User 'bjornjorgensen' has created a pull re

[jira] [Assigned] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

[ https://issues.apache.org/jira/browse/SPARK-40552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40552: Assignee: Apache Spark > Upgrade protobuf-python from 4.21.5 to 4.21.6 >

[jira] [Assigned] (SPARK-40458) Bump Kubernetes Client Version to 6.1.1

[ https://issues.apache.org/jira/browse/SPARK-40458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40458: Assignee: Attila Zsolt Piros (was: Apache Spark) > Bump Kubernetes Client Version to 6.1

[jira] [Assigned] (SPARK-40458) Bump Kubernetes Client Version to 6.1.1

[ https://issues.apache.org/jira/browse/SPARK-40458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40458: Assignee: Apache Spark (was: Attila Zsolt Piros) > Bump Kubernetes Client Version to 6.1

[jira] [Commented] (SPARK-40458) Bump Kubernetes Client Version to 6.1.1

[ https://issues.apache.org/jira/browse/SPARK-40458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609224#comment-17609224 ] Apache Spark commented on SPARK-40458: -- User 'attilapiros' has created a pull reque

[jira] [Created] (SPARK-40552) Upgrade protobuf-python from 4.21.5 to 4.21.6

Bjørn Jørgensen created SPARK-40552: --- Summary: Upgrade protobuf-python from 4.21.5 to 4.21.6 Key: SPARK-40552 URL: https://issues.apache.org/jira/browse/SPARK-40552 Project: Spark Issue Typ

[jira] [Created] (SPARK-40551) DataSource V2: Add APIs for delta-based row-level operations

Anton Okolnychyi created SPARK-40551: Summary: DataSource V2: Add APIs for delta-based row-level operations Key: SPARK-40551 URL: https://issues.apache.org/jira/browse/SPARK-40551 Project: Spark

[jira] [Created] (SPARK-40550) DataSource V2: Handle DELETE commands for delta-based sources

Anton Okolnychyi created SPARK-40550: Summary: DataSource V2: Handle DELETE commands for delta-based sources Key: SPARK-40550 URL: https://issues.apache.org/jira/browse/SPARK-40550 Project: Spark

[jira] [Resolved] (SPARK-40548) Upgrade rocksdbjni from 7.5.3 to 7.6.0

[ https://issues.apache.org/jira/browse/SPARK-40548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40548. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37985 [https://gi

[jira] [Assigned] (SPARK-40548) Upgrade rocksdbjni from 7.5.3 to 7.6.0

[ https://issues.apache.org/jira/browse/SPARK-40548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40548: Assignee: BingKun Pan > Upgrade rocksdbjni from 7.5.3 to 7.6.0 >

[jira] [Created] (SPARK-40549) PYSPARK: Observation computes the wrong results when using `corr` function

Herminio Vazquez created SPARK-40549: Summary: PYSPARK: Observation computes the wrong results when using `corr` function Key: SPARK-40549 URL: https://issues.apache.org/jira/browse/SPARK-40549 P

[jira] [Commented] (SPARK-40096) Finalize shuffle merge slow due to connection creation fails

[ https://issues.apache.org/jira/browse/SPARK-40096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609143#comment-17609143 ] Apache Spark commented on SPARK-40096: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-40096) Finalize shuffle merge slow due to connection creation fails

[ https://issues.apache.org/jira/browse/SPARK-40096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609142#comment-17609142 ] Apache Spark commented on SPARK-40096: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609106#comment-17609106 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull re

[jira] [Commented] (SPARK-40142) Make pyspark.sql.functions examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609105#comment-17609105 ] Apache Spark commented on SPARK-40142: -- User 'khalidmammadov' has created a pull re