[jira] [Assigned] (SPARK-26365) spark-submit for k8s cluster doesn't propagate exit code

[ https://issues.apache.org/jira/browse/SPARK-26365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26365: Assignee: Apache Spark > spark-submit for k8s cluster doesn't propagate exit code >

[jira] [Assigned] (SPARK-26365) spark-submit for k8s cluster doesn't propagate exit code

[ https://issues.apache.org/jira/browse/SPARK-26365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26365: Assignee: (was: Apache Spark) > spark-submit for k8s cluster doesn't propagate exit

[jira] [Resolved] (SPARK-42520) Spark Connect Scala Client: Window

[ https://issues.apache.org/jira/browse/SPARK-42520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42520. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40107

[jira] [Commented] (SPARK-26365) spark-submit for k8s cluster doesn't propagate exit code

[ https://issues.apache.org/jira/browse/SPARK-26365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691972#comment-17691972 ] Apache Spark commented on SPARK-26365: -- User 'zwangsheng' has created a pull request for this

[jira] [Commented] (SPARK-26365) spark-submit for k8s cluster doesn't propagate exit code

[ https://issues.apache.org/jira/browse/SPARK-26365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691973#comment-17691973 ] Apache Spark commented on SPARK-26365: -- User 'zwangsheng' has created a pull request for this

[jira] [Updated] (SPARK-40355) Improve pushdown for orc & parquet when cast scenario

[ https://issues.apache.org/jira/browse/SPARK-40355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40355: Fix Version/s: (was: 3.4.0) > Improve pushdown for orc & parquet when cast scenario >

[jira] [Updated] (SPARK-40158) Remove useless configuration & extract common code for parquet read

[ https://issues.apache.org/jira/browse/SPARK-40158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40158: Fix Version/s: (was: 3.4.0) > Remove useless configuration & extract common code for parquet

[jira] [Assigned] (SPARK-42505) Apply entrypoint template change to 3.3.0/3.3.1

[ https://issues.apache.org/jira/browse/SPARK-42505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-42505: --- Assignee: Yikun Jiang > Apply entrypoint template change to 3.3.0/3.3.1 >

[jira] [Resolved] (SPARK-42505) Apply entrypoint template change to 3.3.0/3.3.1

[ https://issues.apache.org/jira/browse/SPARK-42505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-42505. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 31

[jira] [Updated] (SPARK-42486) Upgrade ZooKeeper from 3.6.3 to 3.6.4

[ https://issues.apache.org/jira/browse/SPARK-42486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-42486: Affects Version/s: (was: 3.4.0) > Upgrade ZooKeeper from 3.6.3 to 3.6.4 >

[jira] [Assigned] (SPARK-42507) Simplify ORC schema merging conflict error check

[ https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-42507: Assignee: Dongjoon Hyun > Simplify ORC schema merging conflict error check >

[jira] [Resolved] (SPARK-42507) Simplify ORC schema merging conflict error check

[ https://issues.apache.org/jira/browse/SPARK-42507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42507. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40101

[jira] [Created] (SPARK-42514) Scala Client add partition transforms functions

Yang Jie created SPARK-42514: Summary: Scala Client add partition transforms functions Key: SPARK-42514 URL: https://issues.apache.org/jira/browse/SPARK-42514 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42515) ClientE2ETestSuite local test failed

[ https://issues.apache.org/jira/browse/SPARK-42515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691702#comment-17691702 ] Yang Jie commented on SPARK-42515: -- will fix this later > ClientE2ETestSuite local test failed >

[jira] [Created] (SPARK-42515) ClientE2ETestSuite local test failed

Yang Jie created SPARK-42515: Summary: ClientE2ETestSuite local test failed Key: SPARK-42515 URL: https://issues.apache.org/jira/browse/SPARK-42515 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-42516) Non-captured session time zone in view creation

Max Gekk created SPARK-42516: Summary: Non-captured session time zone in view creation Key: SPARK-42516 URL: https://issues.apache.org/jira/browse/SPARK-42516 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42516) Non-captured session time zone in view creation

[ https://issues.apache.org/jira/browse/SPARK-42516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-42516: - Description: The session time zone config is captured only when it is set explicitly but if it is not

[jira] [Assigned] (SPARK-42516) Non-captured session time zone in view creation

[ https://issues.apache.org/jira/browse/SPARK-42516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42516: Assignee: Apache Spark (was: Max Gekk) > Non-captured session time zone in view

[jira] [Assigned] (SPARK-42516) Non-captured session time zone in view creation

[ https://issues.apache.org/jira/browse/SPARK-42516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42516: Assignee: Max Gekk (was: Apache Spark) > Non-captured session time zone in view

[jira] [Commented] (SPARK-42516) Non-captured session time zone in view creation

[ https://issues.apache.org/jira/browse/SPARK-42516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691715#comment-17691715 ] Apache Spark commented on SPARK-42516: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-42002) Implement DataFrameWriterV2 (ReadwriterV2Tests)

[ https://issues.apache.org/jira/browse/SPARK-42002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691720#comment-17691720 ] Apache Spark commented on SPARK-42002: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-42002) Implement DataFrameWriterV2 (ReadwriterV2Tests)

[ https://issues.apache.org/jira/browse/SPARK-42002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691721#comment-17691721 ] Apache Spark commented on SPARK-42002: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42514) Scala Client add partition transforms functions

[ https://issues.apache.org/jira/browse/SPARK-42514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42514: Assignee: Apache Spark > Scala Client add partition transforms functions >

[jira] [Assigned] (SPARK-42514) Scala Client add partition transforms functions

[ https://issues.apache.org/jira/browse/SPARK-42514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42514: Assignee: (was: Apache Spark) > Scala Client add partition transforms functions >

[jira] [Commented] (SPARK-42514) Scala Client add partition transforms functions

[ https://issues.apache.org/jira/browse/SPARK-42514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691692#comment-17691692 ] Apache Spark commented on SPARK-42514: -- User 'LuciferYang' has created a pull request for this

[jira] [Closed] (SPARK-42043) Basic Scala Client Result Implementation

[ https://issues.apache.org/jira/browse/SPARK-42043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li closed SPARK-42043. --- > Basic Scala Client Result Implementation > - > >

[jira] [Commented] (SPARK-42517) Add documentation for Protobuf connector

[ https://issues.apache.org/jira/browse/SPARK-42517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691754#comment-17691754 ] Gengliang Wang commented on SPARK-42517: cc [~rangadi]  > Add documentation for Protobuf

[jira] [Comment Edited] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691760#comment-17691760 ] Ritika Maheshwari edited comment on SPARK-41391 at 2/21/23 7:35 PM:

[jira] [Commented] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691785#comment-17691785 ] Apache Spark commented on SPARK-42521: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42521: Assignee: Apache Spark > Add NULL values for INSERT commands with user-specified lists

[jira] [Commented] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691786#comment-17691786 ] Apache Spark commented on SPARK-42521: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42521: Assignee: (was: Apache Spark) > Add NULL values for INSERT commands with

[jira] [Updated] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported

[ https://issues.apache.org/jira/browse/SPARK-42519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42519: Summary: Add more WriteTo tests after Scala Client session config is supported (was: Scala Client

[jira] [Commented] (SPARK-42485) SPIP: Shutting down spark structured streaming when the streaming process completed current process

[ https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691762#comment-17691762 ] Boyang Jerry Peng commented on SPARK-42485: --- [~mich.talebza...@gmail.com] This seems like an

[jira] [Comment Edited] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691760#comment-17691760 ] Ritika Maheshwari edited comment on SPARK-41391 at 2/21/23 7:56 PM:

[jira] [Commented] (SPARK-42522) Fix DataFrameWriterV2 to find the default source

[ https://issues.apache.org/jira/browse/SPARK-42522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691801#comment-17691801 ] Apache Spark commented on SPARK-42522: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42522) Fix DataFrameWriterV2 to find the default source

[ https://issues.apache.org/jira/browse/SPARK-42522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42522: Assignee: (was: Apache Spark) > Fix DataFrameWriterV2 to find the default source >

[jira] [Assigned] (SPARK-42522) Fix DataFrameWriterV2 to find the default source

[ https://issues.apache.org/jira/browse/SPARK-42522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42522: Assignee: Apache Spark > Fix DataFrameWriterV2 to find the default source >

[jira] [Closed] (SPARK-42457) Scala Client Session Read API

[ https://issues.apache.org/jira/browse/SPARK-42457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li closed SPARK-42457. --- > Scala Client Session Read API > - > > Key: SPARK-42457 >

[jira] [Closed] (SPARK-42482) Scala client Write API V1

[ https://issues.apache.org/jira/browse/SPARK-42482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li closed SPARK-42482. --- > Scala client Write API V1 > - > > Key: SPARK-42482 >

[jira] [Closed] (SPARK-42172) Compatibility check for Scala Client

[ https://issues.apache.org/jira/browse/SPARK-42172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li closed SPARK-42172. --- > Compatibility check for Scala Client > > > Key:

[jira] [Closed] (SPARK-42202) Scala Client E2E test stop the server gracefully

[ https://issues.apache.org/jira/browse/SPARK-42202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li closed SPARK-42202. --- > Scala Client E2E test stop the server gracefully > > >

[jira] [Closed] (SPARK-42429) IntelliJ Build issue: value getArgument is not a member of org.mockito.invocation.InvocationOnMock

[ https://issues.apache.org/jira/browse/SPARK-42429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li closed SPARK-42429. --- > IntelliJ Build issue: value getArgument is not a member of > org.mockito.invocation.InvocationOnMock >

[jira] [Created] (SPARK-42517) Add documentation for Protobuf connector

Gengliang Wang created SPARK-42517: -- Summary: Add documentation for Protobuf connector Key: SPARK-42517 URL: https://issues.apache.org/jira/browse/SPARK-42517 Project: Spark Issue Type:

[jira] [Created] (SPARK-42518) Scala client Write API V2

Zhen Li created SPARK-42518: --- Summary: Scala client Write API V2 Key: SPARK-42518 URL: https://issues.apache.org/jira/browse/SPARK-42518 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42519) Scala Client session config

Zhen Li created SPARK-42519: --- Summary: Scala Client session config Key: SPARK-42519 URL: https://issues.apache.org/jira/browse/SPARK-42519 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691760#comment-17691760 ] Ritika Maheshwari edited comment on SPARK-41391 at 2/21/23 7:33 PM:

[jira] [Comment Edited] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691760#comment-17691760 ] Ritika Maheshwari edited comment on SPARK-41391 at 2/21/23 7:34 PM:

[jira] [Assigned] (SPARK-42520) Spark Connect Scala Client: Window

[ https://issues.apache.org/jira/browse/SPARK-42520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42520: Assignee: Rui Wang (was: Apache Spark) > Spark Connect Scala Client: Window >

[jira] [Assigned] (SPARK-42520) Spark Connect Scala Client: Window

[ https://issues.apache.org/jira/browse/SPARK-42520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42520: Assignee: Apache Spark (was: Rui Wang) > Spark Connect Scala Client: Window >

[jira] [Commented] (SPARK-42520) Spark Connect Scala Client: Window

[ https://issues.apache.org/jira/browse/SPARK-42520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691774#comment-17691774 ] Apache Spark commented on SPARK-42520: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-31754) Spark Structured Streaming: NullPointerException in Stream Stream join

[ https://issues.apache.org/jira/browse/SPARK-31754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691757#comment-17691757 ] Yoel Benharrous commented on SPARK-31754: - Seems relate to this bug  [SPARK-38809] Implement

[jira] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391 ] Ritika Maheshwari deleted comment on SPARK-41391: --- was (Author: ritikam): Modifying the agg method in RelationalGroupedDataset.scala to @scala.annotation.varargs def agg(expr: Column,

[jira] [Updated] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported

[ https://issues.apache.org/jira/browse/SPARK-42519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42519: Description: Add more test cases following the examples in "SparkConnectProtoSuite("WriteTo")" tests and

[jira] [Assigned] (SPARK-42518) Scala client Write API V2

[ https://issues.apache.org/jira/browse/SPARK-42518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42518: Assignee: Apache Spark > Scala client Write API V2 > - > >

[jira] [Commented] (SPARK-42518) Scala client Write API V2

[ https://issues.apache.org/jira/browse/SPARK-42518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691758#comment-17691758 ] Apache Spark commented on SPARK-42518: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42518) Scala client Write API V2

[ https://issues.apache.org/jira/browse/SPARK-42518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42518: Assignee: (was: Apache Spark) > Scala client Write API V2 >

[jira] [Commented] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691760#comment-17691760 ] Ritika Maheshwari commented on SPARK-41391: --- A better solution   In

[jira] [Created] (SPARK-42520) Spark Connect Scala Client: Window

Rui Wang created SPARK-42520: Summary: Spark Connect Scala Client: Window Key: SPARK-42520 URL: https://issues.apache.org/jira/browse/SPARK-42520 Project: Spark Issue Type: Task

[jira] [Comment Edited] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691760#comment-17691760 ] Ritika Maheshwari edited comment on SPARK-41391 at 2/21/23 8:06 PM:

[jira] [Created] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

Daniel created SPARK-42521: -- Summary: Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table Key: SPARK-42521 URL: https://issues.apache.org/jira/browse/SPARK-42521

[jira] [Commented] (SPARK-42485) SPIP: Shutting down spark structured streaming when the streaming process completed current process

[ https://issues.apache.org/jira/browse/SPARK-42485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691790#comment-17691790 ] Mich Talebzadeh commented on SPARK-42485: - Hi Boyang,   Please find my responses below   #

[jira] [Created] (SPARK-42522) Fix DataFrameWriterV2 to find the default source

Takuya Ueshin created SPARK-42522: - Summary: Fix DataFrameWriterV2 to find the default source Key: SPARK-42522 URL: https://issues.apache.org/jira/browse/SPARK-42522 Project: Spark Issue

[jira] [Comment Edited] (SPARK-42444) DataFrame.drop should handle multi columns properly

[ https://issues.apache.org/jira/browse/SPARK-42444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691489#comment-17691489 ] Pankaj Nagla edited comment on SPARK-42444 at 2/21/23 9:57 AM: --- Thank you

[jira] [Created] (SPARK-42510) Implement `DataFrame.mapInPandas`

Xinrong Meng created SPARK-42510: Summary: Implement `DataFrame.mapInPandas` Key: SPARK-42510 URL: https://issues.apache.org/jira/browse/SPARK-42510 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-42510) Implement `DataFrame.mapInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42510: Assignee: (was: Apache Spark) > Implement `DataFrame.mapInPandas` >

[jira] [Commented] (SPARK-42510) Implement `DataFrame.mapInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691549#comment-17691549 ] Apache Spark commented on SPARK-42510: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42510) Implement `DataFrame.mapInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42510: Assignee: Apache Spark > Implement `DataFrame.mapInPandas` >

[jira] [Commented] (SPARK-42444) DataFrame.drop should handle multi columns properly

[ https://issues.apache.org/jira/browse/SPARK-42444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691489#comment-17691489 ] Pankaj Nagla commented on SPARK-42444: -- Thank you for sharing. [Azure Solution Architect

[jira] [Resolved] (SPARK-42406) [PROTOBUF] Recursive field handling is incompatible with delta

[ https://issues.apache.org/jira/browse/SPARK-42406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42406. Resolution: Fixed Resolved in https://github.com/apache/spark/pull/40080 > [PROTOBUF]

[jira] [Created] (SPARK-42524) Upgrade numpy and pandas in the release Dockerfile

Xinrong Meng created SPARK-42524: Summary: Upgrade numpy and pandas in the release Dockerfile Key: SPARK-42524 URL: https://issues.apache.org/jira/browse/SPARK-42524 Project: Spark Issue

[jira] [Updated] (SPARK-42184) Setting version to 3.5.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-42184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42184: - Parent: SPARK-42523 Issue Type: Sub-task (was: Task) > Setting version to

[jira] [Commented] (SPARK-41775) Implement training functions as input

[ https://issues.apache.org/jira/browse/SPARK-41775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691836#comment-17691836 ] Apache Spark commented on SPARK-41775: -- User 'rithwik-db' has created a pull request for this

[jira] [Commented] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691861#comment-17691861 ] XiDuo You commented on SPARK-40278: --- It should work now(3.4). We figure out SQL execution status by

[jira] [Updated] (SPARK-42524) Upgrade numpy and pandas in the release Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-42524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42524: - Component/s: (was: PySpark) > Upgrade numpy and pandas in the release Dockerfile >

[jira] [Resolved] (SPARK-42514) Scala Client add partition transforms functions

[ https://issues.apache.org/jira/browse/SPARK-42514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42514. --- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed > Scala

[jira] [Updated] (SPARK-42513) Push down topK through join

[ https://issues.apache.org/jira/browse/SPARK-42513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42513: Summary: Push down topK through join (was: Push topK through join) > Push down topK through join

[jira] [Created] (SPARK-42523) Apache Spark 3.4 release

Xinrong Meng created SPARK-42523: Summary: Apache Spark 3.4 release Key: SPARK-42523 URL: https://issues.apache.org/jira/browse/SPARK-42523 Project: Spark Issue Type: Umbrella

[jira] [Assigned] (SPARK-42524) Upgrade numpy and pandas in the release Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-42524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42524: Assignee: (was: Apache Spark) > Upgrade numpy and pandas in the release Dockerfile >

[jira] [Commented] (SPARK-42509) WindowGroupLimitExec supports codegen

[ https://issues.apache.org/jira/browse/SPARK-42509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691876#comment-17691876 ] Apache Spark commented on SPARK-42509: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-42357) Log `exitCode` when `SparkContext.stop` starts

[ https://issues.apache.org/jira/browse/SPARK-42357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42357: -- Parent: SPARK-41550 Issue Type: Sub-task (was: Improvement) > Log `exitCode` when

[jira] [Assigned] (SPARK-42523) Apache Spark 3.4 release

[ https://issues.apache.org/jira/browse/SPARK-42523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42523: - Assignee: Xinrong Meng > Apache Spark 3.4 release > > >

[jira] [Assigned] (SPARK-42525) collapse two adjacent windows with the same partition/order in subquery

[ https://issues.apache.org/jira/browse/SPARK-42525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42525: Assignee: Apache Spark > collapse two adjacent windows with the same partition/order in

[jira] [Commented] (SPARK-42525) collapse two adjacent windows with the same partition/order in subquery

[ https://issues.apache.org/jira/browse/SPARK-42525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691905#comment-17691905 ] Apache Spark commented on SPARK-42525: -- User 'zml1206' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42525) collapse two adjacent windows with the same partition/order in subquery

[ https://issues.apache.org/jira/browse/SPARK-42525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42525: Assignee: (was: Apache Spark) > collapse two adjacent windows with the same

[jira] [Commented] (SPARK-42525) collapse two adjacent windows with the same partition/order in subquery

[ https://issues.apache.org/jira/browse/SPARK-42525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691904#comment-17691904 ] Apache Spark commented on SPARK-42525: -- User 'zml1206' has created a pull request for this issue:

[jira] [Commented] (SPARK-42524) Upgrade numpy and pandas in the release Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-42524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691867#comment-17691867 ] Apache Spark commented on SPARK-42524: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42524) Upgrade numpy and pandas in the release Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-42524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42524: Assignee: Apache Spark > Upgrade numpy and pandas in the release Dockerfile >

[jira] [Commented] (SPARK-41933) Provide local mode that automatically starts the server

[ https://issues.apache.org/jira/browse/SPARK-41933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691871#comment-17691871 ] Apache Spark commented on SPARK-41933: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-41933) Provide local mode that automatically starts the server

[ https://issues.apache.org/jira/browse/SPARK-41933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691875#comment-17691875 ] Apache Spark commented on SPARK-41933: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42509) WindowGroupLimitExec supports codegen

[ https://issues.apache.org/jira/browse/SPARK-42509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42509: Assignee: (was: Apache Spark) > WindowGroupLimitExec supports codegen >

[jira] [Resolved] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-40278. -- Resolution: Duplicate > Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed >

[jira] [Commented] (SPARK-42509) WindowGroupLimitExec supports codegen

[ https://issues.apache.org/jira/browse/SPARK-42509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691873#comment-17691873 ] Apache Spark commented on SPARK-42509: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42509) WindowGroupLimitExec supports codegen

[ https://issues.apache.org/jira/browse/SPARK-42509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42509: Assignee: Apache Spark > WindowGroupLimitExec supports codegen >

[jira] [Commented] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691877#comment-17691877 ] Yang Jie commented on SPARK-40278: -- OK, I change the status to `RESOLVED` > Used databricks

[jira] [Updated] (SPARK-42343) Ignore `IOException` in `handleBlockRemovalFailure` if SparkContext is stopped

[ https://issues.apache.org/jira/browse/SPARK-42343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42343: -- Parent: SPARK-41550 Issue Type: Sub-task (was: Bug) > Ignore `IOException` in

[jira] [Commented] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691885#comment-17691885 ] Ruifeng Zheng commented on SPARK-41391: --- [~ritikam] thanks, would you mind sending a PR for it? >

[jira] [Resolved] (SPARK-42524) Upgrade numpy and pandas in the release Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-42524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42524. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40111

[jira] [Assigned] (SPARK-42524) Upgrade numpy and pandas in the release Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-42524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42524: Assignee: Xinrong Meng > Upgrade numpy and pandas in the release Dockerfile >

[jira] [Created] (SPARK-42525) collapse two adjacent windows with the same partition/order in subquery

zhuml created SPARK-42525: - Summary: collapse two adjacent windows with the same partition/order in subquery Key: SPARK-42525 URL: https://issues.apache.org/jira/browse/SPARK-42525 Project: Spark

  1   2   >