[jira] [Comment Edited] (SPARK-41266) Spark does not parse timestamp strings when using the IN operator

2022-12-06 Thread huldar chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643706#comment-17643706 ] huldar chen edited comment on SPARK-41266 at 12/6/22 8:11 AM:

[jira] [Created] (SPARK-41403) Implement DataFrame.describe

2022-12-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41403: - Summary: Implement DataFrame.describe Key: SPARK-41403 URL: https://issues.apache.org/jira/browse/SPARK-41403 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41403) Implement DataFrame.describe

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643714#comment-17643714 ] Ruifeng Zheng commented on SPARK-41403: --- [~beliefer] Jiaan, would you want to have

[jira] [Created] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41404: Summary: Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType Key: SPARK-41404 URL: https://issues.apache.org/jira/browse/SPARK-41404 Project: Spark

[jira] [Assigned] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41404: Assignee: Apache Spark > Support `ColumnarBatchSuite#testRandomRows` to test more primiti

[jira] [Commented] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643718#comment-17643718 ] Apache Spark commented on SPARK-41404: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41404: Assignee: (was: Apache Spark) > Support `ColumnarBatchSuite#testRandomRows` to test m

[jira] [Commented] (SPARK-41403) Implement DataFrame.describe

2022-12-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643733#comment-17643733 ] jiaan.geng commented on SPARK-41403: [~podongfeng] Thank you for your ping. I will t

[jira] [Created] (SPARK-41405) centralize the column resolution logic

2022-12-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41405: --- Summary: centralize the column resolution logic Key: SPARK-41405 URL: https://issues.apache.org/jira/browse/SPARK-41405 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41405) centralize the column resolution logic

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643742#comment-17643742 ] Apache Spark commented on SPARK-41405: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-41405) centralize the column resolution logic

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41405: Assignee: Apache Spark > centralize the column resolution logic > ---

[jira] [Assigned] (SPARK-41405) centralize the column resolution logic

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41405: Assignee: (was: Apache Spark) > centralize the column resolution logic >

[jira] [Commented] (SPARK-41405) centralize the column resolution logic

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643743#comment-17643743 ] Apache Spark commented on SPARK-41405: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-41317) PySpark write API for Spark Connect

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643746#comment-17643746 ] Apache Spark commented on SPARK-41317: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-41317) PySpark write API for Spark Connect

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643747#comment-17643747 ] Apache Spark commented on SPARK-41317: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-41121) Upgrade sbt-assembly from 1.2.0 to 2.0.0

2022-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41121. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38637 [https://

[jira] [Assigned] (SPARK-41121) Upgrade sbt-assembly from 1.2.0 to 2.0.0

2022-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41121: - Assignee: BingKun Pan > Upgrade sbt-assembly from 1.2.0 to 2.0.0 >

[jira] [Created] (SPARK-41406) Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic

2022-12-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-41406: --- Summary: Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic Key: SPARK-41406 URL: https://issues.apache.org/jira/browse/SPARK-41406 Project: Spar

[jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2022-12-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643774#comment-17643774 ] Steve Loughran commented on SPARK-41392: may relate to the bouncy castle 1.68 up

[jira] [Commented] (SPARK-41319) when-otherwise support

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643776#comment-17643776 ] Apache Spark commented on SPARK-41319: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-41319) when-otherwise support

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643775#comment-17643775 ] Apache Spark commented on SPARK-41319: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-41319) when-otherwise support

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41319: Assignee: Apache Spark > when-otherwise support > -- > >

[jira] [Assigned] (SPARK-41319) when-otherwise support

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41319: Assignee: (was: Apache Spark) > when-otherwise support > -- > >

[jira] [Updated] (SPARK-28869) Roll over event log files

2022-12-06 Thread Ranga Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranga Reddy updated SPARK-28869: Attachment: application_1670216197043_0012.log > Roll over event log files > -

[jira] [Commented] (SPARK-28869) Roll over event log files

2022-12-06 Thread Ranga Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643804#comment-17643804 ] Ranga Reddy commented on SPARK-28869: - Hi [~kabhwan]  I have enabled the eventlog r

[jira] [Commented] (SPARK-41406) Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643845#comment-17643845 ] Apache Spark commented on SPARK-41406: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-41406) Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41406: Assignee: Apache Spark > Refactor error message for `NUM_COLUMNS_MISMATCH` to make it mor

[jira] [Assigned] (SPARK-41406) Refactor error message for `NUM_COLUMNS_MISMATCH` to make it more generic

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41406: Assignee: (was: Apache Spark) > Refactor error message for `NUM_COLUMNS_MISMATCH` to

[jira] [Assigned] (SPARK-41403) Implement DataFrame.describe

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41403: Assignee: Apache Spark > Implement DataFrame.describe > > >

[jira] [Assigned] (SPARK-41403) Implement DataFrame.describe

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41403: Assignee: (was: Apache Spark) > Implement DataFrame.describe > --

[jira] [Commented] (SPARK-41403) Implement DataFrame.describe

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643850#comment-17643850 ] Apache Spark commented on SPARK-41403: -- User 'beliefer' has created a pull request

[jira] [Created] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-06 Thread XiDuo You (Jira)
XiDuo You created SPARK-41407: - Summary: Pull out v1 write to WriteFiles Key: SPARK-41407 URL: https://issues.apache.org/jira/browse/SPARK-41407 Project: Spark Issue Type: Improvement C

[jira] [Commented] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643859#comment-17643859 ] Apache Spark commented on SPARK-41407: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41407: Assignee: Apache Spark > Pull out v1 write to WriteFiles > --

[jira] [Assigned] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41407: Assignee: (was: Apache Spark) > Pull out v1 write to WriteFiles > ---

[jira] [Commented] (SPARK-41407) Pull out v1 write to WriteFiles

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643861#comment-17643861 ] Apache Spark commented on SPARK-41407: -- User 'ulysses-you' has created a pull reque

[jira] [Created] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41408: Summary: Upgrade scala-maven-plugin to 4.8.0 Key: SPARK-41408 URL: https://issues.apache.org/jira/browse/SPARK-41408 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643892#comment-17643892 ] Apache Spark commented on SPARK-41408: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41408: Assignee: Apache Spark > Upgrade scala-maven-plugin to 4.8.0 > --

[jira] [Assigned] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41408: Assignee: (was: Apache Spark) > Upgrade scala-maven-plugin to 4.8.0 > ---

[jira] [Created] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043`

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41409: Summary: Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` Key: SPARK-41409 URL: https://issues.apache.org/jira/browse/SPARK-41409 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043`

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41409: Assignee: (was: Apache Spark) > Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP

[jira] [Assigned] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043`

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41409: Assignee: Apache Spark > Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` > --

[jira] [Commented] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043`

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643929#comment-17643929 ] Apache Spark commented on SPARK-41409: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043`

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643930#comment-17643930 ] Apache Spark commented on SPARK-41409: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-41398) Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match

2022-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41398: - Assignee: Chao Sun > Relax constraints on Storage-Partitioned Join when partition keys

[jira] [Resolved] (SPARK-41398) Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match

2022-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41398. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38924 [https://

[jira] [Resolved] (SPARK-41393) Upgrade slf4j to 2.0.5

2022-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41393. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38918 [https://

[jira] [Assigned] (SPARK-41393) Upgrade slf4j to 2.0.5

2022-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41393: - Assignee: Yang Jie > Upgrade slf4j to 2.0.5 > -- > >

[jira] [Created] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-41410: - Summary: Support PVC-oriented executor pod allocation Key: SPARK-41410 URL: https://issues.apache.org/jira/browse/SPARK-41410 Project: Spark Issue Type: Ne

[jira] [Assigned] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41410: Assignee: Apache Spark > Support PVC-oriented executor pod allocation > -

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643973#comment-17643973 ] Apache Spark commented on SPARK-41410: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41410: Assignee: (was: Apache Spark) > Support PVC-oriented executor pod allocation > --

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17643976#comment-17643976 ] Apache Spark commented on SPARK-41369: -- User 'hvanhovell' has created a pull reques

[jira] [Created] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Wei Liu (Jira)
Wei Liu created SPARK-41411: --- Summary: Multi-Stateful Operator watermark support bug fix Key: SPARK-41411 URL: https://issues.apache.org/jira/browse/SPARK-41411 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Wei Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644006#comment-17644006 ] Wei Liu commented on SPARK-41411: - PR: https://github.com/apache/spark/pull/38945 > Mul

[jira] [Assigned] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41411: Assignee: (was: Apache Spark) > Multi-Stateful Operator watermark support bug fix > -

[jira] [Assigned] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41411: Assignee: Apache Spark > Multi-Stateful Operator watermark support bug fix >

[jira] [Commented] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644007#comment-17644007 ] Apache Spark commented on SPARK-41411: -- User 'WweiL' has created a pull request for

[jira] [Commented] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644008#comment-17644008 ] Apache Spark commented on SPARK-41411: -- User 'WweiL' has created a pull request for

[jira] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Wei Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411 ] Wei Liu deleted comment on SPARK-41411: - was (Author: JIRAUSER295948): PR: https://github.com/apache/spark/pull/38945 > Multi-Stateful Operator watermark support bug fix > --

[jira] [Updated] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Wei Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-41411: Affects Version/s: (was: 3.3.2) > Multi-Stateful Operator watermark support bug fix >

[jira] [Created] (SPARK-41412) Implement `Cast`

2022-12-06 Thread Rui Wang (Jira)
Rui Wang created SPARK-41412: Summary: Implement `Cast` Key: SPARK-41412 URL: https://issues.apache.org/jira/browse/SPARK-41412 Project: Spark Issue Type: Sub-task Components: Connect

[jira] [Created] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-06 Thread Chao Sun (Jira)
Chao Sun created SPARK-41413: Summary: Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible Key: SPARK-41413 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Commented] (SPARK-38918) Nested column pruning should filter out attributes that do not belong to the current relation

2022-12-06 Thread Wing Yew Poon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644041#comment-17644041 ] Wing Yew Poon commented on SPARK-38918: --- It seems that this is fixed in 3.2.2 ([7

[jira] [Created] (SPARK-41414) Implement data/timestamp functions

2022-12-06 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-41414: Summary: Implement data/timestamp functions Key: SPARK-41414 URL: https://issues.apache.org/jira/browse/SPARK-41414 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41410. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38943 [https://

[jira] [Assigned] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41410: - Assignee: Dongjoon Hyun > Support PVC-oriented executor pod allocation > --

[jira] [Updated] (SPARK-41414) Implement date/timestamp functions

2022-12-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41414: - Summary: Implement date/timestamp functions (was: Implement data/timestamp functions) > Implem

[jira] [Assigned] (SPARK-41414) Implement date/timestamp functions

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41414: Assignee: Apache Spark > Implement date/timestamp functions > ---

[jira] [Assigned] (SPARK-41414) Implement date/timestamp functions

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41414: Assignee: (was: Apache Spark) > Implement date/timestamp functions >

[jira] [Commented] (SPARK-41414) Implement date/timestamp functions

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644049#comment-17644049 ] Apache Spark commented on SPARK-41414: -- User 'xinrong-meng' has created a pull requ

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

2022-12-06 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644061#comment-17644061 ] Pablo Langa Blanco commented on SPARK-41344: In this case the provider has b

[jira] [Assigned] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-41411: Assignee: Wei Liu > Multi-Stateful Operator watermark support bug fix > -

[jira] [Resolved] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-41411. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38945 [https://gi

[jira] [Assigned] (SPARK-41231) Built-in SQL Function Improvement

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41231: Assignee: (was: Apache Spark) > Built-in SQL Function Improvement > -

[jira] [Commented] (SPARK-41231) Built-in SQL Function Improvement

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644066#comment-17644066 ] Apache Spark commented on SPARK-41231: -- User 'navinvishy' has created a pull reques

[jira] [Assigned] (SPARK-41231) Built-in SQL Function Improvement

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41231: Assignee: Apache Spark > Built-in SQL Function Improvement >

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2022-12-06 Thread Navin Viswanath (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644070#comment-17644070 ] Navin Viswanath commented on SPARK-41233: - PR : [https://github.com/apache/spark

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644080#comment-17644080 ] Apache Spark commented on SPARK-41410: -- User 'tedyu' has created a pull request for

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644079#comment-17644079 ] Apache Spark commented on SPARK-41410: -- User 'tedyu' has created a pull request for

[jira] [Created] (SPARK-41415) SASL Request Retry

2022-12-06 Thread Aravind Patnam (Jira)
Aravind Patnam created SPARK-41415: -- Summary: SASL Request Retry Key: SPARK-41415 URL: https://issues.apache.org/jira/browse/SPARK-41415 Project: Spark Issue Type: Task Components:

[jira] [Updated] (SPARK-41415) SASL Request Retries

2022-12-06 Thread Aravind Patnam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravind Patnam updated SPARK-41415: --- Summary: SASL Request Retries (was: SASL Request Retry) > SASL Request Retries > --

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644082#comment-17644082 ] Apache Spark commented on SPARK-41410: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644083#comment-17644083 ] Apache Spark commented on SPARK-41410: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

2022-12-06 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644087#comment-17644087 ] Zhen Wang commented on SPARK-41344: --- [~planga82]  Thanks for your reply, I have submit

[jira] [Commented] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644088#comment-17644088 ] Apache Spark commented on SPARK-41413: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41413: Assignee: Apache Spark > Storage-Partitioned Join should avoid shuffle when partition key

[jira] [Assigned] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41413: Assignee: (was: Apache Spark) > Storage-Partitioned Join should avoid shuffle when pa

[jira] [Resolved] (SPARK-41366) DF.groupby.agg() API should be compatible

2022-12-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-41366. --- Fix Version/s: 3.4.0 Resolution: Fixed > DF.groupby.agg() API should be compa

[jira] [Created] (SPARK-41416) Rewrite self join in in predicate to aggregate

2022-12-06 Thread Wan Kun (Jira)
Wan Kun created SPARK-41416: --- Summary: Rewrite self join in in predicate to aggregate Key: SPARK-41416 URL: https://issues.apache.org/jira/browse/SPARK-41416 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41416) Rewrite self join in in predicate to aggregate

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644091#comment-17644091 ] Apache Spark commented on SPARK-41416: -- User 'wankunde' has created a pull request

[jira] [Assigned] (SPARK-41416) Rewrite self join in in predicate to aggregate

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41416: Assignee: Apache Spark > Rewrite self join in in predicate to aggregate > ---

[jira] [Assigned] (SPARK-41416) Rewrite self join in in predicate to aggregate

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41416: Assignee: (was: Apache Spark) > Rewrite self join in in predicate to aggregate >

[jira] [Commented] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644092#comment-17644092 ] Apache Spark commented on SPARK-39865: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644094#comment-17644094 ] Apache Spark commented on SPARK-41369: -- User 'hvanhovell' has created a pull reques

[jira] [Created] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41417: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_0019 Key: SPARK-41417 URL: https://issues.apache.org/jira/browse/SPARK-41417 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-41369) Refactor connect directory structure

2022-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41369. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38953 [https://gi

[jira] [Assigned] (SPARK-41369) Refactor connect directory structure

2022-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41369: Assignee: Hyukjin Kwon > Refactor connect directory structure > -

[jira] [Assigned] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41417: Assignee: (was: Apache Spark) > Assign a name to the error class _LEGACY_ERROR_TEMP_0

  1   2   >