[jira] [Commented] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621493#comment-17621493 ] Apache Spark commented on SPARK-40812: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621492#comment-17621492 ] Apache Spark commented on SPARK-40812: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40812: --- Assignee: Rui Wang > Add Deduplicate to Connect proto > >

[jira] [Resolved] (SPARK-40812) Add Deduplicate to Connect proto

2022-10-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40812. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38276

[jira] [Resolved] (SPARK-40768) Migrate type check failures of bloom_filter_agg() onto error classes

2022-10-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40768. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38315

[jira] [Assigned] (SPARK-40768) Migrate type check failures of bloom_filter_agg() onto error classes

2022-10-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40768: Assignee: Shaokang Lv > Migrate type check failures of bloom_filter_agg() onto error classes >

[jira] [Resolved] (SPARK-40851) TimestampFormatter behavior changed when using the latest Java 8/11/17

2022-10-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40851. -- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-40860) Change `set-output` to `GITHUB_EVENT` in spark infra code

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40860. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38323

[jira] [Assigned] (SPARK-40860) Change `set-output` to `GITHUB_EVENT` in spark infra code

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40860: --- Assignee: Yikun Jiang > Change `set-output` to `GITHUB_EVENT` in spark infra code >

[jira] [Resolved] (SPARK-40859) Upgrade action/checkout to v3

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40859. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38322

[jira] [Assigned] (SPARK-40859) Upgrade action/checkout to v3

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40859: --- Assignee: Yikun Jiang > Upgrade action/checkout to v3 > - > >

[jira] [Commented] (SPARK-40799) Enforce Scalafmt for Spark Connect Module

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621451#comment-17621451 ] Apache Spark commented on SPARK-40799: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-40799) Enforce Scalafmt for Spark Connect Module

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621450#comment-17621450 ] Apache Spark commented on SPARK-40799: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-40615) Check unsupported data type when decorrelating subqueries

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621436#comment-17621436 ] Apache Spark commented on SPARK-40615: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-40862) Unexpected operators when rewriting scalar subqueries with non-deterministic expressions

2022-10-20 Thread Allison Wang (Jira)
Allison Wang created SPARK-40862: Summary: Unexpected operators when rewriting scalar subqueries with non-deterministic expressions Key: SPARK-40862 URL: https://issues.apache.org/jira/browse/SPARK-40862

[jira] [Updated] (SPARK-40861) CVE-2022-42889 upgrade commons text library to 1.10.0 in spark 3.0.0

2022-10-20 Thread Rajesh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh updated SPARK-40861: --- Summary: CVE-2022-42889 upgrade commons text library to 1.10.0 in spark 3.0.0 (was: CVE-2022-42889 upgrade

[jira] [Created] (SPARK-40861) CVE-2022-42889 upgrade commons text library to 1.10.0

2022-10-20 Thread Rajesh (Jira)
Rajesh created SPARK-40861: -- Summary: CVE-2022-42889 upgrade commons text library to 1.10.0 Key: SPARK-40861 URL: https://issues.apache.org/jira/browse/SPARK-40861 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-40843) Clean up deprecated api usage in SparkThrowableSuite

2022-10-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40843. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38305

[jira] [Assigned] (SPARK-40843) Clean up deprecated api usage in SparkThrowableSuite

2022-10-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40843: Assignee: Yang Jie > Clean up deprecated api usage in SparkThrowableSuite >

[jira] [Commented] (SPARK-40658) Protobuf v2 & v3 support

2022-10-20 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621315#comment-17621315 ] Raghu Angadi commented on SPARK-40658: -- [~mposdev21] PTAL at my changes in a temporary PR :

[jira] [Commented] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

2022-10-20 Thread Nikhil Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621281#comment-17621281 ] Nikhil Sharma commented on SPARK-22588: --- Thank you for sharing the information. [Best Machine

[jira] [Comment Edited] (SPARK-40588) Sorting issue with AQE turned on

2022-10-20 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621032#comment-17621032 ] Enrico Minack edited comment on SPARK-40588 at 10/20/22 4:23 PM: - Here

[jira] [Comment Edited] (SPARK-40588) Sorting issue with AQE turned on

2022-10-20 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621032#comment-17621032 ] Enrico Minack edited comment on SPARK-40588 at 10/20/22 4:23 PM: - Here

[jira] [Updated] (SPARK-40858) Cleanup github action warning

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40858: Description: * The `save-state` command is deprecated and will be disabled soon. Please upgrade

[jira] [Updated] (SPARK-40858) Cleanup github action warning

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-40858: Description: * Node.js 12 actions are deprecated. For more information see:

[jira] [Assigned] (SPARK-40860) Change `set-output` to `GITHUB_EVENT` in spark infra code

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40860: Assignee: Apache Spark > Change `set-output` to `GITHUB_EVENT` in spark infra code >

[jira] [Assigned] (SPARK-40860) Change `set-output` to `GITHUB_EVENT` in spark infra code

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40860: Assignee: (was: Apache Spark) > Change `set-output` to `GITHUB_EVENT` in spark infra

[jira] [Commented] (SPARK-40860) Change `set-output` to `GITHUB_EVENT` in spark infra code

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621176#comment-17621176 ] Apache Spark commented on SPARK-40860: -- User 'Yikun' has created a pull request for this issue:

[jira] [Created] (SPARK-40860) Change `set-output` to `GITHUB_EVENT` in spark infra code

2022-10-20 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40860: --- Summary: Change `set-output` to `GITHUB_EVENT` in spark infra code Key: SPARK-40860 URL: https://issues.apache.org/jira/browse/SPARK-40860 Project: Spark

[jira] [Commented] (SPARK-40859) Upgrade action/checkout to v3

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621172#comment-17621172 ] Apache Spark commented on SPARK-40859: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40859) Upgrade action/checkout to v3

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40859: Assignee: (was: Apache Spark) > Upgrade action/checkout to v3 >

[jira] [Assigned] (SPARK-40859) Upgrade action/checkout to v3

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40859: Assignee: Apache Spark > Upgrade action/checkout to v3 > - >

[jira] [Created] (SPARK-40859) Upgrade action/checkout to v3

2022-10-20 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40859: --- Summary: Upgrade action/checkout to v3 Key: SPARK-40859 URL: https://issues.apache.org/jira/browse/SPARK-40859 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40858) Cleanup github action warning

2022-10-20 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-40858: --- Summary: Cleanup github action warning Key: SPARK-40858 URL: https://issues.apache.org/jira/browse/SPARK-40858 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-40176) Enhance collapse window optimization to work in case partition or order by keys are expressions

2022-10-20 Thread Dovi Joel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621100#comment-17621100 ] Dovi Joel commented on SPARK-40176: --- Is this related to this issue?

[jira] [Updated] (SPARK-40176) Enhance collapse window optimization to work in case partition or order by keys are expressions

2022-10-20 Thread Dovi Joel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dovi Joel updated SPARK-40176: -- Attachment: image-2022-10-20-15-10-13-140.png > Enhance collapse window optimization to work in case

[jira] [Updated] (SPARK-40176) Enhance collapse window optimization to work in case partition or order by keys are expressions

2022-10-20 Thread Dovi Joel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dovi Joel updated SPARK-40176: -- Attachment: (was: image-2022-10-20-15-10-13-140.png) > Enhance collapse window optimization to

[jira] [Commented] (SPARK-39203) Fix remote table location based on database location

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621089#comment-17621089 ] Apache Spark commented on SPARK-39203: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-40422) Upgrade hive to 4.0.0

2022-10-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621053#comment-17621053 ] Sean R. Owen commented on SPARK-40422: -- https://issues.apache.org/jira/browse/SPARK-40681 >

[jira] [Assigned] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40857: Assignee: (was: Apache Spark) > Allow configurable GPRC interceptors for Spark

[jira] [Commented] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621045#comment-17621045 ] Apache Spark commented on SPARK-40857: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40857: Assignee: Apache Spark > Allow configurable GPRC interceptors for Spark Connect >

[jira] [Created] (SPARK-40857) Allow configurable GPRC interceptors for Spark Connect

2022-10-20 Thread Martin Grund (Jira)
Martin Grund created SPARK-40857: Summary: Allow configurable GPRC interceptors for Spark Connect Key: SPARK-40857 URL: https://issues.apache.org/jira/browse/SPARK-40857 Project: Spark Issue

[jira] [Commented] (SPARK-40588) Sorting issue with AQE turned on

2022-10-20 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621032#comment-17621032 ] Enrico Minack commented on SPARK-40588: --- Here is a more concise and complete example to reproduce

[jira] [Commented] (SPARK-40856) Update the error template of WRONG_NUM_PARAMS

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621025#comment-17621025 ] Apache Spark commented on SPARK-40856: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40856) Update the error template of WRONG_NUM_PARAMS

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40856: Assignee: Apache Spark > Update the error template of WRONG_NUM_PARAMS >

[jira] [Commented] (SPARK-40856) Update the error template of WRONG_NUM_PARAMS

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621022#comment-17621022 ] Apache Spark commented on SPARK-40856: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-40856) Update the error template of WRONG_NUM_PARAMS

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40856: Assignee: (was: Apache Spark) > Update the error template of WRONG_NUM_PARAMS >

[jira] [Created] (SPARK-40856) Update the error template of WRONG_NUM_PARAMS

2022-10-20 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-40856: --- Summary: Update the error template of WRONG_NUM_PARAMS Key: SPARK-40856 URL: https://issues.apache.org/jira/browse/SPARK-40856 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40852) Implement `DataFrame.summary`

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620969#comment-17620969 ] Apache Spark commented on SPARK-40852: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-40852) Implement `DataFrame.summary`

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620965#comment-17620965 ] Apache Spark commented on SPARK-40852: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40852) Implement `DataFrame.summary`

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40852: Assignee: Apache Spark (was: Ruifeng Zheng) > Implement `DataFrame.summary` >

[jira] [Assigned] (SPARK-40852) Implement `DataFrame.summary`

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40852: Assignee: Ruifeng Zheng (was: Apache Spark) > Implement `DataFrame.summary` >

[jira] [Resolved] (SPARK-40853) Pin mypy-protobuf==3.3.0

2022-10-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40853. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38316

[jira] [Assigned] (SPARK-40853) Pin mypy-protobuf==3.3.0

2022-10-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40853: - Assignee: Ruifeng Zheng > Pin mypy-protobuf==3.3.0 > > >

[jira] [Assigned] (SPARK-40778) Make HeartbeatReceiver as an IsolatedRpcEndpoint

2022-10-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40778: - Assignee: Zhongwei Zhu > Make HeartbeatReceiver as an IsolatedRpcEndpoint >

[jira] [Resolved] (SPARK-40778) Make HeartbeatReceiver as an IsolatedRpcEndpoint

2022-10-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40778. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38231

[jira] [Assigned] (SPARK-40851) TimestampFormatter behavior changed when using the latest Java 8/11/17

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40851: Assignee: Apache Spark > TimestampFormatter behavior changed when using the latest Java

[jira] [Assigned] (SPARK-40851) TimestampFormatter behavior changed when using the latest Java 8/11/17

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40851: Assignee: (was: Apache Spark) > TimestampFormatter behavior changed when using the

[jira] [Commented] (SPARK-40851) TimestampFormatter behavior changed when using the latest Java 8/11/17

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620915#comment-17620915 ] Apache Spark commented on SPARK-40851: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-40855) Add CONTRIBUTING.md to apache/spark-docker

2022-10-20 Thread Qian Sun (Jira)
Qian Sun created SPARK-40855: Summary: Add CONTRIBUTING.md to apache/spark-docker Key: SPARK-40855 URL: https://issues.apache.org/jira/browse/SPARK-40855 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-40659) Schema evolution for protobuf (and Avro too?)

2022-10-20 Thread Sandish Kumar HN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620897#comment-17620897 ] Sandish Kumar HN commented on SPARK-40659: -- [~rangadi] makes sense, will update the

[jira] [Assigned] (SPARK-40854) Change default serialization from 'broken' CSV to Spark DF JSON

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40854: Assignee: Apache Spark > Change default serialization from 'broken' CSV to Spark DF JSON

[jira] [Assigned] (SPARK-40854) Change default serialization from 'broken' CSV to Spark DF JSON

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40854: Assignee: (was: Apache Spark) > Change default serialization from 'broken' CSV to

[jira] [Commented] (SPARK-40854) Change default serialization from 'broken' CSV to Spark DF JSON

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620892#comment-17620892 ] Apache Spark commented on SPARK-40854: -- User 'grundprinzip' has created a pull request for this

[jira] [Commented] (SPARK-40854) Change default serialization from 'broken' CSV to Spark DF JSON

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620893#comment-17620893 ] Apache Spark commented on SPARK-40854: -- User 'grundprinzip' has created a pull request for this

[jira] [Created] (SPARK-40854) Change default serialization from 'broken' CSV to Spark DF JSON

2022-10-20 Thread Martin Grund (Jira)
Martin Grund created SPARK-40854: Summary: Change default serialization from 'broken' CSV to Spark DF JSON Key: SPARK-40854 URL: https://issues.apache.org/jira/browse/SPARK-40854 Project: Spark

[jira] [Assigned] (SPARK-40853) Pin mypy-protobuf==3.3.0

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40853: Assignee: (was: Apache Spark) > Pin mypy-protobuf==3.3.0 >

[jira] [Assigned] (SPARK-40853) Pin mypy-protobuf==3.3.0

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40853: Assignee: Apache Spark > Pin mypy-protobuf==3.3.0 > > >

[jira] [Commented] (SPARK-40853) Pin mypy-protobuf==3.3.0

2022-10-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620890#comment-17620890 ] Apache Spark commented on SPARK-40853: -- User 'zhengruifeng' has created a pull request for this

[jira] [Updated] (SPARK-40853) Pin mypy-protobuf==3.3.0

2022-10-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-40853: -- Summary: Pin mypy-protobuf==3.3.0 (was: Ping mypy-protobuf to 3.3.0) > Pin

[jira] [Created] (SPARK-40853) Ping mypy-protobuf to 3.3.0

2022-10-20 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40853: - Summary: Ping mypy-protobuf to 3.3.0 Key: SPARK-40853 URL: https://issues.apache.org/jira/browse/SPARK-40853 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-40838) Upgrade infra base image to focal-20220922

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40838: --- Assignee: Yikun Jiang > Upgrade infra base image to focal-20220922 >

[jira] [Resolved] (SPARK-40838) Upgrade infra base image to focal-20220922

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40838. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38304

[jira] [Resolved] (SPARK-40845) Add template support for SPARK_GPG_KEY

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40845. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 16

[jira] [Assigned] (SPARK-40845) Add template support for SPARK_GPG_KEY

2022-10-20 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40845: --- Assignee: Yikun Jiang > Add template support for SPARK_GPG_KEY >

[jira] [Updated] (SPARK-39405) NumPy support in SQL

2022-10-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39405: - Shepherd: Hyukjin Kwon > NumPy support in SQL > > > Key:

[jira] [Updated] (SPARK-40819) Parquet INT64 (TIMESTAMP(NANOS,true)) now throwing Illegal Parquet type instead of automatically converting to LongType

2022-10-20 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-40819: -- Affects Version/s: 3.4.0 3.3.1 3.2.3

[jira] [Commented] (SPARK-40422) Upgrade hive to 4.0.0

2022-10-20 Thread Bilna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620774#comment-17620774 ] Bilna commented on SPARK-40422: --- [~srowen] In the mvn dependency tree I can see google-gson is coming

[jira] [Commented] (SPARK-40457) upgrade jackson data mapper to latest

2022-10-20 Thread Bilna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620766#comment-17620766 ] Bilna commented on SPARK-40457: --- [~hyukjin.kwon] Understood. So I think I can mark this as false positive.

[jira] [Commented] (SPARK-40758) Upgrade Apache zookeeper to get rid of CVE-2020-10663

2022-10-20 Thread Bilna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620765#comment-17620765 ] Bilna commented on SPARK-40758: --- https://issues.apache.org/jira/browse/ZOOKEEPER-3933 This link says the

[jira] [Assigned] (SPARK-40852) Implement `DataFrame.summary`

2022-10-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40852: - Assignee: Ruifeng Zheng > Implement `DataFrame.summary` >

[jira] [Created] (SPARK-40852) Implement `DataFrame.summary`

2022-10-20 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40852: - Summary: Implement `DataFrame.summary` Key: SPARK-40852 URL: https://issues.apache.org/jira/browse/SPARK-40852 Project: Spark Issue Type: Sub-task