[jira] [Assigned] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36776: Assignee: (was: Apache Spark) > Partition filter of DataSourceV2ScanRelation can not

[jira] [Assigned] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36776: Assignee: Apache Spark > Partition filter of DataSourceV2ScanRelation can not push down

[jira] [Commented] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417015#comment-17417015 ] Apache Spark commented on SPARK-36776: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36796) Make all unit tests pass on Java 17

2021-09-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417013#comment-17417013 ] Yang Jie commented on SPARK-36796: -- i'm working on this > Make all unit tests pass on Java 17 >

[jira] [Comment Edited] (SPARK-36796) Make all unit tests pass on Java 17

2021-09-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417013#comment-17417013 ] Yang Jie edited comment on SPARK-36796 at 9/18/21, 4:25 AM: I'm working on

[jira] [Created] (SPARK-36796) Make all unit tests pass on Java 17

2021-09-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36796: --- Summary: Make all unit tests pass on Java 17 Key: SPARK-36796 URL: https://issues.apache.org/jira/browse/SPARK-36796 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

2021-09-17 Thread suheng.cloud (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416987#comment-17416987 ] suheng.cloud commented on SPARK-36776: -- Thank you Hyukjin & Huaxin~ > Partition filter of

[jira] [Resolved] (SPARK-36762) Fix Series.isin when Series has NaN values

2021-09-17 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36762. --- Fix Version/s: 3.2.0 Assignee: dgd_contributor Resolution: Fixed Issue

[jira] [Commented] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

2021-09-17 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416944#comment-17416944 ] Huaxin Gao commented on SPARK-36776: This is fixed in Spark master/3.2 in this PR

[jira] [Assigned] (SPARK-36795) Explain Formatted has Duplicated Node IDs with InMemoryRelation Present

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36795: Assignee: (was: Apache Spark) > Explain Formatted has Duplicated Node IDs with

[jira] [Commented] (SPARK-36795) Explain Formatted has Duplicated Node IDs with InMemoryRelation Present

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416941#comment-17416941 ] Apache Spark commented on SPARK-36795: -- User 'ChenMichael' has created a pull request for this

[jira] [Assigned] (SPARK-36795) Explain Formatted has Duplicated Node IDs with InMemoryRelation Present

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36795: Assignee: Apache Spark > Explain Formatted has Duplicated Node IDs with InMemoryRelation

[jira] [Created] (SPARK-36795) Explain Formatted has Duplicated Node IDs with InMemoryRelation Present

2021-09-17 Thread Michael Chen (Jira)
Michael Chen created SPARK-36795: Summary: Explain Formatted has Duplicated Node IDs with InMemoryRelation Present Key: SPARK-36795 URL: https://issues.apache.org/jira/browse/SPARK-36795 Project:

[jira] [Assigned] (SPARK-36793) [K8S] Support write container stdout/stderr to file

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36793: Assignee: Apache Spark > [K8S] Support write container stdout/stderr to file >

[jira] [Assigned] (SPARK-36793) [K8S] Support write container stdout/stderr to file

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36793: Assignee: (was: Apache Spark) > [K8S] Support write container stdout/stderr to file

[jira] [Commented] (SPARK-36793) [K8S] Support write container stdout/stderr to file

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416896#comment-17416896 ] Apache Spark commented on SPARK-36793: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-36794) Ignore duplicated join keys when building relation for SEMI/ANTI hash join

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36794: Assignee: (was: Apache Spark) > Ignore duplicated join keys when building relation

[jira] [Commented] (SPARK-36794) Ignore duplicated join keys when building relation for SEMI/ANTI hash join

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416879#comment-17416879 ] Apache Spark commented on SPARK-36794: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36794) Ignore duplicated join keys when building relation for SEMI/ANTI hash join

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36794: Assignee: Apache Spark > Ignore duplicated join keys when building relation for

[jira] [Updated] (SPARK-36794) Ignore duplicated join keys when building relation for SEMI/ANTI hash join

2021-09-17 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-36794: - Summary: Ignore duplicated join keys when building relation for SEMI/ANTI hash join (was: Ignore

[jira] [Created] (SPARK-36794) Ignore duplicated join keys when building relation for LEFT/ANTI hash join

2021-09-17 Thread Cheng Su (Jira)
Cheng Su created SPARK-36794: Summary: Ignore duplicated join keys when building relation for LEFT/ANTI hash join Key: SPARK-36794 URL: https://issues.apache.org/jira/browse/SPARK-36794 Project: Spark

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2021-09-17 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416846#comment-17416846 ] Stavros Kontopoulos edited comment on SPARK-23153 at 9/17/21, 6:25 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2021-09-17 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416846#comment-17416846 ] Stavros Kontopoulos edited comment on SPARK-23153 at 9/17/21, 6:23 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2021-09-17 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416846#comment-17416846 ] Stavros Kontopoulos edited comment on SPARK-23153 at 9/17/21, 6:21 PM:

[jira] [Commented] (SPARK-23153) Support application dependencies in submission client's local file system

2021-09-17 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416846#comment-17416846 ] Stavros Kontopoulos commented on SPARK-23153: - [~xuzhoyin] sorry for the late reply, the

[jira] [Created] (SPARK-36793) [K8S] Support write container stdout/stderr to file

2021-09-17 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-36793: Summary: [K8S] Support write container stdout/stderr to file Key: SPARK-36793 URL: https://issues.apache.org/jira/browse/SPARK-36793 Project: Spark Issue

[jira] [Assigned] (SPARK-36792) Inset should handle Double.NaN and Float.NaN

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36792: Assignee: Apache Spark > Inset should handle Double.NaN and Float.NaN >

[jira] [Commented] (SPARK-36792) Inset should handle Double.NaN and Float.NaN

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416799#comment-17416799 ] Apache Spark commented on SPARK-36792: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-36792) Inset should handle Double.NaN and Float.NaN

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36792: Assignee: (was: Apache Spark) > Inset should handle Double.NaN and Float.NaN >

[jira] [Commented] (SPARK-36673) Incorrect Unions of struct with mismatched field name case

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416782#comment-17416782 ] Apache Spark commented on SPARK-36673: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-33772) Build and Run Spark on Java 17

2021-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33772: -- Labels: releasenotes (was: ) > Build and Run Spark on Java 17 >

[jira] [Updated] (SPARK-36772) FinalizeShuffleMerge fails with an exception due to attempt id not matching

2021-09-17 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-36772: -- Target Version/s: 3.2.0 > FinalizeShuffleMerge fails with an exception due to attempt id not

[jira] [Commented] (SPARK-36792) Inset should handle Double.NaN and Float.NaN

2021-09-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416743#comment-17416743 ] angerszhu commented on SPARK-36792: --- raise a pr soon > Inset should handle Double.NaN and Float.NaN >

[jira] [Created] (SPARK-36792) Inset should handle Double.NaN and Float.NaN

2021-09-17 Thread angerszhu (Jira)
angerszhu created SPARK-36792: - Summary: Inset should handle Double.NaN and Float.NaN Key: SPARK-36792 URL: https://issues.apache.org/jira/browse/SPARK-36792 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36663: --- Assignee: Kousuke Saruta > When the existing field name is a number, an error will be

[jira] [Resolved] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36663. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33915

[jira] [Resolved] (SPARK-36767) ArrayMin/ArrayMax/SortArray/ArraySort add comment and UT

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36767. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34008

[jira] [Assigned] (SPARK-36767) ArrayMin/ArrayMax/SortArray/ArraySort add comment and UT

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36767: --- Assignee: angerszhu > ArrayMin/ArrayMax/SortArray/ArraySort add comment and UT >

[jira] [Assigned] (SPARK-36673) Incorrect Unions of struct with mismatched field name case

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36673: --- Assignee: L. C. Hsieh > Incorrect Unions of struct with mismatched field name case >

[jira] [Resolved] (SPARK-36673) Incorrect Unions of struct with mismatched field name case

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36673. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34025

[jira] [Resolved] (SPARK-36718) only collapse projects if we don't duplicate expensive expressions

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36718. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33958

[jira] [Assigned] (SPARK-36718) only collapse projects if we don't duplicate expensive expressions

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36718: --- Assignee: Wenchen Fan > only collapse projects if we don't duplicate expensive expressions

[jira] [Resolved] (SPARK-36764) Fix race-condition on "ensure continuous stream is being used" in KafkaContinuousTest

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36764. - Fix Version/s: 3.2.0 Assignee: Jungtaek Lim Resolution: Fixed > Fix

[jira] [Resolved] (SPARK-36741) array_distinct should not return duplicated NaN

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36741. - Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fixed

[jira] [Assigned] (SPARK-36741) array_distinct should not return duplicated NaN

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36741: --- Assignee: angerszhu > array_distinct should not return duplicated NaN >

[jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

2021-09-17 Thread Manu Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416656#comment-17416656 ] Manu Zhang commented on SPARK-31646: [~yzhangal], Please check this comment 

[jira] [Comment Edited] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

2021-09-17 Thread Manu Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416656#comment-17416656 ] Manu Zhang edited comment on SPARK-31646 at 9/17/21, 12:40 PM: ---

[jira] [Commented] (SPARK-36765) Spark Support for MS Sql JDBC connector with Kerberos/Keytab

2021-09-17 Thread Jakub Pawlowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416635#comment-17416635 ] Jakub Pawlowski commented on SPARK-36765: - As per documentation on JDBC driver, sqljdbc_auth lib

[jira] [Assigned] (SPARK-36778) Support ILIKE API on Scala(dataframe)

2021-09-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36778: Assignee: Leona Yoda > Support ILIKE API on Scala(dataframe) >

[jira] [Resolved] (SPARK-36778) Support ILIKE API on Scala(dataframe)

2021-09-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36778. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34027

[jira] [Assigned] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36791: Assignee: Apache Spark > this is a spelling mistakes in running-on-yarn.md file where

[jira] [Commented] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416612#comment-17416612 ] Apache Spark commented on SPARK-36791: -- User 'jiaoqingbo' has created a pull request for this

[jira] [Assigned] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36791: Assignee: (was: Apache Spark) > this is a spelling mistakes in running-on-yarn.md

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Target Version/s: 3.1.2, 3.2.0 (was: 3.1.2) > this is a spelling mistakes in running-on-yarn.md

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Description: {code:java} NOTE: you need to replace  and  with actual value the JHS_POST should

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Fix Version/s: 3.2.0 > this is a spelling mistakes in running-on-yarn.md file where JHS_POST

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Description: {code:java} NOTE: you need to replace  and  with actual value the JHS_POST should

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Description: {code:java} // code placeholder NOTE: you need to replace  and  with actual value

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Attachment: error_message.png > this is a spelling mistakes in running-on-yarn.md file where

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Attachment: 微信截图_20210917181324.png > this is a spelling mistakes in running-on-yarn.md file

[jira] [Updated] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingbo jiao updated SPARK-36791: Attachment: (was: 微信截图_20210917181324.png) > this is a spelling mistakes in

[jira] [Created] (SPARK-36791) this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST

2021-09-17 Thread qingbo jiao (Jira)
qingbo jiao created SPARK-36791: --- Summary: this is a spelling mistakes in running-on-yarn.md file where JHS_POST should be JHS_HOST Key: SPARK-36791 URL: https://issues.apache.org/jira/browse/SPARK-36791

[jira] [Updated] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-09-17 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-36727: Priority: Major (was: Minor) > Support sql overwrite a path that is also being read from when >

[jira] [Resolved] (SPARK-36789) use the correct constant type as the null value holder in array functions

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36789. - Fix Version/s: 3.0.4 3.1.3 3.2.0 Resolution: Fixed

[jira] [Commented] (SPARK-36765) Spark Support for MS Sql JDBC connector with Kerberos/Keytab

2021-09-17 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416519#comment-17416519 ] Gabor Somogyi commented on SPARK-36765: --- It was long time ago when I've done that and AFAIR it

[jira] [Commented] (SPARK-36790) Update user-facing catalog to adapt CatalogPlugin

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416490#comment-17416490 ] Apache Spark commented on SPARK-36790: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36790) Update user-facing catalog to adapt CatalogPlugin

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36790: Assignee: Apache Spark > Update user-facing catalog to adapt CatalogPlugin >

[jira] [Assigned] (SPARK-36790) Update user-facing catalog to adapt CatalogPlugin

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36790: Assignee: (was: Apache Spark) > Update user-facing catalog to adapt CatalogPlugin >

[jira] [Resolved] (SPARK-32709) Write Hive ORC/Parquet bucketed table with hivehash (for Hive 1,2)

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32709. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33432

[jira] [Assigned] (SPARK-32709) Write Hive ORC/Parquet bucketed table with hivehash (for Hive 1,2)

2021-09-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32709: --- Assignee: Cheng Su > Write Hive ORC/Parquet bucketed table with hivehash (for Hive 1,2) >

[jira] [Updated] (SPARK-36790) Update user-facing catalog to adapt CatalogPlugin

2021-09-17 Thread PengLei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengLei updated SPARK-36790: Description: At now the SparkSession.catalog always retuan a CatalogImpl with a SessionCatalog that is

[jira] [Created] (SPARK-36790) Update user-facing catalog to adapt CatalogPlugin

2021-09-17 Thread PengLei (Jira)
PengLei created SPARK-36790: --- Summary: Update user-facing catalog to adapt CatalogPlugin Key: SPARK-36790 URL: https://issues.apache.org/jira/browse/SPARK-36790 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-36789) use the correct constant type as the null value holder in array functions

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416476#comment-17416476 ] Apache Spark commented on SPARK-36789: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36789) use the correct constant type as the null value holder in array functions

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36789: Assignee: Wenchen Fan (was: Apache Spark) > use the correct constant type as the null

[jira] [Assigned] (SPARK-36789) use the correct constant type as the null value holder in array functions

2021-09-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36789: Assignee: Apache Spark (was: Wenchen Fan) > use the correct constant type as the null

[jira] [Created] (SPARK-36789) use the correct constant type as the null value holder in array functions

2021-09-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-36789: --- Summary: use the correct constant type as the null value holder in array functions Key: SPARK-36789 URL: https://issues.apache.org/jira/browse/SPARK-36789 Project: