[jira] [Created] (SPARK-38066) evaluateEquality should ignore attribute without min/max ColumnStat

Fencheng Mei created SPARK-38066: Summary: evaluateEquality should ignore attribute without min/max ColumnStat Key: SPARK-38066 URL: https://issues.apache.org/jira/browse/SPARK-38066 Project: Spark

[jira] [Commented] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484075#comment-17484075 ] Apache Spark commented on SPARK-37932: -- User 'chenzhx' has created a pull request f

[jira] [Assigned] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37932: Assignee: Apache Spark > Analyzer can fail when join left side and right side are the sam

[jira] [Assigned] (SPARK-37932) Analyzer can fail when join left side and right side are the same view

[ https://issues.apache.org/jira/browse/SPARK-37932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37932: Assignee: (was: Apache Spark) > Analyzer can fail when join left side and right side

[jira] [Commented] (SPARK-37392) Catalyst optimizer very time-consuming and memory-intensive with some "explode(array)"

[ https://issues.apache.org/jira/browse/SPARK-37392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484072#comment-17484072 ] Shivam Verma commented on SPARK-37392: -- Is there a plan to backport the changes to

[jira] [Assigned] (SPARK-37793) Invalid LocalMergedBlockData cause task hang

[ https://issues.apache.org/jira/browse/SPARK-37793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-37793: --- Assignee: Chandni Singh > Invalid LocalMergedBlockData cause task hang > --

[jira] [Resolved] (SPARK-37793) Invalid LocalMergedBlockData cause task hang

[ https://issues.apache.org/jira/browse/SPARK-37793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-37793. - Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed > Invalid

[jira] [Resolved] (SPARK-37675) Push-based merge finalization bugs in the RemoteBlockPushResolver

[ https://issues.apache.org/jira/browse/SPARK-37675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-37675. - Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue res

[jira] [Assigned] (SPARK-37675) Push-based merge finalization bugs in the RemoteBlockPushResolver

[ https://issues.apache.org/jira/browse/SPARK-37675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-37675: --- Assignee: Chandni Singh > Push-based merge finalization bugs in the RemoteB

[jira] [Commented] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484046#comment-17484046 ] Dongjoon Hyun commented on SPARK-38062: --- I removed the JIRA links because your env

[jira] [Assigned] (SPARK-38065) Improve the performance of DS V2 aggregate push-down

[ https://issues.apache.org/jira/browse/SPARK-38065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38065: Assignee: (was: Apache Spark) > Improve the performance of DS V2 aggregate push-down

[jira] [Assigned] (SPARK-38065) Improve the performance of DS V2 aggregate push-down

[ https://issues.apache.org/jira/browse/SPARK-38065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38065: Assignee: Apache Spark > Improve the performance of DS V2 aggregate push-down > -

[jira] [Commented] (SPARK-38065) Improve the performance of DS V2 aggregate push-down

[ https://issues.apache.org/jira/browse/SPARK-38065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484043#comment-17484043 ] Apache Spark commented on SPARK-38065: -- User 'beliefer' has created a pull request

[jira] [Updated] (SPARK-38065) Improve the performance of DS V2 aggregate push-down

[ https://issues.apache.org/jira/browse/SPARK-38065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38065: --- Summary: Improve the performance of DS V2 aggregate push-down (was: Improve the implement of DS V2

[jira] [Created] (SPARK-38065) Improve the implement of DS V2 aggregate push-down

jiaan.geng created SPARK-38065: -- Summary: Improve the implement of DS V2 aggregate push-down Key: SPARK-38065 URL: https://issues.apache.org/jira/browse/SPARK-38065 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-37713) No namespace assigned in Executor Pod ConfigMap

[ https://issues.apache.org/jira/browse/SPARK-37713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484041#comment-17484041 ] Apache Spark commented on SPARK-37713: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-38064) Push-based shuffle's internal implementation details should not be exposed as API

Venkata krishnan Sowrirajan created SPARK-38064: --- Summary: Push-based shuffle's internal implementation details should not be exposed as API Key: SPARK-38064 URL: https://issues.apache.org/jira/brows

[jira] [Assigned] (SPARK-38063) Support SQL split_part function

[ https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38063: Assignee: (was: Apache Spark) > Support SQL split_part function > ---

[jira] [Commented] (SPARK-38063) Support SQL split_part function

[ https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484030#comment-17484030 ] Apache Spark commented on SPARK-38063: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-38063) Support SQL split_part function

[ https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38063: Assignee: Apache Spark > Support SQL split_part function > --

[jira] [Commented] (SPARK-38063) Support SQL split_part function

[ https://issues.apache.org/jira/browse/SPARK-38063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484029#comment-17484029 ] Rui Wang commented on SPARK-38063: -- PR is ready: https://github.com/apache/spark/pull/3

[jira] [Created] (SPARK-38063) Support SQL split_part function

Rui Wang created SPARK-38063: Summary: Support SQL split_part function Key: SPARK-38063 URL: https://issues.apache.org/jira/browse/SPARK-38063 Project: Spark Issue Type: Task Components

[jira] [Commented] (SPARK-38059) Incorrect query ordering with flatMap() and distinct()

[ https://issues.apache.org/jira/browse/SPARK-38059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484023#comment-17484023 ] AJ Bousquet commented on SPARK-38059: - I ported this to use the Spark Java Quick Sta

[jira] [Updated] (SPARK-38059) Incorrect query ordering with flatMap() and distinct()

[ https://issues.apache.org/jira/browse/SPARK-38059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AJ Bousquet updated SPARK-38059: Affects Version/s: 3.2.0 > Incorrect query ordering with flatMap() and distinct() > --

[jira] [Comment Edited] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484013#comment-17484013 ] Erik Krogen edited comment on SPARK-38062 at 1/28/22, 11:10 PM: --

[jira] [Commented] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484013#comment-17484013 ] Erik Krogen commented on SPARK-38062: - Sorry, I should have clarified -- the test is

[jira] [Commented] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484005#comment-17484005 ] Dongjoon Hyun commented on SPARK-38062: --- [~xkrogen]. Well, it doesn't sounds like

[jira] [Commented] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483978#comment-17483978 ] Apache Spark commented on SPARK-38062: -- User 'xkrogen' has created a pull request f

[jira] [Assigned] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38062: Assignee: (was: Apache Spark) > FallbackStorage shouldn't attempt to resolve arbitrar

[jira] [Assigned] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38062: Assignee: Apache Spark > FallbackStorage shouldn't attempt to resolve arbitrary "remote"

[jira] [Commented] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483975#comment-17483975 ] Apache Spark commented on SPARK-38062: -- User 'xkrogen' has created a pull request f

[jira] [Commented] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483955#comment-17483955 ] Erik Krogen commented on SPARK-38062: - Just found SPARK-37318, which disables all {{

[jira] [Updated] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

[ https://issues.apache.org/jira/browse/SPARK-38062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-38062: Affects Version/s: 3.1.1 (was: 3.2.1) > FallbackStorage shouldn't attem

[jira] [Created] (SPARK-38062) FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname

Erik Krogen created SPARK-38062: --- Summary: FallbackStorage shouldn't attempt to resolve arbitrary "remote" hostname Key: SPARK-38062 URL: https://issues.apache.org/jira/browse/SPARK-38062 Project: Spark

[jira] [Updated] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujit Biswas updated SPARK-38061: - Attachment: scan-security-report-spark-3.2.0-jre-11.csv > security scan issue jackson-databindin

[jira] [Created] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

Sujit Biswas created SPARK-38061: Summary: security scan issue jackson-databinding HDFS dependency library Key: SPARK-38061 URL: https://issues.apache.org/jira/browse/SPARK-38061 Project: Spark

[jira] [Updated] (SPARK-38060) Inconsistent behavior from JSON option allowNonNumericNumbers

[ https://issues.apache.org/jira/browse/SPARK-38060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated SPARK-38060: --- Description: The behavior of the JSON option allowNonNumericNumbers is not consistent: 1. Some NaN

[jira] [Created] (SPARK-38060) Inconsistent behavior from JSON option allowNonNumericNumbers

Andy Grove created SPARK-38060: -- Summary: Inconsistent behavior from JSON option allowNonNumericNumbers Key: SPARK-38060 URL: https://issues.apache.org/jira/browse/SPARK-38060 Project: Spark Is

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483845#comment-17483845 ] Apache Spark commented on SPARK-21195: -- User 'robert3005' has created a pull reques

[jira] [Created] (SPARK-38059) Incorrect query ordering with flatMap() and distinct()

AJ Bousquet created SPARK-38059: --- Summary: Incorrect query ordering with flatMap() and distinct() Key: SPARK-38059 URL: https://issues.apache.org/jira/browse/SPARK-38059 Project: Spark Issue Ty

[jira] [Commented] (SPARK-24156) Enable no-data micro batches for more eager streaming state clean up

[ https://issues.apache.org/jira/browse/SPARK-24156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483838#comment-17483838 ] krishna commented on SPARK-24156: - Hi [~kcsrms] [~tdas] ,   I am having the same issue.

[jira] [Created] (SPARK-38058) Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently

john created SPARK-38058: Summary: Writing a spark dataframe to Azure Sql Server is causing duplicate records intermittently Key: SPARK-38058 URL: https://issues.apache.org/jira/browse/SPARK-38058 Project: Sp

[jira] [Created] (SPARK-38057) Log4j remediation on spark binary files

Rajabhupati KS created SPARK-38057: -- Summary: Log4j remediation on spark binary files Key: SPARK-38057 URL: https://issues.apache.org/jira/browse/SPARK-38057 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-37923) Generate partition transforms for BucketSpec inside parser

[ https://issues.apache.org/jira/browse/SPARK-37923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37923: --- Assignee: Huaxin Gao > Generate partition transforms for BucketSpec inside parser > ---

[jira] [Resolved] (SPARK-37923) Generate partition transforms for BucketSpec inside parser

[ https://issues.apache.org/jira/browse/SPARK-37923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37923. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35221 [https://gith

[jira] [Commented] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483781#comment-17483781 ] Apache Spark commented on SPARK-38056: -- User 'kuwii' has created a pull request for

[jira] [Assigned] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38056: Assignee: (was: Apache Spark) > Structured streaming not working in history server wh

[jira] [Commented] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483779#comment-17483779 ] Apache Spark commented on SPARK-38056: -- User 'kuwii' has created a pull request for

[jira] [Assigned] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38056: Assignee: Apache Spark > Structured streaming not working in history server when using Le

[jira] [Updated] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiyi Kong updated SPARK-38056: --- Description: In [SPARK-31953|https://github.com/apache/spark/commit/4f9667035886a67e6c9a4e8fad2efa3

[jira] [Updated] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiyi Kong updated SPARK-38056: --- Description: In [SPARK-31953|https://github.com/apache/spark/commit/4f9667035886a67e6c9a4e8fad2efa3

[jira] [Created] (SPARK-38056) Structured streaming not working in history server when using LevelDB

Weiyi Kong created SPARK-38056: -- Summary: Structured streaming not working in history server when using LevelDB Key: SPARK-38056 URL: https://issues.apache.org/jira/browse/SPARK-38056 Project: Spark

[jira] [Updated] (SPARK-38056) Structured streaming not working in history server when using LevelDB

[ https://issues.apache.org/jira/browse/SPARK-38056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiyi Kong updated SPARK-38056: --- Attachment: local-1643373518829 > Structured streaming not working in history server when using Leve

[jira] [Created] (SPARK-38055) KBS Training

John Son created SPARK-38055: Summary: KBS Training Key: SPARK-38055 URL: https://issues.apache.org/jira/browse/SPARK-38055 Project: Spark Issue Type: Bug Components: Examples Affec

[jira] [Comment Edited] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483735#comment-17483735 ] chris snow edited comment on SPARK-24668 at 1/28/22, 12:03 PM: ---

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483735#comment-17483735 ] chris snow commented on SPARK-24668: I tried `getOrElse(None)` ... {code:java} /usr/

[jira] [Assigned] (SPARK-38054) DS V2 supports list namespaces of MySQL

[ https://issues.apache.org/jira/browse/SPARK-38054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38054: Assignee: Apache Spark > DS V2 supports list namespaces of MySQL > --

[jira] [Commented] (SPARK-38054) DS V2 supports list namespaces of MySQL

[ https://issues.apache.org/jira/browse/SPARK-38054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483714#comment-17483714 ] Apache Spark commented on SPARK-38054: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-38054) DS V2 supports list namespaces of MySQL

[ https://issues.apache.org/jira/browse/SPARK-38054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38054: Assignee: (was: Apache Spark) > DS V2 supports list namespaces of MySQL > ---

[jira] [Created] (SPARK-38054) DS V2 supports list namespaces of MySQL

jiaan.geng created SPARK-38054: -- Summary: DS V2 supports list namespaces of MySQL Key: SPARK-38054 URL: https://issues.apache.org/jira/browse/SPARK-38054 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-38035) Add docker tests for build-in JDBC dialect

[ https://issues.apache.org/jira/browse/SPARK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38035: --- Assignee: jiaan.geng > Add docker tests for build-in JDBC dialect > ---

[jira] [Resolved] (SPARK-38035) Add docker tests for build-in JDBC dialect

[ https://issues.apache.org/jira/browse/SPARK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38035. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35333 [https://gith

[jira] [Commented] (SPARK-38053) Report driver side metric from datasource V2

[ https://issues.apache.org/jira/browse/SPARK-38053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483667#comment-17483667 ] Apache Spark commented on SPARK-38053: -- User 'Yikf' has created a pull request for

[jira] [Assigned] (SPARK-38053) Report driver side metric from datasource V2

[ https://issues.apache.org/jira/browse/SPARK-38053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38053: Assignee: (was: Apache Spark) > Report driver side metric from datasource V2 > --

[jira] [Assigned] (SPARK-38053) Report driver side metric from datasource V2

[ https://issues.apache.org/jira/browse/SPARK-38053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38053: Assignee: Apache Spark > Report driver side metric from datasource V2 > -

[jira] [Created] (SPARK-38053) Report driver side metric from datasource V2

yikf created SPARK-38053: Summary: Report driver side metric from datasource V2 Key: SPARK-38053 URL: https://issues.apache.org/jira/browse/SPARK-38053 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-38049) Use Java 17 in K8s integration tests

[ https://issues.apache.org/jira/browse/SPARK-38049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38049. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35346 [https://

[jira] [Commented] (SPARK-37994) Unable to build spark3.2 with -Dhadoop.version=3.1.4

[ https://issues.apache.org/jira/browse/SPARK-37994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483628#comment-17483628 ] Vu Tan commented on SPARK-37994: And by the way I understood the reason for setting vers