[jira] [Assigned] (SPARK-33413) SparkUI / Executor Page doesn't work where under external reverse proxy

[ https://issues.apache.org/jira/browse/SPARK-33413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33413: Assignee: Apache Spark > SparkUI / Executor Page doesn't work where under external revers

[jira] [Commented] (SPARK-33413) SparkUI / Executor Page doesn't work where under external reverse proxy

[ https://issues.apache.org/jira/browse/SPARK-33413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230446#comment-17230446 ] Apache Spark commented on SPARK-33413: -- User 'PierreLeresteux' has created a pull r

[jira] [Assigned] (SPARK-33413) SparkUI / Executor Page doesn't work where under external reverse proxy

[ https://issues.apache.org/jira/browse/SPARK-33413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33413: Assignee: (was: Apache Spark) > SparkUI / Executor Page doesn't work where under exte

[jira] [Commented] (SPARK-32916) Add support for external shuffle service in YARN deployment mode to leverage push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-32916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230448#comment-17230448 ] Apache Spark commented on SPARK-32916: -- User 'otterc' has created a pull request fo

[jira] [Resolved] (SPARK-33386) Accessing array elements should failed if index is out of bound.

[ https://issues.apache.org/jira/browse/SPARK-33386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33386. - Fix Version/s: 3.1.0 Assignee: Leanken.Lin Resolution: Fixed > Accessing array e

[jira] [Assigned] (SPARK-33428) conv UDF returns incorrect value

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33428: Assignee: (was: Apache Spark) > conv UDF returns incorrect value > --

[jira] [Commented] (SPARK-33428) conv UDF returns incorrect value

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230464#comment-17230464 ] Apache Spark commented on SPARK-33428: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-33428) conv UDF returns incorrect value

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33428: Assignee: Apache Spark > conv UDF returns incorrect value > -

[jira] [Commented] (SPARK-33428) conv UDF returns incorrect value

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230463#comment-17230463 ] Apache Spark commented on SPARK-33428: -- User 'AngersZh' has created a pull requ

[jira] [Created] (SPARK-33430) Support namespaces in JDBC v2 Table Catalog

Maxim Gekk created SPARK-33430: -- Summary: Support namespaces in JDBC v2 Table Catalog Key: SPARK-33430 URL: https://issues.apache.org/jira/browse/SPARK-33430 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-33430) Support namespaces in JDBC v2 Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-33430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230514#comment-17230514 ] Maxim Gekk commented on SPARK-33430: [~cloud_fan] [~huaxingao] It would be nice to s

[jira] [Commented] (SPARK-23499) Mesos Cluster Dispatcher should support priority queues to submit drivers

[ https://issues.apache.org/jira/browse/SPARK-23499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230520#comment-17230520 ] Apache Spark commented on SPARK-23499: -- User 'pgillet' has created a pull request f

[jira] [Commented] (SPARK-32110) -0.0 vs 0.0 is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-32110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230524#comment-17230524 ] Bart Samwel commented on SPARK-32110: - I think the path we went on so far is to norm

[jira] [Resolved] (SPARK-32907) adaptively blockify instances

[ https://issues.apache.org/jira/browse/SPARK-32907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu resolved SPARK-32907. Fix Version/s: 3.1.0 Target Version/s: 3.1.0 Resolution: Fixed Resolved in https:

[jira] [Commented] (SPARK-33430) Support namespaces in JDBC v2 Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-33430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230533#comment-17230533 ] Wenchen Fan commented on SPARK-33430: - yea, like creating/dropping database/schema.

[jira] [Assigned] (SPARK-33421) Support Greatest and Least in Expression Canonicalize

[ https://issues.apache.org/jira/browse/SPARK-33421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33421: Assignee: ulysses you > Support Greatest and Least in Expression Canonicalize > -

[jira] [Resolved] (SPARK-33421) Support Greatest and Least in Expression Canonicalize

[ https://issues.apache.org/jira/browse/SPARK-33421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33421. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30330 [https://gi

[jira] [Created] (SPARK-33431) Simplifying equality of the instance of Option and Some(value)

Yang Jie created SPARK-33431: Summary: Simplifying equality of the instance of Option and Some(value) Key: SPARK-33431 URL: https://issues.apache.org/jira/browse/SPARK-33431 Project: Spark Issue

[jira] [Updated] (SPARK-33431) Simplifying equality of the instance of Option and Some(value)

[ https://issues.apache.org/jira/browse/SPARK-33431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-33431: - Description: There are some code like "InstanceOfOption == Some(value)", for example "TaskSetManager#ha

[jira] [Created] (SPARK-33432) DataType parser should use active SQLConf

Lu Lu created SPARK-33432: - Summary: DataType parser should use active SQLConf Key: SPARK-33432 URL: https://issues.apache.org/jira/browse/SPARK-33432 Project: Spark Issue Type: Bug Compone

[jira] [Updated] (SPARK-33432) DataType parser should use active SQLConf

[ https://issues.apache.org/jira/browse/SPARK-33432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33432: -- Description: In ANSI mode, schema string parsing should fail if the schema uses ANSI reserved keyword as attr

[jira] [Commented] (SPARK-33431) Simplifying equality of the instance of Option and Some(value)

[ https://issues.apache.org/jira/browse/SPARK-33431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230565#comment-17230565 ] Apache Spark commented on SPARK-33431: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-33431) Simplifying equality of the instance of Option and Some(value)

[ https://issues.apache.org/jira/browse/SPARK-33431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33431: Assignee: Apache Spark > Simplifying equality of the instance of Option and Some(value) >

[jira] [Assigned] (SPARK-33431) Simplifying equality of the instance of Option and Some(value)

[ https://issues.apache.org/jira/browse/SPARK-33431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33431: Assignee: (was: Apache Spark) > Simplifying equality of the instance of Option and So

[jira] [Commented] (SPARK-33140) make all sub-class of Rule[QueryPlan] using SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-33140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230569#comment-17230569 ] Apache Spark commented on SPARK-33140: -- User 'linhongliu-db' has created a pull req

[jira] [Commented] (SPARK-33431) Simplifying equality of the instance of Option and Some(value)

[ https://issues.apache.org/jira/browse/SPARK-33431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230564#comment-17230564 ] Apache Spark commented on SPARK-33431: -- User 'LuciferYang' has created a pull reque

[jira] [Updated] (SPARK-33432) SQL parser should use active SQLConf

[ https://issues.apache.org/jira/browse/SPARK-33432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33432: -- Summary: SQL parser should use active SQLConf (was: DataType parser should use active SQLConf) > SQL parser

[jira] [Commented] (SPARK-32907) adaptively blockify instances

[ https://issues.apache.org/jira/browse/SPARK-32907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230595#comment-17230595 ] Apache Spark commented on SPARK-32907: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-33433) Change Aggregate max rows to 1 if grouping is empty

ulysses you created SPARK-33433: --- Summary: Change Aggregate max rows to 1 if grouping is empty Key: SPARK-33433 URL: https://issues.apache.org/jira/browse/SPARK-33433 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-33433) Change Aggregate max rows to 1 if grouping is empty

[ https://issues.apache.org/jira/browse/SPARK-33433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33433: Assignee: Apache Spark > Change Aggregate max rows to 1 if grouping is empty > --

[jira] [Commented] (SPARK-33433) Change Aggregate max rows to 1 if grouping is empty

[ https://issues.apache.org/jira/browse/SPARK-33433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230675#comment-17230675 ] Apache Spark commented on SPARK-33433: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-33433) Change Aggregate max rows to 1 if grouping is empty

[ https://issues.apache.org/jira/browse/SPARK-33433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33433: Assignee: (was: Apache Spark) > Change Aggregate max rows to 1 if grouping is empty >

[jira] [Assigned] (SPARK-33278) Improve the performance for FIRST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-33278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33278: --- Assignee: jiaan.geng > Improve the performance for FIRST_VALUE > --

[jira] [Resolved] (SPARK-33278) Improve the performance for FIRST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-33278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33278. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30178 [https://gith

[jira] [Updated] (SPARK-33399) Normalize output partitioning and sortorder with respect to aliases to avoid unneeded exchange/sort nodes

[ https://issues.apache.org/jira/browse/SPARK-33399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakhar Jain updated SPARK-33399: - Summary: Normalize output partitioning and sortorder with respect to aliases to avoid unneeded e

[jira] [Commented] (SPARK-33430) Support namespaces in JDBC v2 Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-33430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230787#comment-17230787 ] Huaxin Gao commented on SPARK-33430: [~cloud_fan] yes, I will work on this. Thanks

[jira] [Created] (SPARK-33434) Document spark.conf.isModifiable()

Nicholas Chammas created SPARK-33434: Summary: Document spark.conf.isModifiable() Key: SPARK-33434 URL: https://issues.apache.org/jira/browse/SPARK-33434 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-33434) Document spark.conf.isModifiable()

[ https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-33434: - Description: PySpark's docs make no mention of {{conf.isModifiable()}}, though it appear

[jira] [Updated] (SPARK-33434) Document spark.conf.isModifiable()

[ https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-33434: - Affects Version/s: 3.0.1 > Document spark.conf.isModifiable() >

[jira] [Commented] (SPARK-33432) SQL parser should use active SQLConf

[ https://issues.apache.org/jira/browse/SPARK-33432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230818#comment-17230818 ] Apache Spark commented on SPARK-33432: -- User 'luluorta' has created a pull request

[jira] [Assigned] (SPARK-33432) SQL parser should use active SQLConf

[ https://issues.apache.org/jira/browse/SPARK-33432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33432: Assignee: Apache Spark > SQL parser should use active SQLConf > -

[jira] [Assigned] (SPARK-33432) SQL parser should use active SQLConf

[ https://issues.apache.org/jira/browse/SPARK-33432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33432: Assignee: (was: Apache Spark) > SQL parser should use active SQLConf > --

[jira] [Commented] (SPARK-33394) Throw `NoSuchDatabaseException` for not existing namespace in DSv2 SHOW TABLES

[ https://issues.apache.org/jira/browse/SPARK-33394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230839#comment-17230839 ] Apache Spark commented on SPARK-33394: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33394) Throw `NoSuchDatabaseException` for not existing namespace in DSv2 SHOW TABLES

[ https://issues.apache.org/jira/browse/SPARK-33394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230840#comment-17230840 ] Apache Spark commented on SPARK-33394: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-33394) Throw `NoSuchDatabaseException` for not existing namespace in DSv2 SHOW TABLES

[ https://issues.apache.org/jira/browse/SPARK-33394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33394: Assignee: (was: Apache Spark) > Throw `NoSuchDatabaseException` for not existing name

[jira] [Assigned] (SPARK-33394) Throw `NoSuchDatabaseException` for not existing namespace in DSv2 SHOW TABLES

[ https://issues.apache.org/jira/browse/SPARK-33394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33394: Assignee: Apache Spark > Throw `NoSuchDatabaseException` for not existing namespace in DS

[jira] [Created] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

Chao Sun created SPARK-33435: Summary: DSv2: REFRESH TABLE should invalidate caches Key: SPARK-33435 URL: https://issues.apache.org/jira/browse/SPARK-33435 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230856#comment-17230856 ] Apache Spark commented on SPARK-33435: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33435: Assignee: (was: Apache Spark) > DSv2: REFRESH TABLE should invalidate caches > --

[jira] [Commented] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17230857#comment-17230857 ] Apache Spark commented on SPARK-33435: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33435: Assignee: Apache Spark > DSv2: REFRESH TABLE should invalidate caches > -

[jira] [Updated] (SPARK-33434) Document spark.conf.isModifiable()

[ https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-33434: - Affects Version/s: (was: 2.4.7) (was: 3.0.1)

[jira] [Created] (SPARK-33436) PySpark equivalent of SparkContext.hadoopConfiguration

Nicholas Chammas created SPARK-33436: Summary: PySpark equivalent of SparkContext.hadoopConfiguration Key: SPARK-33436 URL: https://issues.apache.org/jira/browse/SPARK-33436 Project: Spark

[jira] [Updated] (SPARK-33436) PySpark equivalent of SparkContext.hadoopConfiguration

[ https://issues.apache.org/jira/browse/SPARK-33436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-33436: - Description: PySpark should offer an API to {{hadoopConfiguration}} to [match Scala's|h

[jira] [Updated] (SPARK-33436) PySpark equivalent of SparkContext.hadoopConfiguration

[ https://issues.apache.org/jira/browse/SPARK-33436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-33436: - Description: PySpark should offer an API to {{hadoopConfiguration}} to [match Scala's|h

[jira] [Updated] (SPARK-33437) Support CACHE TABLE command in DSv2

[ https://issues.apache.org/jira/browse/SPARK-33437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33437: - Issue Type: New Feature (was: Improvement) > Support CACHE TABLE command in DSv2 >

[jira] [Created] (SPARK-33437) Support CACHE TABLE command in DSv2

Chao Sun created SPARK-33437: Summary: Support CACHE TABLE command in DSv2 Key: SPARK-33437 URL: https://issues.apache.org/jira/browse/SPARK-33437 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33332) Errors in running spark job on K8 with RPC Authentication Secret File properties

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231010#comment-17231010 ] Surbhi Aggarwal commented on SPARK-2: - Hey guys, I tried a temp fix, and it

[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33435: - Environment: (was: R) > DSv2: REFRESH TABLE should invalidate caches > -

[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33435: - Labels: DSv2 (was: ) > DSv2: REFRESH TABLE should invalidate caches > -

[jira] [Resolved] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33435. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30359 [https://

[jira] [Assigned] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33435: - Assignee: Chao Sun > DSv2: REFRESH TABLE should invalidate caches > ---

[jira] [Resolved] (SPARK-33259) Joining 3 streams results in incorrect output

[ https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33259. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30210 [https://

[jira] [Assigned] (SPARK-33259) Joining 3 streams results in incorrect output

[ https://issues.apache.org/jira/browse/SPARK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33259: - Assignee: L. C. Hsieh > Joining 3 streams results in incorrect output > ---

[jira] [Commented] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231046#comment-17231046 ] Apache Spark commented on SPARK-33435: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231047#comment-17231047 ] Apache Spark commented on SPARK-33435: -- User 'sunchao' has created a pull request f

[jira] [Updated] (SPARK-32314) [SHS] Remove old format of stacktrace in event log

[ https://issues.apache.org/jira/browse/SPARK-32314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-32314: - Summary: [SHS] Remove old format of stacktrace in event log (was: [SHS] Add config to control w

[jira] [Updated] (SPARK-32314) [SHS] Remove old format of stacktrace in event log

[ https://issues.apache.org/jira/browse/SPARK-32314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-32314: - Description: Currently, EventLoggingListeneer write both "Stack Trace" and "Full Stack Trace" i

[jira] [Commented] (SPARK-33339) Pyspark application will hang due to non Exception

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231079#comment-17231079 ] Apache Spark commented on SPARK-9: -- User 'li36909' has created a pull request f

[jira] [Updated] (SPARK-33435) DSv2: REFRESH TABLE should invalidate caches

[ https://issues.apache.org/jira/browse/SPARK-33435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33435: -- Fix Version/s: 3.0.2 > DSv2: REFRESH TABLE should invalidate caches >

[jira] [Updated] (SPARK-33432) SQL parser should use active SQLConf

[ https://issues.apache.org/jira/browse/SPARK-33432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33432: -- Description: In ANSI mode, schema string parsing should fail if the schema uses ANSI reserved keyword as attr

[jira] [Updated] (SPARK-33432) SQL parser should use active SQLConf

[ https://issues.apache.org/jira/browse/SPARK-33432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33432: -- Description: In ANSI mode, schema string parsing should fail if the schema uses ANSI reserved keyword as attr

[jira] [Created] (SPARK-33438) set -v couldn't dump all the conf entries

Linhong Liu created SPARK-33438: --- Summary: set -v couldn't dump all the conf entries Key: SPARK-33438 URL: https://issues.apache.org/jira/browse/SPARK-33438 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33339) Pyspark application will hang due to non Exception

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-9: -- Description: When a system.exit exception occurs during the process, the python worker exits

[jira] [Updated] (SPARK-33339) Pyspark application will hang due to non Exception

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-9: -- Description: When a system.exit exception occurs during the process, the python worker exits

[jira] [Commented] (SPARK-33139) protect setActiveSession and clearActiveSession

[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231112#comment-17231112 ] Apache Spark commented on SPARK-33139: -- User 'leanken' has created a pull request f

[jira] [Updated] (SPARK-33339) Pyspark application will hang due to non Exception

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-9: -- Fix Version/s: 2.4.8 > Pyspark application will hang due to non Exception > --

[jira] [Updated] (SPARK-33437) Support CACHE TABLE command in DSv2

[ https://issues.apache.org/jira/browse/SPARK-33437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33437: -- Affects Version/s: (was: 3.0.1) 3.1.0 > Support CACHE TABLE command

[jira] [Commented] (SPARK-33437) Support CACHE TABLE command in DSv2

[ https://issues.apache.org/jira/browse/SPARK-33437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231121#comment-17231121 ] Dongjoon Hyun commented on SPARK-33437: --- Since new feature cannot affect old relea

[jira] [Commented] (SPARK-33438) set -v couldn't dump all the conf entries

[ https://issues.apache.org/jira/browse/SPARK-33438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231131#comment-17231131 ] Apache Spark commented on SPARK-33438: -- User 'linhongliu-db' has created a pull req

[jira] [Assigned] (SPARK-33438) set -v couldn't dump all the conf entries

[ https://issues.apache.org/jira/browse/SPARK-33438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33438: Assignee: (was: Apache Spark) > set -v couldn't dump all the conf entries > -

[jira] [Assigned] (SPARK-33438) set -v couldn't dump all the conf entries

[ https://issues.apache.org/jira/browse/SPARK-33438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33438: Assignee: Apache Spark > set -v couldn't dump all the conf entries >

[jira] [Commented] (SPARK-33140) make all sub-class of Rule[QueryPlan] using SQLConf.get

[ https://issues.apache.org/jira/browse/SPARK-33140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231139#comment-17231139 ] Apache Spark commented on SPARK-33140: -- User 'leanken' has created a pull request f

[jira] [Created] (SPARK-33439) Use SERIAL_SBT_TESTS=1 for SQL module like Hive module

Dongjoon Hyun created SPARK-33439: - Summary: Use SERIAL_SBT_TESTS=1 for SQL module like Hive module Key: SPARK-33439 URL: https://issues.apache.org/jira/browse/SPARK-33439 Project: Spark Issu

[jira] [Commented] (SPARK-33439) Use SERIAL_SBT_TESTS=1 for SQL module like Hive module

[ https://issues.apache.org/jira/browse/SPARK-33439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231140#comment-17231140 ] Apache Spark commented on SPARK-33439: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-33439) Use SERIAL_SBT_TESTS=1 for SQL module like Hive module

[ https://issues.apache.org/jira/browse/SPARK-33439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33439: Assignee: (was: Apache Spark) > Use SERIAL_SBT_TESTS=1 for SQL module like Hive modul

[jira] [Assigned] (SPARK-33439) Use SERIAL_SBT_TESTS=1 for SQL module like Hive module

[ https://issues.apache.org/jira/browse/SPARK-33439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33439: Assignee: Apache Spark > Use SERIAL_SBT_TESTS=1 for SQL module like Hive module > ---

[jira] [Commented] (SPARK-33424) Doubts about the use of the "DiskBlockObjectWriter#revertPartialWritesAndClose" method in Spark Code

[ https://issues.apache.org/jira/browse/SPARK-33424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231145#comment-17231145 ] Hyukjin Kwon commented on SPARK-33424: -- [~LuciferYang], let's post a question to th

[jira] [Resolved] (SPARK-33424) Doubts about the use of the "DiskBlockObjectWriter#revertPartialWritesAndClose" method in Spark Code

[ https://issues.apache.org/jira/browse/SPARK-33424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33424. -- Resolution: Invalid > Doubts about the use of the > "DiskBlockObjectWriter#revertPartialWrite

[jira] [Created] (SPARK-33440) Spark schedules on updating delegation token with 0 interval under some token provider implementation

Jungtaek Lim created SPARK-33440: Summary: Spark schedules on updating delegation token with 0 interval under some token provider implementation Key: SPARK-33440 URL: https://issues.apache.org/jira/browse/SPARK-33

[jira] [Commented] (SPARK-33440) Spark schedules on updating delegation token with 0 interval under some token provider implementation

[ https://issues.apache.org/jira/browse/SPARK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231147#comment-17231147 ] Jungtaek Lim commented on SPARK-33440: -- I have a fix and now refining a bit. Will r

[jira] [Commented] (SPARK-33440) Spark schedules on updating delegation token with 0 interval under some token provider implementation

[ https://issues.apache.org/jira/browse/SPARK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231163#comment-17231163 ] Apache Spark commented on SPARK-33440: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-33440) Spark schedules on updating delegation token with 0 interval under some token provider implementation

[ https://issues.apache.org/jira/browse/SPARK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231164#comment-17231164 ] Apache Spark commented on SPARK-33440: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-33440) Spark schedules on updating delegation token with 0 interval under some token provider implementation

[ https://issues.apache.org/jira/browse/SPARK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33440: Assignee: (was: Apache Spark) > Spark schedules on updating delegation token with 0 i

[jira] [Assigned] (SPARK-33440) Spark schedules on updating delegation token with 0 interval under some token provider implementation

[ https://issues.apache.org/jira/browse/SPARK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33440: Assignee: Apache Spark > Spark schedules on updating delegation token with 0 interval und

[jira] [Resolved] (SPARK-33426) Unify Hive SHOW TABLES tests

[ https://issues.apache.org/jira/browse/SPARK-33426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33426. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30340 [https://gith

[jira] [Assigned] (SPARK-33426) Unify Hive SHOW TABLES tests

[ https://issues.apache.org/jira/browse/SPARK-33426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33426: --- Assignee: Maxim Gekk > Unify Hive SHOW TABLES tests > > >

[jira] [Assigned] (SPARK-33439) Use SERIAL_SBT_TESTS=1 for SQL module like Hive module

[ https://issues.apache.org/jira/browse/SPARK-33439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33439: - Assignee: Dongjoon Hyun > Use SERIAL_SBT_TESTS=1 for SQL module like Hive module >

[jira] [Resolved] (SPARK-33439) Use SERIAL_SBT_TESTS=1 for SQL module like Hive module

[ https://issues.apache.org/jira/browse/SPARK-33439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33439. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pul

[jira] [Created] (SPARK-33441) Add "unused-import" compile arg to scalac and remove all unused imports in Scala code

Yang Jie created SPARK-33441: Summary: Add "unused-import" compile arg to scalac and remove all unused imports in Scala code Key: SPARK-33441 URL: https://issues.apache.org/jira/browse/SPARK-33441 Projec

  1   2   >