[jira] [Created] (SPARK-34024) datasourceV1 VS dataSourceV2

Zhenglin luo created SPARK-34024: Summary: datasourceV1 VS dataSourceV2 Key: SPARK-34024 URL: https://issues.apache.org/jira/browse/SPARK-34024 Project: Spark Issue Type: Question

[jira] [Assigned] (SPARK-34023) Updated to Kryo 5.0.3

[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34023: Assignee: (was: Apache Spark) > Updated to Kryo 5.0.3 > - > >

[jira] [Assigned] (SPARK-34023) Updated to Kryo 5.0.3

[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34023: Assignee: Apache Spark > Updated to Kryo 5.0.3 > - > >

[jira] [Commented] (SPARK-34023) Updated to Kryo 5.0.3

[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259469#comment-17259469 ] Apache Spark commented on SPARK-34023: -- User 'nicknezis' has created a pull request for this issue:

[jira] [Commented] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259468#comment-17259468 ] Apache Spark commented on SPARK-34011: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-34023) Updated to Kryo 5.0.3

[ https://issues.apache.org/jira/browse/SPARK-34023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34023: -- Reporter: Nick Nezis (was: Dongjoon Hyun) > Updated to Kryo 5.0.3 > - >

[jira] [Created] (SPARK-34023) Updated to Kryo 5.0.3

Dongjoon Hyun created SPARK-34023: - Summary: Updated to Kryo 5.0.3 Key: SPARK-34023 URL: https://issues.apache.org/jira/browse/SPARK-34023 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34022) Support latest mkdocs in SQL functions doc

[ https://issues.apache.org/jira/browse/SPARK-34022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34022: - Description: The list on the sidebar does not show the list of functions. > Support latest

[jira] [Updated] (SPARK-34022) Support latest mkdocs in SQL functions doc

[ https://issues.apache.org/jira/browse/SPARK-34022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34022: - Attachment: Screen Shot 2021-01-06 at 4.22.50 PM.png > Support latest mkdocs in SQL functions

[jira] [Created] (SPARK-34022) Support latest mkdocs in SQL functions doc

Hyukjin Kwon created SPARK-34022: Summary: Support latest mkdocs in SQL functions doc Key: SPARK-34022 URL: https://issues.apache.org/jira/browse/SPARK-34022 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33948. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 31055

[jira] [Assigned] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33948: - Assignee: Yang Jie > ExpressionEncoderSuite failed in >

[jira] [Commented] (SPARK-33966) Two-tier encryption key management

[ https://issues.apache.org/jira/browse/SPARK-33966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259454#comment-17259454 ] DB Tsai commented on SPARK-33966: - cc [~dongjoon] [~chaosun] and [~viirya] > Two-tier encryption key

[jira] [Commented] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259446#comment-17259446 ] Jungtaek Lim commented on SPARK-33635: -- One more point, though the root cause is actually the

[jira] [Updated] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33635: -- Target Version/s: 3.0.2, 3.1.0 > Performance regression in Kafka read >

[jira] [Resolved] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33635. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33635: - Assignee: Jungtaek Lim > Performance regression in Kafka read >

[jira] [Commented] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259432#comment-17259432 ] Apache Spark commented on SPARK-34021: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34021: Assignee: (was: Apache Spark) > Fix hyper links in SparkR documentation for CRAN

[jira] [Assigned] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34021: Assignee: Apache Spark > Fix hyper links in SparkR documentation for CRAN submission >

[jira] [Commented] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259430#comment-17259430 ] Apache Spark commented on SPARK-34021: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-34008) Upgrade derby to 10.14.2.0

[ https://issues.apache.org/jira/browse/SPARK-34008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34008. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31032

[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] Maple edited comment on SPARK-33981 at 1/6/21, 5:48 AM: I know what's the

[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] Maple edited comment on SPARK-33981 at 1/6/21, 5:33 AM: I know what's the

[jira] [Commented] (SPARK-34017) Pass json column information via pruneColumns()

[ https://issues.apache.org/jira/browse/SPARK-34017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259423#comment-17259423 ] Ted Yu commented on SPARK-34017: For PushDownUtils#pruneColumns, I am experimenting with the following:

[jira] [Updated] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-33981: -- Attachment: (was: image-2021-01-06-11-20-49-804.png) > SparkUI: Storage page is empty even if cached >

[jira] [Updated] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-33981: -- Attachment: (was: screenshot-1.png) > SparkUI: Storage page is empty even if cached >

[jira] [Updated] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maple updated SPARK-33981: -- Attachment: (was: image-2021-01-06-11-19-09-849.png) > SparkUI: Storage page is empty even if cached >

[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] Maple edited comment on SPARK-33981 at 1/6/21, 5:31 AM: I know what's the

[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] Maple edited comment on SPARK-33981 at 1/6/21, 5:30 AM: I know what's the

[jira] [Updated] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34021: - Target Version/s: 3.1.0 > Fix hyper links in SparkR documentation for CRAN submission >

[jira] [Updated] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

[ https://issues.apache.org/jira/browse/SPARK-34021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34021: - Priority: Blocker (was: Critical) > Fix hyper links in SparkR documentation for CRAN

[jira] [Resolved] (SPARK-34020) IndexOutOfBoundsException on merge of two pyspark frames

[ https://issues.apache.org/jira/browse/SPARK-34020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darshat resolved SPARK-34020. - Resolution: Invalid The call stack pointed to an issue with apply, not the join. I think this may be

[jira] [Created] (SPARK-34021) Fix hyper links in SparkR documentation for CRAN submission

Hyukjin Kwon created SPARK-34021: Summary: Fix hyper links in SparkR documentation for CRAN submission Key: SPARK-34021 URL: https://issues.apache.org/jira/browse/SPARK-34021 Project: Spark

[jira] [Commented] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259415#comment-17259415 ] Apache Spark commented on SPARK-33029: -- User 'baohe-zhang' has created a pull request for this

[jira] [Updated] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-33635: - Priority: Blocker (was: Major) > Performance regression in Kafka read >

[jira] [Resolved] (SPARK-34004) Change FrameLessOffsetWindowFunction as sealed abstract class

[ https://issues.apache.org/jira/browse/SPARK-34004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34004. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31026

[jira] [Assigned] (SPARK-34004) Change FrameLessOffsetWindowFunction as sealed abstract class

[ https://issues.apache.org/jira/browse/SPARK-34004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34004: - Assignee: jiaan.geng > Change FrameLessOffsetWindowFunction as sealed abstract class >

[jira] [Assigned] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33635: Assignee: Apache Spark > Performance regression in Kafka read >

[jira] [Assigned] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33635: Assignee: (was: Apache Spark) > Performance regression in Kafka read >

[jira] [Commented] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259407#comment-17259407 ] Apache Spark commented on SPARK-33635: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259406#comment-17259406 ] Apache Spark commented on SPARK-33948: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-33100) Support parse the sql statements with c-style comments

[ https://issues.apache.org/jira/browse/SPARK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259405#comment-17259405 ] Apache Spark commented on SPARK-33100: -- User 'turboFei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33948: Assignee: Apache Spark > ExpressionEncoderSuite failed in >

[jira] [Commented] (SPARK-33100) Support parse the sql statements with c-style comments

[ https://issues.apache.org/jira/browse/SPARK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259404#comment-17259404 ] Apache Spark commented on SPARK-33100: -- User 'turboFei' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33948: Assignee: (was: Apache Spark) > ExpressionEncoderSuite failed in >

[jira] [Commented] (SPARK-33948) ExpressionEncoderSuite failed in spark-branch-3.1-test-maven-hadoop-*-jdk-*-scala-2.13

[ https://issues.apache.org/jira/browse/SPARK-33948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259403#comment-17259403 ] Apache Spark commented on SPARK-33948: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-34020) IndexOutOfBoundsException on merge of two pyspark frames

[ https://issues.apache.org/jira/browse/SPARK-34020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darshat updated SPARK-34020: Description: We are using databricks on Azure, with Apache spack 3.0.0 and Scala 2.12. When two tables

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259401#comment-17259401 ] Apache Spark commented on SPARK-32165: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259400#comment-17259400 ] Apache Spark commented on SPARK-32165: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32165: Assignee: Apache Spark > SessionState leaks SparkListener with multiple SparkSession >

[jira] [Assigned] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32165: Assignee: (was: Apache Spark) > SessionState leaks SparkListener with multiple

[jira] [Comment Edited] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259399#comment-17259399 ] Jungtaek Lim edited comment on SPARK-33635 at 1/6/21, 4:18 AM: --- I've spent

[jira] [Updated] (SPARK-34020) IndexOutOfBoundsException on merge of two pyspark frames

[ https://issues.apache.org/jira/browse/SPARK-34020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darshat updated SPARK-34020: Affects Version/s: (was: 3.0.1) 3.0.0 > IndexOutOfBoundsException on merge of

[jira] [Created] (SPARK-34020) IndexOutOfBoundsException on merge of two pyspark frames

Darshat created SPARK-34020: --- Summary: IndexOutOfBoundsException on merge of two pyspark frames Key: SPARK-34020 URL: https://issues.apache.org/jira/browse/SPARK-34020 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33635) Performance regression in Kafka read

[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259399#comment-17259399 ] Jungtaek Lim commented on SPARK-33635: -- I've spent some time to trace the issue, and noticed

[jira] [Assigned] (SPARK-33541) Group exception messages in catalyst/expressions

[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33541: Assignee: Apache Spark > Group exception messages in catalyst/expressions >

[jira] [Assigned] (SPARK-33541) Group exception messages in catalyst/expressions

[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33541: Assignee: (was: Apache Spark) > Group exception messages in catalyst/expressions >

[jira] [Commented] (SPARK-33541) Group exception messages in catalyst/expressions

[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259398#comment-17259398 ] Apache Spark commented on SPARK-33541: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259395#comment-17259395 ] Apache Spark commented on SPARK-32685: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259394#comment-17259394 ] Apache Spark commented on SPARK-32685: -- User 'AngersZh' has created a pull request for this

[jira] [Resolved] (SPARK-33982) Sparksql does not support when the inserted table is a read table

[ https://issues.apache.org/jira/browse/SPARK-33982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33982. -- Resolution: Duplicate > Sparksql does not support when the inserted table is a read table >

[jira] [Commented] (SPARK-33982) Sparksql does not support when the inserted table is a read table

[ https://issues.apache.org/jira/browse/SPARK-33982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259391#comment-17259391 ] hao commented on SPARK-33982: - [~hyukjin.kwon] 小哥，能看懂中文的呀！是的这是同一个问题>.< > Sparksql does not support when the

[jira] [Comment Edited] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] maple edited comment on SPARK-33981 at 1/6/21, 3:20 AM: I try in Spark 2.4.7,it

[jira] [Commented] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259377#comment-17259377 ] maple commented on SPARK-33981: --- I try in Spark 2.4.7,it still exists.

[jira] [Updated] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maple updated SPARK-33981: -- Attachment: image-2021-01-06-11-19-09-849.png > SparkUI: Storage page is empty even if cached >

[jira] [Updated] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maple updated SPARK-33981: -- Attachment: screenshot-1.png > SparkUI: Storage page is empty even if cached >

[jira] [Resolved] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33029. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30954

[jira] [Assigned] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33029: - Assignee: Baohe Zhang > Standalone mode blacklist executors page UI marks driver as

[jira] [Resolved] (SPARK-33986) Spark handle always return LOST status in standalone cluster mode with Spark launcher

[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33986. -- Resolution: Invalid > Spark handle always return LOST status in standalone cluster mode with

[jira] [Commented] (SPARK-33986) Spark handle always return LOST status in standalone cluster mode with Spark launcher

[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259370#comment-17259370 ] Hyukjin Kwon commented on SPARK-33986: -- Then it sounds likely a env problem. For a question, I

[jira] [Commented] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259369#comment-17259369 ] Apache Spark commented on SPARK-34012: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259368#comment-17259368 ] Apache Spark commented on SPARK-34012: -- User 'AngersZh' has created a pull request for this

[jira] [Resolved] (SPARK-34015) SparkR partition timing summary reports input time correctly

[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34015. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/31021 > SparkR partition

[jira] [Assigned] (SPARK-34015) SparkR partition timing summary reports input time correctly

[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34015: Assignee: Tom Howland > SparkR partition timing summary reports input time correctly >

[jira] [Updated] (SPARK-34015) SparkR partition timing summary reports input time correctly

[ https://issues.apache.org/jira/browse/SPARK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34015: - Fix Version/s: 3.1.1 3.2.0 > SparkR partition timing summary reports input

[jira] [Updated] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34011: - Fix Version/s: 3.2.0 > ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache >

[jira] [Resolved] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34011. -- Resolution: Fixed > ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache >

[jira] [Updated] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34011: - Fix Version/s: (was: 3.2.0) (was: 3.0.2) (was:

[jira] [Commented] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259355#comment-17259355 ] Apache Spark commented on SPARK-34012: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-34002) Broken UDF Encoding

[ https://issues.apache.org/jira/browse/SPARK-34002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34002: - Component/s: (was: Spark Core) SQL > Broken UDF Encoding >

[jira] [Issue Comment Deleted] (SPARK-33986) Spark handle always return LOST status in standalone cluster mode with Spark launcher

[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhongyuWang updated SPARK-33986: Comment: was deleted (was: Yes, other applications have the same scenario(in cluster mode, after

[jira] [Commented] (SPARK-33986) Spark handle always return LOST status in standalone cluster mode with Spark launcher

[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259348#comment-17259348 ] ZhongyuWang commented on SPARK-33986: - Yes, other applications have the same scenario(in cluster

[jira] [Commented] (SPARK-33986) Spark handle always return LOST status in standalone cluster mode with Spark launcher

[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259346#comment-17259346 ] ZhongyuWang commented on SPARK-33986: - Yes, other applications have the same scenario(in cluster

[jira] [Commented] (SPARK-34019) Keep same quantiles of UI and restful API

[ https://issues.apache.org/jira/browse/SPARK-34019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259344#comment-17259344 ] Apache Spark commented on SPARK-34019: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34019) Keep same quantiles of UI and restful API

[ https://issues.apache.org/jira/browse/SPARK-34019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34019: Assignee: (was: Apache Spark) > Keep same quantiles of UI and restful API >

[jira] [Commented] (SPARK-34019) Keep same quantiles of UI and restful API

[ https://issues.apache.org/jira/browse/SPARK-34019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259343#comment-17259343 ] Apache Spark commented on SPARK-34019: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34019) Keep same quantiles of UI and restful API

[ https://issues.apache.org/jira/browse/SPARK-34019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34019: Assignee: Apache Spark > Keep same quantiles of UI and restful API >

[jira] [Created] (SPARK-34019) Keep same quantiles of UI and restful API

angerszhu created SPARK-34019: - Summary: Keep same quantiles of UI and restful API Key: SPARK-34019 URL: https://issues.apache.org/jira/browse/SPARK-34019 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33986) Spark handle always return LOST status in standalone cluster mode with Spark launcher

[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259338#comment-17259338 ] Hyukjin Kwon commented on SPARK-33986: -- Do other applications work fine in cluster modes? > Spark

[jira] [Updated] (SPARK-34002) Broken UDF Encoding

[ https://issues.apache.org/jira/browse/SPARK-34002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34002: - Priority: Major (was: Critical) > Broken UDF Encoding > --- > >

[jira] [Commented] (SPARK-33981) SparkUI: Storage page is empty even if cached

[ https://issues.apache.org/jira/browse/SPARK-33981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259336#comment-17259336 ] Hyukjin Kwon commented on SPARK-33981: -- [~995582386], Spark 2.3.3 is EOL. Can you see if the issue

[jira] [Commented] (SPARK-33982) Sparksql does not support when the inserted table is a read table

[ https://issues.apache.org/jira/browse/SPARK-33982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259335#comment-17259335 ] Hyukjin Kwon commented on SPARK-33982: -- [~hao.duan] how is it different from SPARK-34006? >

[jira] [Commented] (SPARK-34016) SparkR not on CRAN (again)

[ https://issues.apache.org/jira/browse/SPARK-34016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259334#comment-17259334 ] Hyukjin Kwon commented on SPARK-34016: -- cc [~dongjoon], [~felixcheung], [~shivaram] FYI > SparkR

[jira] [Created] (SPARK-34018) finishedExecutorWithRunningSidecar in test utils depends on nulls matching

Holden Karau created SPARK-34018: Summary: finishedExecutorWithRunningSidecar in test utils depends on nulls matching Key: SPARK-34018 URL: https://issues.apache.org/jira/browse/SPARK-34018 Project:

[jira] [Updated] (SPARK-33935) Fix CBOs cost function

[ https://issues.apache.org/jira/browse/SPARK-33935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33935: - Fix Version/s: 2.4.8 > Fix CBOs cost function > --- > >

[jira] [Resolved] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-34012. -- Fix Version/s: 3.2.0 3.1.0 Assignee: angerszhu

[jira] [Updated] (SPARK-34012) Keep behavior consistent when conf `spark.sql.legacy.parser.havingWithoutGroupByAsWhere` is true with migration guide

[ https://issues.apache.org/jira/browse/SPARK-34012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-34012: - Affects Version/s: 3.1.0 3.0.2 2.4.8 >

[jira] [Commented] (SPARK-33833) Allow Spark Structured Streaming report Kafka Lag through Burrow

[ https://issues.apache.org/jira/browse/SPARK-33833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259280#comment-17259280 ] L. C. Hsieh commented on SPARK-33833: - Thanks [~kabhwan]. > Allow Spark Structured Streaming

[jira] [Commented] (SPARK-33833) Allow Spark Structured Streaming report Kafka Lag through Burrow

[ https://issues.apache.org/jira/browse/SPARK-33833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17259263#comment-17259263 ] Jungtaek Lim commented on SPARK-33833: -- (Just to make clear, I was talking about setting the group

  1   2   >