[jira] [Commented] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098723#comment-17098723 ] Jungtaek Lim commented on SPARK-26385: -- [~rajeevkumar] Yes please raise a separate

[jira] [Resolved] (SPARK-31606) reduce the perf regression of vectorized parquet reader caused by datetime rebase

[ https://issues.apache.org/jira/browse/SPARK-31606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31606. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28406 [https://gi

[jira] [Resolved] (SPARK-31626) Port HIVE-10415: hive.start.cleanup.scratchdir configuration is not taking effect

[ https://issues.apache.org/jira/browse/SPARK-31626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31626. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28436 [https://gi

[jira] [Assigned] (SPARK-31626) Port HIVE-10415: hive.start.cleanup.scratchdir configuration is not taking effect

[ https://issues.apache.org/jira/browse/SPARK-31626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31626: Assignee: Yuming Wang > Port HIVE-10415: hive.start.cleanup.scratchdir configuration is n

[jira] [Resolved] (SPARK-31267) Flaky test: WholeStageCodegenSparkSubmitSuite.Generated code on driver should not embed platform-specific constant

[ https://issues.apache.org/jira/browse/SPARK-31267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31267. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed in https://github.com/apache/spark/pull/28

[jira] [Updated] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31633: -- Parent: SPARK-29194 Issue Type: Sub-task (was: Bug) > Upgrade SLF4J from 1.7.16 to 1.

[jira] [Updated] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31633: -- Description: SLF4J 1.7.23+ is required to enable `slf4j-log4j12` with MDC feature to run unde

[jira] [Created] (SPARK-31634) "show tables like" support for SQL wildcard characters (% and _)

Yuming Wang created SPARK-31634: --- Summary: "show tables like" support for SQL wildcard characters (% and _) Key: SPARK-31634 URL: https://issues.apache.org/jira/browse/SPARK-31634 Project: Spark

[jira] [Updated] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31633: -- Description: SLF4J 1.7.23+ is required to enable `slf4j-log4j12` with MDC feature to run unde

[jira] [Issue Comment Deleted] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31633: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue: htt

[jira] [Commented] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098654#comment-17098654 ] Apache Spark commented on SPARK-31633: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31633: Assignee: Apache Spark > Upgrade SLF4J from 1.7.16 to 1.7.30 > --

[jira] [Assigned] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31633: Assignee: (was: Apache Spark) > Upgrade SLF4J from 1.7.16 to 1.7.30 > ---

[jira] [Commented] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098653#comment-17098653 ] Apache Spark commented on SPARK-31633: -- User 'dongjoon-hyun' has created a pull req

[jira] [Comment Edited] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098651#comment-17098651 ] Rajeev Kumar edited comment on SPARK-26385 at 5/4/20, 4:44 AM: ---

[jira] [Created] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

Dongjoon Hyun created SPARK-31633: - Summary: Upgrade SLF4J from 1.7.16 to 1.7.30 Key: SPARK-31633 URL: https://issues.apache.org/jira/browse/SPARK-31633 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098651#comment-17098651 ] Rajeev Kumar commented on SPARK-26385: -- Sorry for coming late on this thread. I was

[jira] [Commented] (SPARK-31212) Failure of casting the '1000-02-29' string to the date type

[ https://issues.apache.org/jira/browse/SPARK-31212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098644#comment-17098644 ] Apache Spark commented on SPARK-31212: -- User 'tianshizz' has created a pull request

[jira] [Commented] (SPARK-31374) Returning complex types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-31374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098609#comment-17098609 ] Oleksii Kachaiev commented on SPARK-31374: -- [~hoeze] do you have an example of

[jira] [Assigned] (SPARK-31632) The ApplicationInfo in KVStore may be accessed before it's prepared

[ https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31632: Assignee: (was: Apache Spark) > The ApplicationInfo in KVStore may be accessed before

[jira] [Commented] (SPARK-31632) The ApplicationInfo in KVStore may be accessed before it's prepared

[ https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098590#comment-17098590 ] Apache Spark commented on SPARK-31632: -- User 'xccui' has created a pull request for

[jira] [Assigned] (SPARK-31632) The ApplicationInfo in KVStore may be accessed before it's prepared

[ https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31632: Assignee: Apache Spark > The ApplicationInfo in KVStore may be accessed before it's prepa

[jira] [Created] (SPARK-31632) The ApplicationInfo in KVStore may be accessed before it's prepared

Xingcan Cui created SPARK-31632: --- Summary: The ApplicationInfo in KVStore may be accessed before it's prepared Key: SPARK-31632 URL: https://issues.apache.org/jira/browse/SPARK-31632 Project: Spark

[jira] [Commented] (SPARK-31212) Failure of casting the '1000-02-29' string to the date type

[ https://issues.apache.org/jira/browse/SPARK-31212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098548#comment-17098548 ] Apache Spark commented on SPARK-31212: -- User 'tianshizz' has created a pull request

[jira] [Assigned] (SPARK-31212) Failure of casting the '1000-02-29' string to the date type

[ https://issues.apache.org/jira/browse/SPARK-31212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31212: Assignee: (was: Apache Spark) > Failure of casting the '1000-02-29' string to the dat

[jira] [Assigned] (SPARK-31212) Failure of casting the '1000-02-29' string to the date type

[ https://issues.apache.org/jira/browse/SPARK-31212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31212: Assignee: Apache Spark > Failure of casting the '1000-02-29' string to the date type > --

[jira] [Commented] (SPARK-31212) Failure of casting the '1000-02-29' string to the date type

[ https://issues.apache.org/jira/browse/SPARK-31212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098547#comment-17098547 ] Apache Spark commented on SPARK-31212: -- User 'tianshizz' has created a pull request

[jira] [Commented] (SPARK-31527) date add/subtract interval only allow those day precision in ansi mode

[ https://issues.apache.org/jira/browse/SPARK-31527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098531#comment-17098531 ] Apache Spark commented on SPARK-31527: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-31527) date add/subtract interval only allow those day precision in ansi mode

[ https://issues.apache.org/jira/browse/SPARK-31527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098530#comment-17098530 ] Apache Spark commented on SPARK-31527: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-31631) Fix test flakiness caused by MiniKdc which throws "address in use" BindException

[ https://issues.apache.org/jira/browse/SPARK-31631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31631: Assignee: Apache Spark > Fix test flakiness caused by MiniKdc which throws "address in us

[jira] [Assigned] (SPARK-31631) Fix test flakiness caused by MiniKdc which throws "address in use" BindException

[ https://issues.apache.org/jira/browse/SPARK-31631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31631: Assignee: (was: Apache Spark) > Fix test flakiness caused by MiniKdc which throws "ad

[jira] [Commented] (SPARK-31631) Fix test flakiness caused by MiniKdc which throws "address in use" BindException

[ https://issues.apache.org/jira/browse/SPARK-31631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098488#comment-17098488 ] Apache Spark commented on SPARK-31631: -- User 'yaooqinn' has created a pull request

[jira] [Created] (SPARK-31631) Fix test flakiness caused by MiniKdc which throws "address in use" BindException

Kent Yao created SPARK-31631: Summary: Fix test flakiness caused by MiniKdc which throws "address in use" BindException Key: SPARK-31631 URL: https://issues.apache.org/jira/browse/SPARK-31631 Project: Spa

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098459#comment-17098459 ] Guillaume Martres commented on SPARK-29292: --- Right, so ideally you'd change Se

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098448#comment-17098448 ] Sean R. Owen commented on SPARK-29292: -- I think the issue is that if you import sca

[jira] [Commented] (SPARK-31527) date add/subtract interval only allow those day precision in ansi mode

[ https://issues.apache.org/jira/browse/SPARK-31527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098436#comment-17098436 ] Apache Spark commented on SPARK-31527: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-31630) Skip timestamp rebasing after 1900-01-01

[ https://issues.apache.org/jira/browse/SPARK-31630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31630: Assignee: (was: Apache Spark) > Skip timestamp rebasing after 1900-01-01 > --

[jira] [Assigned] (SPARK-31630) Skip timestamp rebasing after 1900-01-01

[ https://issues.apache.org/jira/browse/SPARK-31630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31630: Assignee: Apache Spark > Skip timestamp rebasing after 1900-01-01 > -

[jira] [Commented] (SPARK-31630) Skip timestamp rebasing after 1900-01-01

[ https://issues.apache.org/jira/browse/SPARK-31630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098414#comment-17098414 ] Apache Spark commented on SPARK-31630: -- User 'MaxGekk' has created a pull request f

[jira] [Updated] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] appleyuchi updated SPARK-31629: --- Description: I have search the forum, SPARK-8365 mentioned the same issue in spark 1.4.0 SPARK-83

[jira] [Created] (SPARK-31630) Skip timestamp rebasing after 1900-01-01

Maxim Gekk created SPARK-31630: -- Summary: Skip timestamp rebasing after 1900-01-01 Key: SPARK-31630 URL: https://issues.apache.org/jira/browse/SPARK-31630 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] appleyuchi updated SPARK-31629: --- Environment: Ubuntu19.10   anaconda3-python3.6.10   scala 2.11.8   apache-hive-3.0.0-bin   h

[jira] [Created] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

appleyuchi created SPARK-31629: -- Summary: "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1 Key: SPARK-31629 URL: https://issues.apache.org/jira/browse/SPARK-31629

[jira] [Commented] (SPARK-31627) Font style of Spark SQL DAG-viz is broken in Chrome on macOS

[ https://issues.apache.org/jira/browse/SPARK-31627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098389#comment-17098389 ] Kousuke Saruta commented on SPARK-31627: Thanks [~hyukjin.kwon] . I'll close thi

[jira] [Resolved] (SPARK-31627) Font style of Spark SQL DAG-viz is broken in Chrome on macOS

[ https://issues.apache.org/jira/browse/SPARK-31627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-31627. Resolution: Won't Fix > Font style of Spark SQL DAG-viz is broken in Chrome on macOS > ---

[jira] [Resolved] (SPARK-31033) Support 'SHOW views' command

[ https://issues.apache.org/jira/browse/SPARK-31033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-31033. - Resolution: Duplicate > Support 'SHOW views' command > > >

[jira] [Commented] (SPARK-31527) date add/subtract interval only allow those day precision in ansi mode

[ https://issues.apache.org/jira/browse/SPARK-31527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098319#comment-17098319 ] Apache Spark commented on SPARK-31527: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-30119) Support pagination for spark streaming tab

[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098315#comment-17098315 ] Apache Spark commented on SPARK-30119: -- User 'iRakson' has created a pull request f

[jira] [Assigned] (SPARK-30119) Support pagination for spark streaming tab

[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30119: Assignee: (was: Apache Spark) > Support pagination for spark streaming tab > ---

[jira] [Assigned] (SPARK-30119) Support pagination for spark streaming tab

[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30119: Assignee: Apache Spark > Support pagination for spark streaming tab > --

[jira] [Commented] (SPARK-30119) Support pagination for spark streaming tab

[ https://issues.apache.org/jira/browse/SPARK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17098314#comment-17098314 ] Apache Spark commented on SPARK-30119: -- User 'iRakson' has created a pull request f