[jira] [Commented] (SPARK-33616) Join queries across different datasources (hive and hive)

2020-12-13 Thread Fang Wen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248782#comment-17248782 ] Fang Wen commented on SPARK-33616: -- amazing!l will study it carefully > Join queries a

[jira] [Commented] (SPARK-33616) Join queries across different datasources (hive and hive)

2020-12-13 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248776#comment-17248776 ] angerszhu commented on SPARK-33616: --- [~fang666] Hi, we meet similar situation and I ha

[jira] [Commented] (SPARK-33770) Test failures: ALTER TABLE .. DROP PARTITION tries to delete files out of partition path

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248774#comment-17248774 ] Apache Spark commented on SPARK-33770: -- User 'MaxGekk' has created a pull request f

[jira] [Updated] (SPARK-32007) Spark Driver Supervise does not work reliably

2020-12-13 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-32007: Priority: Major (was: Critical) > Spark Driver Supervise does not work reliably > ---

[jira] [Commented] (SPARK-33769) improve the next-day function of the sql component to deal with Column type

2020-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248751#comment-17248751 ] Hyukjin Kwon commented on SPARK-33769: -- Please go ahead and add an overridden versi

[jira] [Updated] (SPARK-33761) [k8s] Support fetching driver and executor pod templates from HCFS

2020-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33761: - Priority: Major (was: Critical) > [k8s] Support fetching driver and executor pod templates from

[jira] [Commented] (SPARK-33734) Spark Core ::Spark core versions upto 3.0.1 using interdependency on Jackson-core-asl version 1.9.13, which is having security issues reported.

2020-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248747#comment-17248747 ] Hyukjin Kwon commented on SPARK-33734: -- Which security issue do you refer then? >

[jira] [Assigned] (SPARK-33705) Three cases always fail in hive-thriftserver module

2020-12-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33705: --- Assignee: Kent Yao (was: Yang Jie) > Three cases always fail in hive-thriftserver module >

[jira] [Resolved] (SPARK-33705) Three cases always fail in hive-thriftserver module

2020-12-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33705. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30643 [https://gith

[jira] [Assigned] (SPARK-33705) Three cases always fail in hive-thriftserver module

2020-12-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33705: --- Assignee: Yang Jie > Three cases always fail in hive-thriftserver module >

[jira] [Commented] (SPARK-33679) Enable spark.sql.adaptive.enabled true by default

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248740#comment-17248740 ] Apache Spark commented on SPARK-33679: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-33679) Enable spark.sql.adaptive.enabled true by default

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248741#comment-17248741 ] Apache Spark commented on SPARK-33679: -- User 'sarutak' has created a pull request f

[jira] [Updated] (SPARK-33771) Fix Invalid value for HourOfAmPm when testing on JDK 14

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33771: -- Parent: SPARK-33772 Issue Type: Sub-task (was: Improvement) > Fix Invalid value for H

[jira] [Commented] (SPARK-33772) Build and Run Spark on JDK17

2020-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248710#comment-17248710 ] Hyukjin Kwon commented on SPARK-33772: -- Nice, thanks [~dongjoon]. > Build and Run

[jira] [Created] (SPARK-33772) Build and Run Spark on JDK17

2020-12-13 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33772: - Summary: Build and Run Spark on JDK17 Key: SPARK-33772 URL: https://issues.apache.org/jira/browse/SPARK-33772 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-33273) Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

2020-12-13 Thread huangtianhua (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248707#comment-17248707 ] huangtianhua commented on SPARK-33273: -- Test scalar-subquery-select.sql is failed o

[jira] [Resolved] (SPARK-33723) ANSI mode: Casting string to date should throw exception on parse error

2020-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33723. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30687 [https://gi

[jira] [Assigned] (SPARK-33771) Fix Invalid value for HourOfAmPm when testing on JDK 14

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33771: Assignee: (was: Apache Spark) > Fix Invalid value for HourOfAmPm when testing on JDK

[jira] [Assigned] (SPARK-33771) Fix Invalid value for HourOfAmPm when testing on JDK 14

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33771: Assignee: Apache Spark > Fix Invalid value for HourOfAmPm when testing on JDK 14 > --

[jira] [Commented] (SPARK-33771) Fix Invalid value for HourOfAmPm when testing on JDK 14

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248705#comment-17248705 ] Apache Spark commented on SPARK-33771: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-33771) Fix Invalid value for HourOfAmPm when testing on JDK 14

2020-12-13 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33771: --- Summary: Fix Invalid value for HourOfAmPm when testing on JDK 14 Key: SPARK-33771 URL: https://issues.apache.org/jira/browse/SPARK-33771 Project: Spark Issue T

[jira] [Commented] (SPARK-33757) Fix the R dependencies build error on GitHub Actions and AppVeyor

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248701#comment-17248701 ] Apache Spark commented on SPARK-33757: -- User 'sarutak' has created a pull request f

[jira] [Resolved] (SPARK-33690) Escape meta-characters in showString

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33690. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30647 [https://

[jira] [Assigned] (SPARK-33690) Escape meta-characters in showString

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33690: - Assignee: Takeshi Yamamuro > Escape meta-characters in showString > ---

[jira] [Updated] (SPARK-33764) Make state store maintenance interval as SQL config

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33764: -- Priority: Minor (was: Major) > Make state store maintenance interval as SQL config >

[jira] [Resolved] (SPARK-33764) Make state store maintenance interval as SQL config

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33764. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30741 [https://

[jira] [Updated] (SPARK-33764) Make state store maintenance interval as SQL config

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33764: -- Affects Version/s: (was: 3.2.0) 3.1.0 > Make state store maintenanc

[jira] [Assigned] (SPARK-33766) Upgrade Jackson to 2.11.4

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33766: - Assignee: Yuming Wang > Upgrade Jackson to 2.11.4 > - > >

[jira] [Resolved] (SPARK-33766) Upgrade Jackson to 2.11.4

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33766. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30746 [https://

[jira] [Resolved] (SPARK-33762) Bump commons-codec to latest version.

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33762. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30740 [https://

[jira] [Assigned] (SPARK-33762) Bump commons-codec to latest version.

2020-12-13 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33762: - Assignee: Nicholas Marion > Bump commons-codec to latest version. > --

[jira] [Updated] (SPARK-33725) Upgrade snappy-java to 1.1.8.2

2020-12-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-33725: Fix Version/s: 3.0.2 > Upgrade snappy-java to 1.1.8.2 > -- > >

[jira] [Commented] (SPARK-33770) Test failures: ALTER TABLE .. DROP PARTITION tries to delete files out of partition path

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248605#comment-17248605 ] Apache Spark commented on SPARK-33770: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33770) Test failures: ALTER TABLE .. DROP PARTITION tries to delete files out of partition path

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248604#comment-17248604 ] Apache Spark commented on SPARK-33770: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-33770) Test failures: ALTER TABLE .. DROP PARTITION tries to delete files out of partition path

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33770: Assignee: Apache Spark > Test failures: ALTER TABLE .. DROP PARTITION tries to delete fil

[jira] [Assigned] (SPARK-33770) Test failures: ALTER TABLE .. DROP PARTITION tries to delete files out of partition path

2020-12-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33770: Assignee: (was: Apache Spark) > Test failures: ALTER TABLE .. DROP PARTITION tries to

[jira] [Created] (SPARK-33770) Test failures: ALTER TABLE .. DROP PARTITION tries to delete files out of partition path

2020-12-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33770: -- Summary: Test failures: ALTER TABLE .. DROP PARTITION tries to delete files out of partition path Key: SPARK-33770 URL: https://issues.apache.org/jira/browse/SPARK-33770

[jira] [Created] (SPARK-33769) improve the next-day function of the sql component to deal with Column type

2020-12-13 Thread Chongguang LIU (Jira)
Chongguang LIU created SPARK-33769: -- Summary: improve the next-day function of the sql component to deal with Column type Key: SPARK-33769 URL: https://issues.apache.org/jira/browse/SPARK-33769 Proje

[jira] [Commented] (SPARK-33744) Canonicalization error in SortAggregate

2020-12-13 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248574#comment-17248574 ] Pablo Langa Blanco commented on SPARK-33744: I have seen the problem, but I

[jira] [Commented] (SPARK-33635) Performance regression in Kafka read

2020-12-13 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248550#comment-17248550 ] Gabor Somogyi commented on SPARK-33635: --- {quote}The collect in this test case is o

[jira] [Commented] (SPARK-33635) Performance regression in Kafka read

2020-12-13 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248549#comment-17248549 ] Gabor Somogyi commented on SPARK-33635: --- Mixed up with DStreams, in Strutured Stre