[jira] [Updated] (SPARK-30651) EXPLAIN EXTENDED does not show detail information for aggregate operators

2020-02-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-30651: Issue Type: Bug (was: Improvement) > EXPLAIN EXTENDED does not show detail information for aggregate

[jira] [Commented] (SPARK-30688) Spark SQL Unix Timestamp produces incorrect result with unix_timestamp UDF

2020-02-07 Thread Javier Fuentes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032825#comment-17032825 ] Javier Fuentes commented on SPARK-30688: - When using week based dates the year pattern should

[jira] [Commented] (SPARK-30756) `ThriftServerWithSparkContextSuite` fails always on spark-branch-3.0-test-sbt-hadoop-2.7-hive-2.3

2020-02-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032821#comment-17032821 ] Yuming Wang commented on SPARK-30756: - Hi [~shaneknapp] Do you have some special configuration? I

[jira] [Updated] (SPARK-23710) Upgrade the built-in Hive to 2.3.5 for hadoop-3.2

2020-02-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-23710: Fix Version/s: 3.0.0 > Upgrade the built-in Hive to 2.3.5 for hadoop-3.2 >

[jira] [Resolved] (SPARK-23710) Upgrade the built-in Hive to 2.3.5 for hadoop-3.2

2020-02-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-23710. - Resolution: Fixed > Upgrade the built-in Hive to 2.3.5 for hadoop-3.2 >

[jira] [Created] (SPARK-30757) Update the doc on TableCatalog.alterTable's behavior

2020-02-07 Thread Terry Kim (Jira)
Terry Kim created SPARK-30757: - Summary: Update the doc on TableCatalog.alterTable's behavior Key: SPARK-30757 URL: https://issues.apache.org/jira/browse/SPARK-30757 Project: Spark Issue Type:

[jira] [Reopened] (SPARK-24884) Implement regexp_extract_all

2020-02-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-24884: - > Implement regexp_extract_all > > > Key: SPARK-24884 >

[jira] [Assigned] (SPARK-30579) Document ORDER BY Clause of SELECT statement in SQL Reference.

2020-02-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-30579: --- Assignee: Dilip Biswal > Document ORDER BY Clause of SELECT statement in SQL Reference. >

[jira] [Resolved] (SPARK-30579) Document ORDER BY Clause of SELECT statement in SQL Reference.

2020-02-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-30579. - Fix Version/s: 3.0.0 Resolution: Fixed > Document ORDER BY Clause of SELECT statement in SQL

[jira] [Commented] (SPARK-21918) HiveClient shouldn't share Hive object between different thread

2020-02-07 Thread Chenhao Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032776#comment-17032776 ] Chenhao Wu commented on SPARK-21918: is this still in progress?? > HiveClient shouldn't share Hive

[jira] [Reopened] (SPARK-30659) LogisticRegression blockify input vectors

2020-02-07 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reopened SPARK-30659: -- need more tests on sparse datasets > LogisticRegression blockify input vectors >

[jira] [Reopened] (SPARK-30660) LinearRegression blockify input vectors

2020-02-07 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reopened SPARK-30660: -- need more tests on sparse datasets > LinearRegression blockify input vectors >

[jira] [Reopened] (SPARK-30642) LinearSVC blockify input vectors

2020-02-07 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reopened SPARK-30642: -- need more tests on sparse datasets > LinearSVC blockify input vectors >

[jira] [Created] (SPARK-30756) `ThriftServerWithSparkContextSuite` fails always on spark-branch-3.0-test-sbt-hadoop-2.7-hive-2.3

2020-02-07 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-30756: - Summary: `ThriftServerWithSparkContextSuite` fails always on spark-branch-3.0-test-sbt-hadoop-2.7-hive-2.3 Key: SPARK-30756 URL:

[jira] [Commented] (SPARK-30756) `ThriftServerWithSparkContextSuite` fails always on spark-branch-3.0-test-sbt-hadoop-2.7-hive-2.3

2020-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032744#comment-17032744 ] Dongjoon Hyun commented on SPARK-30756: --- Hi, [~yumwang]. Could you take a look please? >

[jira] [Resolved] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

2020-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27298. --- Fix Version/s: 2.4.4 Target Version/s: (was: 3.0.0) Resolution: Fixed

[jira] [Commented] (SPARK-27298) Dataset except operation gives different results(dataset count) on Spark 2.3.0 Windows and Spark 2.3.0 Linux environment

2020-02-07 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032740#comment-17032740 ] Dongjoon Hyun commented on SPARK-27298: --- [~ksunitha]. SPARK-26366 is backported to 2.4.1 and the

[jira] [Updated] (SPARK-30289) Partitioned by Nested Column for `InMemoryTable`

2020-02-07 Thread DB Tsai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-30289: Summary: Partitioned by Nested Column for `InMemoryTable` (was: DSv2 partitioning should not accept

[jira] [Commented] (SPARK-29292) Fix internal usages of mutable collection for Seq in 2.13

2020-02-07 Thread Guillaume Martres (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032671#comment-17032671 ] Guillaume Martres commented on SPARK-29292: --- > I can try updating my fork and pushing the

[jira] [Resolved] (SPARK-30753) Remove unnecessary changes in SPARK-30684

2020-02-07 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-30753. Resolution: Duplicate Close this one and make https://github.com/apache/spark/pull/27490

[jira] [Resolved] (SPARK-30752) Wrong result of to_utc_timestamp() on daylight saving day

2020-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30752. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27474

[jira] [Assigned] (SPARK-30752) Wrong result of to_utc_timestamp() on daylight saving day

2020-02-07 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30752: --- Assignee: Maxim Gekk > Wrong result of to_utc_timestamp() on daylight saving day >

[jira] [Assigned] (SPARK-30747) Update roxygen2 to 7.0.1

2020-02-07 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Knapp reassigned SPARK-30747: --- Assignee: Shane Knapp > Update roxygen2 to 7.0.1 > > >

[jira] [Created] (SPARK-30755) Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-07 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-30755: --- Summary: Support Hive 1.2.1's Serde after making built-in Hive to 2.3 Key: SPARK-30755 URL: https://issues.apache.org/jira/browse/SPARK-30755 Project: Spark

[jira] [Created] (SPARK-30754) Reuse results of floorDiv in calculations of floorMod in DateTimeUtils

2020-02-07 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-30754: -- Summary: Reuse results of floorDiv in calculations of floorMod in DateTimeUtils Key: SPARK-30754 URL: https://issues.apache.org/jira/browse/SPARK-30754 Project: Spark

[jira] [Created] (SPARK-30753) Remove unnecessary changes in SPARK-30684

2020-02-07 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-30753: -- Summary: Remove unnecessary changes in SPARK-30684 Key: SPARK-30753 URL: https://issues.apache.org/jira/browse/SPARK-30753 Project: Spark Issue Type: