[jira] [Created] (SPARK-29939) Add a conf for CompressionCodec for Ser/Deser of MapOutputStatus

2019-11-17 Thread Xiao Li (Jira)
Xiao Li created SPARK-29939: --- Summary: Add a conf for CompressionCodec for Ser/Deser of MapOutputStatus Key: SPARK-29939 URL: https://issues.apache.org/jira/browse/SPARK-29939 Project: Spark

[jira] [Created] (SPARK-29883) Improve error messages when function name is an alias

2019-11-13 Thread Xiao Li (Jira)
Xiao Li created SPARK-29883: --- Summary: Improve error messages when function name is an alias Key: SPARK-29883 URL: https://issues.apache.org/jira/browse/SPARK-29883 Project: Spark Issue Type:

[jira] [Updated] (SPARK-29396) Extend Spark plugin interface to driver

2019-11-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29396: Labels: release-notes (was: ) > Extend Spark plugin interface to driver >

[jira] [Updated] (SPARK-28091) Extend Spark metrics system with user-defined metrics using executor plugins

2019-11-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28091: Labels: release-notes (was: ) > Extend Spark metrics system with user-defined metrics using executor

[jira] [Resolved] (SPARK-29759) LocalShuffleReaderExec.outputPartitioning should use the corrected attributes

2019-11-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29759. - Fix Version/s: 3.0.0 Resolution: Fixed > LocalShuffleReaderExec.outputPartitioning should use

[jira] [Resolved] (SPARK-29752) make AdaptiveQueryExecSuite more robust

2019-11-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29752. - Fix Version/s: 3.0.0 Resolution: Fixed > make AdaptiveQueryExecSuite more robust >

[jira] [Updated] (SPARK-29768) nondeterministic expression fails column pruning

2019-11-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29768: Fix Version/s: (was: 3.0.0) Target Version/s: 3.0.0 > nondeterministic expression fails column

[jira] [Updated] (SPARK-29768) nondeterministic expression fails column pruning

2019-11-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29768: Fix Version/s: 3.0.0 > nondeterministic expression fails column pruning >

[jira] [Assigned] (SPARK-29768) nondeterministic expression fails column pruning

2019-11-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-29768: --- Assignee: Wenchen Fan > nondeterministic expression fails column pruning >

[jira] [Updated] (SPARK-29743) sample should set needCopyResult to true if its child is

2019-11-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29743: Priority: Blocker (was: Major) > sample should set needCopyResult to true if its child is >

[jira] [Updated] (SPARK-29743) sample should set needCopyResult to true if its child is

2019-11-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29743: Affects Version/s: (was: 2.4.0) 2.3.4 2.4.4 > sample

[jira] [Updated] (SPARK-29449) Add tooltip to Spark WebUI

2019-10-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29449: Description: The initial effort was made in  https://issues.apache.org/jira/browse/SPARK-2384. This

[jira] [Updated] (SPARK-29019) Improve tooltip information in JDBC/ODBC Server tab

2019-10-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29019: Parent: SPARK-29449 Issue Type: Sub-task (was: Improvement) > Improve tooltip information in

[jira] [Updated] (SPARK-29323) Add tooltip for The Executors Tab's column names in the Spark history server Page

2019-10-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29323: Parent: SPARK-29449 Issue Type: Sub-task (was: Improvement) > Add tooltip for The Executors

[jira] [Created] (SPARK-29449) Add tooltip to Spark WebUI

2019-10-12 Thread Xiao Li (Jira)
Xiao Li created SPARK-29449: --- Summary: Add tooltip to Spark WebUI Key: SPARK-29449 URL: https://issues.apache.org/jira/browse/SPARK-29449 Project: Spark Issue Type: Umbrella Components:

[jira] [Updated] (SPARK-27986) Support Aggregate Expressions with filter

2019-10-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27986: Target Version/s: 3.0.0 > Support Aggregate Expressions with filter >

[jira] [Commented] (SPARK-27986) Support Aggregate Expressions with filter

2019-10-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947822#comment-16947822 ] Xiao Li commented on SPARK-27986: - There is a blog to describe this feature too. 

[jira] [Commented] (SPARK-27986) Support Aggregate Expressions with filter

2019-10-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947816#comment-16947816 ] Xiao Li commented on SPARK-27986: - cc [~beliefer] > Support Aggregate Expressions with filter >

[jira] [Resolved] (SPARK-29366) Subqueries created for DPP are not printed in EXPLAIN FORMATTED

2019-10-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29366. - Fix Version/s: 3.0.0 Assignee: Dilip Biswal Resolution: Fixed > Subqueries created for

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Labels: release-notes (was: ) > Dynamic partition pruning > - > >

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Description: Implements dynamic partition pruning by adding a dynamic-partition-pruning filter if there

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Description: Implements dynamic partition pruning by adding a dynamic-partition-pruning filter if there

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Attachment: image-2019-10-04-11-20-02-616.png > Dynamic partition pruning > - > >

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Description: Implements dynamic partition pruning by adding a dynamic-partition-pruning filter if there

[jira] [Updated] (SPARK-11150) Dynamic partition pruning

2019-10-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11150: Description: Implements dynamic partition pruning by adding a dynamic-partition-pruning filter if there

[jira] [Assigned] (SPARK-29350) Fix BroadcastExchange reuse in Dynamic Partition Pruning

2019-10-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-29350: --- Assignee: Wei Xue > Fix BroadcastExchange reuse in Dynamic Partition Pruning >

[jira] [Resolved] (SPARK-29350) Fix BroadcastExchange reuse in Dynamic Partition Pruning

2019-10-03 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29350. - Fix Version/s: 3.0.0 Resolution: Fixed > Fix BroadcastExchange reuse in Dynamic Partition

[jira] [Resolved] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2019-09-29 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28476. - Fix Version/s: 3.0.0 Assignee: yuming.wang (was: Weichen Xu) Resolution: Fixed >

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

2019-09-21 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935119#comment-16935119 ] Xiao Li commented on SPARK-29038: - Building it using parquet does not perform well for incremental

[jira] [Resolved] (SPARK-28819) Document CREATE OR REPLACE FUNCTION in SQL Reference

2019-09-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28819. - Resolution: Duplicate They are duplicate.  > Document CREATE OR REPLACE FUNCTION in SQL Reference >

[jira] [Commented] (SPARK-28816) Document ADD JAR statement in SQL Reference.

2019-09-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934760#comment-16934760 ] Xiao Li commented on SPARK-28816: - Any update? > Document ADD JAR statement in SQL Reference. >

[jira] [Commented] (SPARK-28827) Document SELECT CURRENT_DATABASE in SQL Reference

2019-09-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934757#comment-16934757 ] Xiao Li commented on SPARK-28827: - CURRENT_DATABASE is just a function. We do not need to document it in

[jira] [Resolved] (SPARK-28827) Document SELECT CURRENT_DATABASE in SQL Reference

2019-09-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28827. - Resolution: Invalid > Document SELECT CURRENT_DATABASE in SQL Reference >

[jira] [Commented] (SPARK-28827) Document SELECT CURRENT_DATABASE in SQL Reference

2019-09-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934756#comment-16934756 ] Xiao Li commented on SPARK-28827: - Any update? > Document SELECT CURRENT_DATABASE in SQL Reference >

[jira] [Commented] (SPARK-28800) Document REPAIR TABLE statement in SQL Reference.

2019-09-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934754#comment-16934754 ] Xiao Li commented on SPARK-28800: - Any update? > Document REPAIR TABLE statement in SQL Reference. >

[jira] [Commented] (SPARK-28794) Document CREATE TABLE in SQL Reference.

2019-09-20 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934752#comment-16934752 ] Xiao Li commented on SPARK-28794: - Any update on this? > Document CREATE TABLE in SQL Reference. >

[jira] [Resolved] (SPARK-28822) Document USE DATABASE in SQL Reference

2019-09-19 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28822. - Fix Version/s: 3.0.0 Assignee: Shivu Sondur Resolution: Fixed > Document USE DATABASE

[jira] [Resolved] (SPARK-28989) Add `spark.sql.ansi.enabled`

2019-09-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28989. - Fix Version/s: 3.0.0 Resolution: Fixed > Add `spark.sql.ansi.enabled` >

[jira] [Updated] (SPARK-16452) basic INFORMATION_SCHEMA support

2019-09-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-16452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-16452: Target Version/s: (was: 3.0.0) > basic INFORMATION_SCHEMA support > >

[jira] [Resolved] (SPARK-26022) PySpark Comparison with Pandas

2019-09-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-26022. - Target Version/s: (was: 3.0.0) Resolution: Later > PySpark Comparison with Pandas >

[jira] [Commented] (SPARK-26022) PySpark Comparison with Pandas

2019-09-18 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932610#comment-16932610 ] Xiao Li commented on SPARK-26022: - [https://github.com/databricks/koalas] is to close the gap.  >

[jira] [Resolved] (SPARK-28792) Document CREATE DATABASE statement in SQL Reference.

2019-09-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28792. - Fix Version/s: 3.0.0 Resolution: Fixed > Document CREATE DATABASE statement in SQL Reference. >

[jira] [Assigned] (SPARK-28792) Document CREATE DATABASE statement in SQL Reference.

2019-09-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28792: --- Assignee: Sharanabasappa G Keriwaddi > Document CREATE DATABASE statement in SQL Reference. >

[jira] [Resolved] (SPARK-28814) Document SET/RESET in SQL Reference.

2019-09-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28814. - Fix Version/s: 3.0.0 Resolution: Fixed > Document SET/RESET in SQL Reference. >

[jira] [Assigned] (SPARK-28814) Document SET/RESET in SQL Reference.

2019-09-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28814: --- Assignee: Sharanabasappa G Keriwaddi > Document SET/RESET in SQL Reference. >

[jira] [Resolved] (SPARK-27972) Move SQL migration guide to the top level

2019-09-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27972. - Resolution: Duplicate > Move SQL migration guide to the top level >

[jira] [Updated] (SPARK-29092) EXPLAIN FORMATTED does not work well with DPP

2019-09-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29092: Description:   {code:java} withSQLConf(SQLConf.DYNAMIC_PARTITION_PRUNING_ENABLED.key -> "true",

[jira] [Updated] (SPARK-29092) EXPLAIN FORMATTED does not work well with DPP

2019-09-15 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-29092: Target Version/s: 3.0.0 > EXPLAIN FORMATTED does not work well with DPP >

[jira] [Created] (SPARK-29092) EXPLAIN FORMATTED does not work well with DPP

2019-09-15 Thread Xiao Li (Jira)
Xiao Li created SPARK-29092: --- Summary: EXPLAIN FORMATTED does not work well with DPP Key: SPARK-29092 URL: https://issues.apache.org/jira/browse/SPARK-29092 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-28372) Document Spark WEB UI

2019-09-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28372. - Fix Version/s: 3.0.0 Resolution: Fixed > Document Spark WEB UI > - > >

[jira] [Resolved] (SPARK-28373) Document JDBC/ODBC Server page

2019-09-14 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28373. - Fix Version/s: 3.0.0 Assignee: Pablo Langa Blanco Resolution: Fixed > Document

[jira] [Resolved] (SPARK-28134) Trigonometric Functions

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28134. - Resolution: Later > Trigonometric Functions > --- > > Key:

[jira] [Resolved] (SPARK-28909) ANSI SQL: delete and update does not support in Spark

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28909. - Resolution: Duplicate > ANSI SQL: delete and update does not support in Spark >

[jira] [Resolved] (SPARK-28663) Aggregate Functions for Statistics

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28663. - Resolution: Later > Aggregate Functions for Statistics > -- > >

[jira] [Resolved] (SPARK-28731) Support limit on recursive queries

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28731. - Resolution: Later > Support limit on recursive queries > -- > >

[jira] [Resolved] (SPARK-28661) Hypothetical-Set Aggregate Functions

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28661. - Resolution: Later > Hypothetical-Set Aggregate Functions > > >

[jira] [Resolved] (SPARK-28171) Difference of interval type conversion between SparkSQL and PostgreSQL

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28171. - Resolution: Later > Difference of interval type conversion between SparkSQL and PostgreSQL >

[jira] [Resolved] (SPARK-28379) Correlated scalar subqueries must be aggregated

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28379. - Resolution: Later > Correlated scalar subqueries must be aggregated >

[jira] [Resolved] (SPARK-28316) Decimal precision issue

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28316. - Resolution: Later > Decimal precision issue > --- > > Key:

[jira] [Updated] (SPARK-25411) Implement range partition in Spark

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25411: Parent: (was: SPARK-27764) Issue Type: New Feature (was: Sub-task) > Implement range

[jira] [Commented] (SPARK-25411) Implement range partition in Spark

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929690#comment-16929690 ] Xiao Li commented on SPARK-25411: - I think it is very specific to the impl of data sources. We can

[jira] [Resolved] (SPARK-28669) System Information Functions

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28669. - Resolution: Later > System Information Functions > > >

[jira] [Resolved] (SPARK-28400) Add built-in Array Functions: array_upper

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28400. - Resolution: Later > Add built-in Array Functions: array_upper >

[jira] [Resolved] (SPARK-28865) Table inheritance

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28865. - Resolution: Won't Fix > Table inheritance > - > > Key: SPARK-28865 >

[jira] [Resolved] (SPARK-28566) window functions should not be allowed in window definitions

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28566. - Resolution: Won't Fix > window functions should not be allowed in window definitions >

[jira] [Resolved] (SPARK-28795) Document CREATE VIEW statement in SQL Reference.

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28795. - Fix Version/s: 3.0.0 Assignee: Aman Omer Resolution: Fixed > Document CREATE VIEW

[jira] [Resolved] (SPARK-28796) Document DROP DATABASE statement in SQL Reference.

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28796. - Fix Version/s: 3.0.0 Assignee: Sandeep Katta Resolution: Fixed > Document DROP DATABASE

[jira] [Assigned] (SPARK-28828) Document REFRESH statement in SQL Reference.

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28828: --- Assignee: kevin yu > Document REFRESH statement in SQL Reference. >

[jira] [Resolved] (SPARK-28828) Document REFRESH statement in SQL Reference.

2019-09-13 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28828. - Fix Version/s: 3.0.0 Resolution: Fixed > Document REFRESH statement in SQL Reference. >

[jira] [Resolved] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29048. - Fix Version/s: 3.0.0 Resolution: Fixed > Query optimizer slow when using Column.isInCollection()

[jira] [Resolved] (SPARK-27149) Support LOCALTIMESTAMP when ANSI mode enabled

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27149. - Resolution: Won't Fix > Support LOCALTIMESTAMP when ANSI mode enabled >

[jira] [Resolved] (SPARK-28453) Support recursive view syntax

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28453. - Resolution: Won't Fix > Support recursive view syntax > - > >

[jira] [Commented] (SPARK-28453) Support recursive view syntax

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928947#comment-16928947 ] Xiao Li commented on SPARK-28453: - This is a very low priority task. Let us do not spend time on it.  >

[jira] [Closed] (SPARK-28298) Fully support char and varchar types

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-28298. --- > Fully support char and varchar types > > > Key:

[jira] [Closed] (SPARK-28448) Implement ILIKE operator

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-28448. --- > Implement ILIKE operator > > > Key: SPARK-28448 >

[jira] [Resolved] (SPARK-28298) Fully support char and varchar types

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28298. - Resolution: Won't Fix > Fully support char and varchar types > > >

[jira] [Resolved] (SPARK-28448) Implement ILIKE operator

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28448. - Resolution: Won't Fix > Implement ILIKE operator > > > Key:

[jira] [Closed] (SPARK-27877) ANSI SQL: LATERAL derived table(T491)

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-27877. --- > ANSI SQL: LATERAL derived table(T491) > - > > Key:

[jira] [Resolved] (SPARK-27877) ANSI SQL: LATERAL derived table(T491)

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27877. - Resolution: Won't Fix > ANSI SQL: LATERAL derived table(T491) > - >

[jira] [Closed] (SPARK-27980) Ordered-Set Aggregate Functions

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-27980. --- > Ordered-Set Aggregate Functions > --- > > Key: SPARK-27980 >

[jira] [Resolved] (SPARK-28027) Missing some mathematical operators

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28027. - Resolution: Won't Fix > Missing some mathematical operators > --- > >

[jira] [Resolved] (SPARK-27980) Ordered-Set Aggregate Functions

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27980. - Resolution: Won't Fix > Ordered-Set Aggregate Functions > --- > >

[jira] [Commented] (SPARK-28027) Missing some mathematical operators

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928940#comment-16928940 ] Xiao Li commented on SPARK-28027: - Here, we will only support ^.  > Missing some mathematical operators

[jira] [Commented] (SPARK-28027) Missing some mathematical operators

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928942#comment-16928942 ] Xiao Li commented on SPARK-28027: - OK, since ^ has different semantics. Let us close it.  > Missing

[jira] [Resolved] (SPARK-29071) Upgrade Scala to 2.12.10

2019-09-12 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29071. - Resolution: Duplicate > Upgrade Scala to 2.12.10 > > > Key:

[jira] [Created] (SPARK-29071) Upgrade Scala to 2.12.10

2019-09-12 Thread Xiao Li (Jira)
Xiao Li created SPARK-29071: --- Summary: Upgrade Scala to 2.12.10 Key: SPARK-29071 URL: https://issues.apache.org/jira/browse/SPARK-29071 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

2019-09-11 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927784#comment-16927784 ] Xiao Li commented on SPARK-29038: - So far, the doc does not contain enough details. It requires

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

2019-09-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927274#comment-16927274 ] Xiao Li commented on SPARK-29038: - https://www.bwdb2ug.org/Presentations/BWDUG_%20MQT.pps is a

[jira] [Commented] (SPARK-29038) SPIP: Support Spark Materialized View

2019-09-10 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927268#comment-16927268 ] Xiao Li commented on SPARK-29038: - We need to follow ANSI SQL if we plan to support the materialized

[jira] [Resolved] (SPARK-28831) Document CLEAR CACHE in SQL Reference

2019-09-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28831. - Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed > Document CLEAR CACHE in

[jira] [Resolved] (SPARK-28773) NULL Handling

2019-09-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28773. - Fix Version/s: 3.0.0 Resolution: Fixed > NULL Handling > - > > Key:

[jira] [Assigned] (SPARK-28773) NULL Handling

2019-09-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28773: --- Assignee: Dilip Biswal (was: Xiao Li) > NULL Handling > - > > Key:

[jira] [Resolved] (SPARK-28637) Thriftserver can not support interval type

2019-09-09 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28637. - Fix Version/s: 3.0.0 Assignee: Yuming Wang Resolution: Fixed > Thriftserver can not

[jira] [Assigned] (SPARK-28542) Document Stages page

2019-09-08 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28542: --- Assignee: Pablo Langa Blanco > Document Stages page > > >

[jira] [Updated] (SPARK-28912) MatchError exception in CheckpointWriteHandler

2019-09-07 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28912: Fix Version/s: (was: 2.4.5) > MatchError exception in CheckpointWriteHandler >

[jira] [Resolved] (SPARK-28935) Document SQL metrics for Details for Query Plan

2019-09-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28935. - Fix Version/s: 3.0.0 Assignee: Liang-Chi Hsieh Resolution: Fixed > Document SQL metrics

[jira] [Resolved] (SPARK-29002) Avoid changing SMJ to BHJ if the build side has a high ratio of empty partitions

2019-09-06 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-29002. - Fix Version/s: 3.0.0 Assignee: Maryann Xue Resolution: Fixed > Avoid changing SMJ to

[jira] [Assigned] (SPARK-28802) Document DESCRIBE DATABASE in SQL Reference.

2019-09-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28802: --- Assignee: kevin yu > Document DESCRIBE DATABASE in SQL Reference. >

[jira] [Resolved] (SPARK-28802) Document DESCRIBE DATABASE in SQL Reference.

2019-09-05 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28802. - Fix Version/s: 3.0.0 Resolution: Fixed > Document DESCRIBE DATABASE in SQL Reference. >

[jira] [Resolved] (SPARK-28830) Document UNCACHE TABLE in SQL Reference

2019-09-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28830. - Fix Version/s: 3.0.0 Assignee: Huaxin Gao Resolution: Fixed > Document UNCACHE TABLE in

<    1   2   3   4   5   6   7   8   9   10   >