[jira] [Resolved] (SPARK-28530) Fix Join Reorder optimizer rule to enforce idempotence

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28530. - Resolution: Fixed Assignee: Yesheng Ma Fix Version/s: 3.0.0 > Fix Join Reorder

[jira] [Assigned] (SPARK-28532) Fix subquery optimizer rule to enforce idempotence

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28532: --- Assignee: Yesheng Ma > Fix subquery optimizer rule to enforce idempotence >

[jira] [Resolved] (SPARK-28532) Fix subquery optimizer rule to enforce idempotence

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28532. - Resolution: Fixed Fix Version/s: 3.0.0 > Fix subquery optimizer rule to enforce idempotence >

[jira] [Assigned] (SPARK-27889) Make development scripts under dev/ support Python 3

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27889: --- Assignee: Weichen Xu (was: Xiao Li) > Make development scripts under dev/ support Python 3 >

[jira] [Issue Comment Deleted] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28476: Comment: was deleted (was: [~ivy.weichan.xu]  ) > Support ALTER DATABASE SET LOCATION >

[jira] [Created] (SPARK-28527) Build a Test Framework for Thriftserver

2019-07-26 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28527: --- Summary: Build a Test Framework for Thriftserver Key: SPARK-28527 URL: https://issues.apache.org/jira/browse/SPARK-28527 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28527) Build a Test Framework for Thriftserver

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894015#comment-16894015 ] Xiao Li commented on SPARK-28527: - [~yumwang]  > Build a Test Framework for Thriftserver >

[jira] [Resolved] (SPARK-28524) ThriftServerTab lost error message

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28524. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > ThriftServerTab lost

[jira] [Updated] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27714: Target Version/s: 3.0.0 > Support Join Reorder based on Genetic Algorithm when the # of joined tables >

[jira] [Assigned] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27714: --- Assignee: Xianyin Xin > Support Join Reorder based on Genetic Algorithm when the # of joined

[jira] [Assigned] (SPARK-28237) Idempotence checker for Idempotent batches in RuleExecutors

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28237: --- Assignee: Yesheng Ma > Idempotence checker for Idempotent batches in RuleExecutors >

[jira] [Resolved] (SPARK-28237) Idempotence checker for Idempotent batches in RuleExecutors

2019-07-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28237. - Resolution: Fixed Fix Version/s: 3.0.0 > Idempotence checker for Idempotent batches in

[jira] [Assigned] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2019-07-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28476: --- Assignee: Weichen Xu > Support ALTER DATABASE SET LOCATION > --- >

[jira] [Commented] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2019-07-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893274#comment-16893274 ] Xiao Li commented on SPARK-28476: - [~ivy.weichan.xu]   > Support ALTER DATABASE SET LOCATION >

[jira] [Assigned] (SPARK-25914) Separate projection from grouping and aggregate in logical Aggregate

2019-07-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-25914: --- Assignee: (was: Dilip Biswal) > Separate projection from grouping and aggregate in logical

[jira] [Resolved] (SPARK-28293) Implement Spark's own GetTableTypesOperation

2019-07-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28293. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Implement Spark's own

[jira] [Commented] (SPARK-28486) PythonBroadcast may delete the broadcast file while a Python worker still needs it

2019-07-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891377#comment-16891377 ] Xiao Li commented on SPARK-28486: - [~Ngone51] Please submit a PR to address this issue. Thanks! >

[jira] [Assigned] (SPARK-28486) PythonBroadcast may delete the broadcast file while a Python worker still needs it

2019-07-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28486: --- Assignee: wuyi > PythonBroadcast may delete the broadcast file while a Python worker still >

[jira] [Deleted] (SPARK-28485) PythonBroadcast may delete the broadcast file while a Python worker still needs it

2019-07-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li deleted SPARK-28485: > PythonBroadcast may delete the broadcast file while a Python worker still > needs it >

[jira] [Updated] (SPARK-28485) PythonBroadcast may delete the broadcast file while a Python worker still needs it

2019-07-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28485: Issue Type: Bug (was: Improvement) > PythonBroadcast may delete the broadcast file while a Python worker

[jira] [Updated] (SPARK-28485) PythonBroadcast may delete the broadcast file while a Python worker still needs it

2019-07-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28485: Description: How to reproduce: Run "bin/pyspark --master local[1,1] --conf spark.memory.fraction=0.0001"

[jira] [Commented] (SPARK-28485) PythonBroadcast may delete the broadcast file while a Python worker still needs it

2019-07-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891364#comment-16891364 ] Xiao Li commented on SPARK-28485: - [~Ngone51] Could you help fix this? > PythonBroadcast may delete the

[jira] [Created] (SPARK-28485) PythonBroadcast may delete the broadcast file while a Python worker still needs it

2019-07-23 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28485: --- Summary: PythonBroadcast may delete the broadcast file while a Python worker still needs it Key: SPARK-28485 URL: https://issues.apache.org/jira/browse/SPARK-28485 Project:

[jira] [Assigned] (SPARK-28485) PythonBroadcast may delete the broadcast file while a Python worker still needs it

2019-07-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28485: --- Assignee: wuyi > PythonBroadcast may delete the broadcast file while a Python worker still >

[jira] [Resolved] (SPARK-28346) clone the query plan between analyzer, optimizer and planner

2019-07-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28346. - Resolution: Fixed Fix Version/s: 3.0.0 > clone the query plan between analyzer, optimizer and

[jira] [Updated] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2019-07-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28476: Target Version/s: 3.0.0 > Support ALTER DATABASE SET LOCATION > --- > >

[jira] [Created] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2019-07-22 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28476: --- Summary: Support ALTER DATABASE SET LOCATION Key: SPARK-28476 URL: https://issues.apache.org/jira/browse/SPARK-28476 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890281#comment-16890281 ] Xiao Li commented on SPARK-28457: - [~shaneknapp] Thanks for fixing it!  > curl: (60) SSL certificate

[jira] [Comment Edited] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889392#comment-16889392 ] Xiao Li edited comment on SPARK-28457 at 7/20/19 6:46 AM: -- [~shaneknapp], Could

[jira] [Commented] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889392#comment-16889392 ] Xiao Li commented on SPARK-28457: - [~shaneknapp] > curl: (60) SSL certificate problem: unable to get

[jira] [Updated] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28457: Description:   Build broke since this afternoon. [spark-master-compile-maven-hadoop-2.7 #10224 (broken

[jira] [Updated] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28457: Description: [spark-master-compile-maven-hadoop-2.7 #10224 (broken since this

[jira] [Updated] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28457: Priority: Blocker (was: Major) > curl: (60) SSL certificate problem: unable to get local issuer

[jira] [Created] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-20 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28457: --- Summary: curl: (60) SSL certificate problem: unable to get local issuer certificate More details here: Key: SPARK-28457 URL: https://issues.apache.org/jira/browse/SPARK-28457

[jira] [Updated] (SPARK-28457) curl: (60) SSL certificate problem: unable to get local issuer certificate More details here:

2019-07-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28457: Description: + build/mvn -DzincPort=3215 -DskipTests -Phadoop-2.7 -Phive-thriftserver -Pkinesis-asl

[jira] [Updated] (SPARK-28241) Show metadata operations on ThriftServerTab

2019-07-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28241: Issue Type: Sub-task (was: Improvement) Parent: SPARK-28426 > Show metadata operations on

[jira] [Updated] (SPARK-24570) SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

2019-07-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24570: Issue Type: Sub-task (was: Improvement) Parent: SPARK-28426 > SparkSQL - show schemas/tables in

[jira] [Updated] (SPARK-24196) Spark Thrift Server - SQL Client connections does't show db artefacts

2019-07-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24196: Issue Type: Sub-task (was: Bug) Parent: SPARK-28426 > Spark Thrift Server - SQL Client

[jira] [Updated] (SPARK-28104) Implement Spark's own GetColumnsOperation

2019-07-17 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28104: Issue Type: Sub-task (was: Improvement) Parent: SPARK-28426 > Implement Spark's own

[jira] [Created] (SPARK-28426) Metadata Handling in Thrift Server

2019-07-17 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28426: --- Summary: Metadata Handling in Thrift Server Key: SPARK-28426 URL: https://issues.apache.org/jira/browse/SPARK-28426 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule

2019-07-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885450#comment-16885450 ] Xiao Li commented on SPARK-28375: - [~joshrosen] The issue is only triggered if we run the rule more than

[jira] [Resolved] (SPARK-28355) Use Spark conf for threshold at which UDF is compressed by broadcast

2019-07-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28355. - Resolution: Fixed Fix Version/s: 3.0.0 > Use Spark conf for threshold at which UDF is compressed

[jira] [Assigned] (SPARK-28355) Use Spark conf for threshold at which UDF is compressed by broadcast

2019-07-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28355: --- Assignee: Jesse Cai > Use Spark conf for threshold at which UDF is compressed by broadcast >

[jira] [Updated] (SPARK-28355) Use Spark conf for threshold at which UDF is compressed by broadcast

2019-07-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28355: Priority: Minor (was: Blocker) > Use Spark conf for threshold at which UDF is compressed by broadcast >

[jira] [Reopened] (SPARK-20856) support statement using nested joins

2019-07-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-20856: - > support statement using nested joins > > > Key:

[jira] [Updated] (SPARK-28372) Document Spark WEB UI

2019-07-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28372: Target Version/s: 3.0.0 > Document Spark WEB UI > - > > Key:

[jira] [Created] (SPARK-28373) Document JDBC/ODBC Server page

2019-07-12 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28373: --- Summary: Document JDBC/ODBC Server page Key: SPARK-28373 URL: https://issues.apache.org/jira/browse/SPARK-28373 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28372) Document Spark WEB UI

2019-07-12 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28372: --- Summary: Document Spark WEB UI Key: SPARK-28372 URL: https://issues.apache.org/jira/browse/SPARK-28372 Project: Spark Issue Type: Umbrella Components:

[jira] [Resolved] (SPARK-28260) Add CLOSED state to ExecutionState

2019-07-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28260. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Add CLOSED state to

[jira] [Created] (SPARK-28361) Test equality of generated code with id in class name

2019-07-12 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28361: --- Summary: Test equality of generated code with id in class name Key: SPARK-28361 URL: https://issues.apache.org/jira/browse/SPARK-28361 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-28155) Improve SQL optimizer's predicate pushdown performance for cascading joins

2019-07-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28155. - Resolution: Fixed Fix Version/s: 3.0.0 > Improve SQL optimizer's predicate pushdown performance

[jira] [Commented] (SPARK-28155) Improve SQL optimizer's predicate pushdown performance for cascading joins

2019-07-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16877975#comment-16877975 ] Xiao Li commented on SPARK-28155: - [https://github.com/apache/spark/pull/24956] > Improve SQL

[jira] [Assigned] (SPARK-28155) Improve SQL optimizer's predicate pushdown performance for cascading joins

2019-07-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28155: --- Assignee: Yesheng Ma > Improve SQL optimizer's predicate pushdown performance for cascading joins

[jira] [Resolved] (SPARK-28167) Show global temporary view in database tool

2019-07-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28167. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Show global temporary

[jira] [Assigned] (SPARK-11412) Support merge schema for ORC

2019-06-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-11412: --- Assignee: EdisonWang > Support merge schema for ORC > > >

[jira] [Resolved] (SPARK-28196) Add a new `listTables` and `listLocalTempViews` APIs for SessionCatalog

2019-06-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28196. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Add a new `listTables`

[jira] [Resolved] (SPARK-28184) Avoid creating new sessions in SparkMetadataOperationSuite

2019-06-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28184. - Resolution: Fixed Fix Version/s: 3.0.0 > Avoid creating new sessions in

[jira] [Assigned] (SPARK-28184) Avoid creating new sessions in SparkMetadataOperationSuite

2019-06-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28184: --- Assignee: Yuming Wang > Avoid creating new sessions in SparkMetadataOperationSuite >

[jira] [Resolved] (SPARK-11412) Support merge schema for ORC

2019-06-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-11412. - Resolution: Fixed Fix Version/s: 3.0.0 > Support merge schema for ORC >

[jira] [Updated] (SPARK-28206) "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc

2019-06-28 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28206: Target Version/s: 3.0.0 > "@pandas_udf" in doctest is rendered as ":pandas_udf" in html API doc >

[jira] [Updated] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

2019-06-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-26985: Labels: BigEndian correctness (was: BigEndian) > Test "access only some column of the all of columns "

[jira] [Resolved] (SPARK-27871) LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-06-27 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27871. - Resolution: Fixed Fix Version/s: 3.0.0 > LambdaVariable should use per-query unique IDs instead

[jira] [Commented] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

2019-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870703#comment-16870703 ] Xiao Li commented on SPARK-28093: - In 3.0, we also need to add an internal conf to ensure users can

[jira] [Updated] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

2019-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28093: Labels: release-notes (was: correctness release-notes) > Built-in function trim/ltrim/rtrim has bug when

[jira] [Commented] (SPARK-28093) Built-in function trim/ltrim/rtrim has bug when using trimStr

2019-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870702#comment-16870702 ] Xiao Li commented on SPARK-28093: - The parameter orders might be different in different vendors. This is

[jira] [Updated] (SPARK-28126) Support TRIM(trimStr FROM str) syntax

2019-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28126: Issue Type: Sub-task (was: Improvement) Parent: SPARK-27764 > Support TRIM(trimStr FROM str)

[jira] [Resolved] (SPARK-28126) Support TRIM(trimStr FROM str) syntax

2019-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28126. - Resolution: Fixed Fix Version/s: 3.0.0 > Support TRIM(trimStr FROM str) syntax >

[jira] [Assigned] (SPARK-28126) Support TRIM(trimStr FROM str) syntax

2019-06-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28126: --- Assignee: yuming.wang > Support TRIM(trimStr FROM str) syntax >

[jira] [Resolved] (SPARK-28104) Implement Spark's own GetColumnsOperation

2019-06-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28104. - Resolution: Fixed Fix Version/s: 3.0.0 > Implement Spark's own GetColumnsOperation >

[jira] [Assigned] (SPARK-28104) Implement Spark's own GetColumnsOperation

2019-06-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28104: --- Assignee: Yuming Wang > Implement Spark's own GetColumnsOperation >

[jira] [Resolved] (SPARK-28127) Micro optimization on TreeNode's mapChildren method

2019-06-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28127. - Resolution: Fixed Assignee: Yesheng Ma Fix Version/s: 3.0.0 > Micro optimization on

[jira] [Commented] (SPARK-23160) Add window.sql

2019-06-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868936#comment-16868936 ] Xiao Li commented on SPARK-23160: - Thanks! [~DylanGuedes] > Add window.sql > -- > >

[jira] [Commented] (SPARK-27946) Hive DDL to Spark DDL conversion USING "show create table"

2019-06-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868935#comment-16868935 ] Xiao Li commented on SPARK-27946: - Thanks! It is not urgent.  > Hive DDL to Spark DDL conversion USING

[jira] [Commented] (SPARK-26038) Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long

2019-06-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868934#comment-16868934 ] Xiao Li commented on SPARK-26038: - Yes. It sounds good to me. Feel free to submit a backport PR.  >

[jira] [Assigned] (SPARK-28114) Add Jenkins job for `Hadoop-3.2` profile

2019-06-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-28114: --- Assignee: shane knapp > Add Jenkins job for `Hadoop-3.2` profile >

[jira] [Commented] (SPARK-28114) Add Jenkins job for `Hadoop-3.2` profile

2019-06-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16868194#comment-16868194 ] Xiao Li commented on SPARK-28114: - Thank you, [~shaneknapp]   > Add Jenkins job for `Hadoop-3.2`

[jira] [Created] (SPARK-28112) Fix Kryo exception perf. bottleneck in tests due to absence of ML/MLlib classes

2019-06-19 Thread Xiao Li (JIRA)
Xiao Li created SPARK-28112: --- Summary: Fix Kryo exception perf. bottleneck in tests due to absence of ML/MLlib classes Key: SPARK-28112 URL: https://issues.apache.org/jira/browse/SPARK-28112 Project: Spark

[jira] [Updated] (SPARK-27946) Hive DDL to Spark DDL conversion USING "show create table"

2019-06-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27946: Description: Many users migrate tables created with Hive DDL to Spark. Defining the table with Spark DDL

[jira] [Commented] (SPARK-27946) Hive DDL to Spark DDL conversion USING "show create table"

2019-06-19 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867607#comment-16867607 ] Xiao Li commented on SPARK-27946: - cc [~viirya] Are you interested in this? > Hive DDL to Spark DDL

[jira] [Resolved] (SPARK-27890) Improve SQL parser error message when missing backquotes for identifiers with hyphens

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27890. - Resolution: Fixed Fix Version/s: 3.0.0 > Improve SQL parser error message when missing

[jira] [Assigned] (SPARK-27890) Improve SQL parser error message when missing backquotes for identifiers with hyphens

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27890: --- Assignee: Yesheng Ma > Improve SQL parser error message when missing backquotes for identifiers

[jira] [Updated] (SPARK-28103) Cannot infer filters from union table with empty local relation table properly

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28103: Target Version/s: 3.0.0 > Cannot infer filters from union table with empty local relation table properly

[jira] [Resolved] (SPARK-28096) Lazy val performance pitfall in Spark SQL LogicalPlans

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28096. - Resolution: Fixed Assignee: Yesheng Ma Fix Version/s: 3.0.0 > Lazy val performance

[jira] [Resolved] (SPARK-28039) Add float4.sql

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28039. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Add float4.sql >

[jira] [Resolved] (SPARK-27783) Add customizable hint error handler

2019-06-18 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27783. - Resolution: Fixed Assignee: Maryann Xue Fix Version/s: 3.0.0 > Add customizable hint

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2019-06-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28024: Priority: Critical (was: Major) > Incorrect numeric values when out of range >

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2019-06-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28024: Labels: correctness (was: ) > Incorrect numeric values when out of range >

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

2019-06-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28024: Target Version/s: 3.0.0 > Incorrect numeric values when out of range >

[jira] [Resolved] (SPARK-27934) Add case.sql

2019-06-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27934. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Add case.sql >

[jira] [Resolved] (SPARK-27899) Make HiveMetastoreClient.getTableObjectsByName available in ExternalCatalog/SessionCatalog API

2019-06-11 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27899. - Resolution: Fixed Fix Version/s: 3.0.0 > Make HiveMetastoreClient.getTableObjectsByName

[jira] [Resolved] (SPARK-27970) Support Hive 3.0 metastore

2019-06-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27970. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Support Hive 3.0

[jira] [Resolved] (SPARK-27870) Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27870. - Resolution: Fixed Assignee: Weichen Xu Fix Version/s: 3.0.0 > Flush each batch for

[jira] [Resolved] (SPARK-27965) Add extractors for logical transforms

2019-06-07 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27965. - Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 3.0.0 > Add extractors for logical

[jira] [Created] (SPARK-27972) Move SQL migration guide to the top level

2019-06-06 Thread Xiao Li (JIRA)
Xiao Li created SPARK-27972: --- Summary: Move SQL migration guide to the top level Key: SPARK-27972 URL: https://issues.apache.org/jira/browse/SPARK-27972 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-27918) Add boolean.sql

2019-06-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27918. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 > Add boolean.sql >

[jira] [Updated] (SPARK-27924) ANSI SQL: Boolean Test

2019-06-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27924: Description: {quote} ::=   [ IS [ NOT ] ] ::=     TRUE   | FALSE   | UNKNOWN{quote}   Currently, the

[jira] [Updated] (SPARK-27924) ANSI SQL: Boolean Test

2019-06-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27924: Summary: ANSI SQL: Boolean Test (was: E061-14: Search Conditions) > ANSI SQL: Boolean Test >

[jira] [Updated] (SPARK-27924) E061-14: Search Conditions

2019-06-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-27924: Target Version/s: 3.0.0 > E061-14: Search Conditions > -- > >

[jira] [Assigned] (SPARK-27883) Add aggregates.sql - Part2

2019-06-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-27883: --- Assignee: Yuming Wang > Add aggregates.sql - Part2 > -- > >

[jira] [Resolved] (SPARK-27883) Add aggregates.sql - Part2

2019-06-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-27883. - Resolution: Fixed Fix Version/s: 3.0.0 > Add aggregates.sql - Part2 > --

<    2   3   4   5   6   7   8   9   10   11   >