[jira] [Commented] (SPARK-19211) Explicitly prevent Insert into View or Create View As Insert

2017-02-28 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889270#comment-15889270 ] Jiang Xingbo commented on SPARK-19211: -- I‘ve been working on it this week and perhaps I'll submit a

[jira] [Created] (SPARK-19331) Improve the test coverage of SQLViewSuite

2017-01-22 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-19331: Summary: Improve the test coverage of SQLViewSuite Key: SPARK-19331 URL: https://issues.apache.org/jira/browse/SPARK-19331 Project: Spark Issue Type:

[jira] [Created] (SPARK-19272) Remove the param `viewOriginalText` from `CatalogTable`

2017-01-18 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-19272: Summary: Remove the param `viewOriginalText` from `CatalogTable` Key: SPARK-19272 URL: https://issues.apache.org/jira/browse/SPARK-19272 Project: Spark

[jira] [Updated] (SPARK-19024) Implement new approach to write a permanent view

2017-01-17 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-19024: - Summary: Implement new approach to write a permanent view (was: Don't generate SQL query on

[jira] [Created] (SPARK-19212) Parse the view query in HiveSessionCatalog

2017-01-13 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-19212: Summary: Parse the view query in HiveSessionCatalog Key: SPARK-19212 URL: https://issues.apache.org/jira/browse/SPARK-19212 Project: Spark Issue Type:

[jira] [Created] (SPARK-19211) Explicitly prevent Insert into View or Create View As Insert

2017-01-13 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-19211: Summary: Explicitly prevent Insert into View or Create View As Insert Key: SPARK-19211 URL: https://issues.apache.org/jira/browse/SPARK-19211 Project: Spark

[jira] [Created] (SPARK-19025) Remove SQL builder for operators

2016-12-29 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-19025: Summary: Remove SQL builder for operators Key: SPARK-19025 URL: https://issues.apache.org/jira/browse/SPARK-19025 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-19024) Don't generate SQL query on CREATE/ALTER a view

2016-12-29 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-19024: Summary: Don't generate SQL query on CREATE/ALTER a view Key: SPARK-19024 URL: https://issues.apache.org/jira/browse/SPARK-19024 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18801) Support resolve a nested view

2016-12-29 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-18801: - Summary: Support resolve a nested view (was: Add `View` operator to help resolve a view) >

[jira] [Updated] (SPARK-18801) Add `View` operator to help resolve a view

2016-12-29 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-18801: - Description: We should be able to resolve a nested view. The main advantage is that if you

[jira] [Updated] (SPARK-18801) Add `View` operator to help resolve a view

2016-12-29 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-18801: - Description: We should be able to resolve a nested view. The main advantage is that if you

[jira] [Created] (SPARK-18961) Support `SHOW TABLE EXTENDED ... PARTITION` statement

2016-12-21 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-18961: Summary: Support `SHOW TABLE EXTENDED ... PARTITION` statement Key: SPARK-18961 URL: https://issues.apache.org/jira/browse/SPARK-18961 Project: Spark Issue

[jira] [Created] (SPARK-18801) Add `View` operator to help resolve a view

2016-12-09 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-18801: Summary: Add `View` operator to help resolve a view Key: SPARK-18801 URL: https://issues.apache.org/jira/browse/SPARK-18801 Project: Spark Issue Type:

[jira] [Closed] (SPARK-17031) Add `Scanner` operator to wrap the optimized plan directly in planner

2016-11-29 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo closed SPARK-17031. Resolution: Won't Fix We don't want this now. > Add `Scanner` operator to wrap the optimized plan

[jira] [Created] (SPARK-18624) Implict cast between ArrayTypes

2016-11-29 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-18624: Summary: Implict cast between ArrayTypes Key: SPARK-18624 URL: https://issues.apache.org/jira/browse/SPARK-18624 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

2016-11-28 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702258#comment-15702258 ] Jiang Xingbo commented on SPARK-18549: -- I'd suggest we store the view dependency in the view's

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

2016-11-26 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15699163#comment-15699163 ] Jiang Xingbo commented on SPARK-18549: -- Currently we barely don't manage a view's references, when a

[jira] [Comment Edited] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

2016-11-24 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692672#comment-15692672 ] Jiang Xingbo edited comment on SPARK-18549 at 11/24/16 8:53 AM: Do you

[jira] [Commented] (SPARK-18549) Failed to Uncache a View that References a Dropped Table.

2016-11-24 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692672#comment-15692672 ] Jiang Xingbo commented on SPARK-18549: -- Do you think we can resolve this problem after we have added

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

2016-11-23 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15690451#comment-15690451 ] Jiang Xingbo commented on SPARK-18209: -- I changed the share settings of the doc, I hope everyone can

[jira] [Comment Edited] (SPARK-18209) More robust view canonicalization without full SQL expansion

2016-11-23 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15689577#comment-15689577 ] Jiang Xingbo edited comment on SPARK-18209 at 11/23/16 9:54 AM: Hi all, I

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

2016-11-23 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15689577#comment-15689577 ] Jiang Xingbo commented on SPARK-18209: -- Hi all, I have recently prepared a design document for Spark

[jira] [Commented] (SPARK-17932) Failed to run SQL "show table extended like table_name" in Spark2.0.0

2016-11-17 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675985#comment-15675985 ] Jiang Xingbo commented on SPARK-17932: -- I’m working on this, thanks! > Failed to run SQL "show

[jira] [Comment Edited] (SPARK-18436) isin causing SQL syntax error with JDBC

2016-11-16 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670939#comment-15670939 ] Jiang Xingbo edited comment on SPARK-18436 at 11/16/16 4:44 PM: I created

[jira] [Commented] (SPARK-18436) isin causing SQL syntax error with JDBC

2016-11-16 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15670939#comment-15670939 ] Jiang Xingbo commented on SPARK-18436: -- The `queryExecution` of this DF is: {code} == Parsed Logical

[jira] [Created] (SPARK-18294) Implement commit protocol to support `mapred` package's committer

2016-11-06 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-18294: Summary: Implement commit protocol to support `mapred` package's committer Key: SPARK-18294 URL: https://issues.apache.org/jira/browse/SPARK-18294 Project: Spark

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

2016-11-01 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627367#comment-15627367 ] Jiang Xingbo commented on SPARK-18209: -- I'm working on this, thanks! > More robust view

[jira] [Commented] (SPARK-18191) Port RDD API to use commit protocol

2016-11-01 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625013#comment-15625013 ] Jiang Xingbo commented on SPARK-18191: -- [~rxin] I'll be working on this. Thank you! > Port RDD API

[jira] [Commented] (SPARK-18148) Misleading Error Message for Aggregation Without Window/GroupBy

2016-10-28 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614773#comment-15614773 ] Jiang Xingbo commented on SPARK-18148: -- [~pat.mcdono...@databricks.com] I've reproduced this bug,

[jira] [Created] (SPARK-18094) Move group analytics test cases from `SQLQuerySuite` into a query file test

2016-10-25 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-18094: Summary: Move group analytics test cases from `SQLQuerySuite` into a query file test Key: SPARK-18094 URL: https://issues.apache.org/jira/browse/SPARK-18094 Project:

[jira] [Created] (SPARK-18063) Failed to infer constraints over multiple aliases

2016-10-22 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-18063: Summary: Failed to infer constraints over multiple aliases Key: SPARK-18063 URL: https://issues.apache.org/jira/browse/SPARK-18063 Project: Spark Issue

[jira] [Commented] (SPARK-17910) Allow users to update the comment of a column

2016-10-21 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594623#comment-15594623 ] Jiang Xingbo commented on SPARK-17910: -- [~yhuai] Seems we don't support `ALTER TABLE CHANGE COLUMN`

[jira] [Issue Comment Deleted] (SPARK-17910) Allow users to update the comment of a column

2016-10-21 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-17910: - Comment: was deleted (was: [~yhuai] Seems we don't support `ALTER TABLE CHANGE COLUMN`

[jira] [Commented] (SPARK-17910) Allow users to update the comment of a column

2016-10-21 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594610#comment-15594610 ] Jiang Xingbo commented on SPARK-17910: -- [~yhuai] Seems we don't support `ALTER TABLE CHANGE COLUMN`

[jira] [Created] (SPARK-18045) Move `HiveDataFrameAnalyticsSuite` to package `sql`

2016-10-21 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-18045: Summary: Move `HiveDataFrameAnalyticsSuite` to package `sql` Key: SPARK-18045 URL: https://issues.apache.org/jira/browse/SPARK-18045 Project: Spark Issue

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587659#comment-15587659 ] Jiang Xingbo commented on SPARK-17982: -- You are right, just made a mistake. Sorry for that! > Spark

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587433#comment-15587433 ] Jiang Xingbo commented on SPARK-17982: -- Would you please give a example that it works? Thanks! >

[jira] [Comment Edited] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587420#comment-15587420 ] Jiang Xingbo edited comment on SPARK-17982 at 10/19/16 2:22 AM:

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587420#comment-15587420 ] Jiang Xingbo commented on SPARK-17982: -- [~dongjoon] In your examples there is a misleading part:

[jira] [Commented] (SPARK-17910) Allow users to update the comment of a column

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585121#comment-15585121 ] Jiang Xingbo commented on SPARK-17910: -- Hi, If no one is working on this, I'd like to have a try.

[jira] [Comment Edited] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails when select statement contains limit clause

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585061#comment-15585061 ] Jiang Xingbo edited comment on SPARK-17982 at 10/18/16 10:16 AM: - Hi,

[jira] [Commented] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails when select statement contains limit clause

2016-10-18 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585061#comment-15585061 ] Jiang Xingbo commented on SPARK-17982: -- Thank you for reporting! I'll look at this issue. > Spark

[jira] [Updated] (SPARK-17851) Make sure all test sqls in catalyst pass checkAnalysis

2016-10-15 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-17851: - Description: Currently we have several tens of test sqls in catalyst will fail at

[jira] [Updated] (SPARK-17851) Make sure all test sqls in catalyst pass checkAnalyze

2016-10-14 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-17851: - Description: Currently we have several tens of test sqls in catalyst will fail at

[jira] [Commented] (SPARK-17868) Do not use bitmasks during parsing and analysis of CUBE/ROLLUP/GROUPING SETS

2016-10-11 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564751#comment-15564751 ] Jiang Xingbo commented on SPARK-17868: -- Yes, I'll be working on this. Thank you! > Do not use

[jira] [Created] (SPARK-17851) Update invalid test sql in `ColumnPruningSuite`

2016-10-10 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-17851: Summary: Update invalid test sql in `ColumnPruningSuite` Key: SPARK-17851 URL: https://issues.apache.org/jira/browse/SPARK-17851 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17820) Spark sqlContext.sql() performs only first insert for HiveQL "FROM target INSERT INTO dest" command to insert into multiple target tables from same source

2016-10-09 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559565#comment-15559565 ] Jiang Xingbo commented on SPARK-17820: -- [~kmbeyond]I tried on Spark 1.6.0 and was unable to repro

[jira] [Commented] (SPARK-17820) Spark sqlContext.sql() performs only first insert for HiveQL "FROM target INSERT INTO dest" command to insert into multiple target tables from same source

2016-10-08 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15557461#comment-15557461 ] Jiang Xingbo commented on SPARK-17820: -- [~hvanhovell] Thank you! I'll be working on this. > Spark

[jira] [Commented] (SPARK-17820) Spark sqlContext.sql() performs only first insert for HiveQL "FROM target INSERT INTO dest" command to insert into multiple target tables from same source

2016-10-08 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15557433#comment-15557433 ] Jiang Xingbo commented on SPARK-17820: -- Looks we could support this by expanding

[jira] [Commented] (SPARK-17741) Grammar to parse top level and nested data fields separately

2016-10-01 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15539707#comment-15539707 ] Jiang Xingbo commented on SPARK-17741: -- I'm working on this - Perhaps we can also add more testcases

[jira] [Commented] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537815#comment-15537815 ] Jiang Xingbo commented on SPARK-17733: -- [~sameer]Thank you for your help! Since

[jira] [Comment Edited] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535727#comment-15535727 ] Jiang Xingbo edited comment on SPARK-17733 at 9/30/16 11:26 AM: The

[jira] [Comment Edited] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535727#comment-15535727 ] Jiang Xingbo edited comment on SPARK-17733 at 9/30/16 11:21 AM: The

[jira] [Comment Edited] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535727#comment-15535727 ] Jiang Xingbo edited comment on SPARK-17733 at 9/30/16 11:20 AM: The

[jira] [Commented] (SPARK-17733) InferFiltersFromConstraints rule never terminates for query

2016-09-30 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535727#comment-15535727 ] Jiang Xingbo commented on SPARK-17733: -- The problem lies in function

[jira] [Created] (SPARK-17506) Improve the check double values equality rule

2016-09-12 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-17506: Summary: Improve the check double values equality rule Key: SPARK-17506 URL: https://issues.apache.org/jira/browse/SPARK-17506 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17253) Left join where ON clause does not reference the right table produces analysis error

2016-09-02 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457845#comment-15457845 ] Jiang Xingbo commented on SPARK-17253: -- I'm afraid we don't support `CROSS JOIN` operator for now,

[jira] [Comment Edited] (SPARK-17142) Complex query triggers binding error in HashAggregateExec

2016-09-01 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454837#comment-15454837 ] Jiang Xingbo edited comment on SPARK-17142 at 9/1/16 9:07 AM: -- In

[jira] [Comment Edited] (SPARK-17142) Complex query triggers binding error in HashAggregateExec

2016-09-01 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454837#comment-15454837 ] Jiang Xingbo edited comment on SPARK-17142 at 9/1/16 9:07 AM: -- In

[jira] [Commented] (SPARK-17142) Complex query triggers binding error in HashAggregateExec

2016-09-01 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454837#comment-15454837 ] Jiang Xingbo commented on SPARK-17142: -- In `ReorderAssociativeOperator` rule, we extract foldable

[jira] [Created] (SPARK-17295) Create TestHiveSessionState use reflect logic based on the setting of CATALOG_IMPLEMENTATION

2016-08-29 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-17295: Summary: Create TestHiveSessionState use reflect logic based on the setting of CATALOG_IMPLEMENTATION Key: SPARK-17295 URL: https://issues.apache.org/jira/browse/SPARK-17295

[jira] [Created] (SPARK-17215) Method `SQLContext.parseDataType(dataTypeString: String)` could be removed.

2016-08-24 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-17215: Summary: Method `SQLContext.parseDataType(dataTypeString: String)` could be removed. Key: SPARK-17215 URL: https://issues.apache.org/jira/browse/SPARK-17215 Project:

[jira] [Created] (SPARK-17032) Add test cases for methods in ParserUtils

2016-08-12 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-17032: Summary: Add test cases for methods in ParserUtils Key: SPARK-17032 URL: https://issues.apache.org/jira/browse/SPARK-17032 Project: Spark Issue Type:

[jira] [Created] (SPARK-17031) Add `Scanner` operator to wrap the optimized plan directly in planner

2016-08-12 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-17031: Summary: Add `Scanner` operator to wrap the optimized plan directly in planner Key: SPARK-17031 URL: https://issues.apache.org/jira/browse/SPARK-17031 Project: Spark

[jira] [Created] (SPARK-16793) Set the temporary warehouse path to sc'conf in TestHive

2016-07-29 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-16793: Summary: Set the temporary warehouse path to sc'conf in TestHive Key: SPARK-16793 URL: https://issues.apache.org/jira/browse/SPARK-16793 Project: Spark

[jira] [Closed] (SPARK-16661) HiveContextCompatibilitySuite should use SparkSession.build.getOrCreate to create HIVE context

2016-07-21 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo closed SPARK-16661. Resolution: Not A Problem This testsuit is for users who cannot update to the newer version. >

[jira] [Created] (SPARK-16661) HiveContextCompatibilitySuite should use SparkSession.build.getOrCreate to create HIVE context

2016-07-21 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-16661: Summary: HiveContextCompatibilitySuite should use SparkSession.build.getOrCreate to create HIVE context Key: SPARK-16661 URL: https://issues.apache.org/jira/browse/SPARK-16661

[jira] [Commented] (SPARK-16282) Implement percentile SQL function

2016-07-09 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15369147#comment-15369147 ] Jiang Xingbo commented on SPARK-16282: -- Hi, I'm working on this task, will submit a PR in one or two

[jira] [Created] (SPARK-16343) Improve the PushDownPredicate rule to pushdown predicates currectly in non-deterministic condition

2016-07-01 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-16343: Summary: Improve the PushDownPredicate rule to pushdown predicates currectly in non-deterministic condition Key: SPARK-16343 URL:

[jira] [Commented] (SPARK-14172) Hive table partition predicate not passed down correctly

2016-06-27 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350704#comment-15350704 ] Jiang Xingbo commented on SPARK-14172: -- Yes you are right. I thought the deterministic part can

[jira] [Commented] (SPARK-14172) Hive table partition predicate not passed down correctly

2016-06-23 Thread Jiang Xingbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346209#comment-15346209 ] Jiang Xingbo commented on SPARK-14172: -- In collectProjectsAndFilters function, currently we only

<    1   2