[jira] [Comment Edited] (SPARK-15340) Limit the size of the map used to cache JobConfs to void OOM

2016-06-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337421#comment-15337421 ] Zhongshuai Pei edited comment on SPARK-15340 at 6/18/16 1:47 AM: -

[jira] [Commented] (SPARK-15340) Limit the size of the map used to cache JobConfs to void OOM

2016-06-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337421#comment-15337421 ] Zhongshuai Pei commented on SPARK-15340: [~clockfly] 1. I run in the cluster mode on YARN and

[jira] [Issue Comment Deleted] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-05-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-4105: -- Comment: was deleted (was: Can you suggest how I reproduce this error?) >

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-05-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288084#comment-15288084 ] Zhongshuai Pei commented on SPARK-4105: --- Can you suggest how I reproduce this error? >

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-05-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288085#comment-15288085 ] Zhongshuai Pei commented on SPARK-4105: --- Can you suggest how I reproduce this error? >

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs to void OOM

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Summary: Limit the size of the map used to cache JobConfs to void OOM (was: Limit the size

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Summary: Limit the size of the map used to cache JobConfs (was: Limit the size of the map

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by using JDBCServer, driver always OOM. i find tens of

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by using JDBCServer, driver always OOM. i find tens of

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by JDBCServer, driver always OOM. i find tens of

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by JDBCServer, driver always OOM and i find tens of

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by JDBCServer, driver always OOM and i find tens of

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by JDBCServer, driver always OOM and i find tens of

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

2016-05-16 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Affects Version/s: 1.5.0 1.6.0 > Limit the size of the map used to

[jira] [Created] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

2016-05-16 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-15340: -- Summary: Limit the size of the map used to cache JobConfs and InputFormats Key: SPARK-15340 URL: https://issues.apache.org/jira/browse/SPARK-15340 Project: Spark

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251201#comment-15251201 ] Zhongshuai Pei edited comment on SPARK-4105 at 4/21/16 8:08 AM: I find

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-04-20 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251201#comment-15251201 ] Zhongshuai Pei edited comment on SPARK-4105 at 4/21/16 3:51 AM: I find

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-04-20 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251201#comment-15251201 ] Zhongshuai Pei edited comment on SPARK-4105 at 4/21/16 3:49 AM: I find

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-04-20 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251201#comment-15251201 ] Zhongshuai Pei commented on SPARK-4105: --- I find that some task recompute before this problem

[jira] [Issue Comment Deleted] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-03-28 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-4105: -- Comment: was deleted (was: snappy or lz4?) > FAILED_TO_UNCOMPRESS(5) errors when fetching

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-03-10 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189227#comment-15189227 ] Zhongshuai Pei commented on SPARK-4105: --- snappy or lz4? > FAILED_TO_UNCOMPRESS(5) errors when

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-03-09 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188556#comment-15188556 ] Zhongshuai Pei commented on SPARK-4105: --- I had this happen in Spark 1.5.2 [~joshrosen]

[jira] [Created] (SPARK-11974) Not all the temp dirs had been deleted when the JVM exits

2015-11-24 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-11974: -- Summary: Not all the temp dirs had been deleted when the JVM exits Key: SPARK-11974 URL: https://issues.apache.org/jira/browse/SPARK-11974 Project: Spark

[jira] [Updated] (SPARK-11974) Not all the temp dirs had been deleted when the JVM exits

2015-11-24 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-11974: --- Description: deleting the temp dir like that {noformat} val a =

[jira] [Updated] (SPARK-11974) Not all the temp dirs had been deleted when the JVM exits

2015-11-24 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-11974: --- Description: deleting the temp dir like that {noformat} val a =

[jira] [Issue Comment Deleted] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-9725: -- Comment: was deleted (was: good job :)) spark sql query string field return empty/garbled

[jira] [Commented] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-15 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14698524#comment-14698524 ] Zhongshuai Pei commented on SPARK-9725: --- good job :) spark sql query string field

[jira] [Commented] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-14 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696684#comment-14696684 ] Zhongshuai Pei commented on SPARK-9725: --- In my environment,offset did not change

[jira] [Commented] (SPARK-9725) spark sql query string field return empty/garbled string

2015-08-13 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696336#comment-14696336 ] Zhongshuai Pei commented on SPARK-9725: --- I have debug this issue and i find

[jira] [Closed] (SPARK-8441) ArrayIndexOutOfBoundsException when select all fields of a parqurt table with nested schema

2015-07-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-8441. - Resolution: Fixed ArrayIndexOutOfBoundsException when select all fields of a parqurt table with

[jira] [Created] (SPARK-8441) ArrayIndexOutOfBoundsException when select all fields of a parqurt table with nested schema

2015-06-18 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-8441: - Summary: ArrayIndexOutOfBoundsException when select all fields of a parqurt table with nested schema Key: SPARK-8441 URL: https://issues.apache.org/jira/browse/SPARK-8441

[jira] [Updated] (SPARK-8441) ArrayIndexOutOfBoundsException when select all fields of a parqurt table with nested schema

2015-06-18 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-8441: -- Description: Table Info : {noformat} create table t1( key1 int, key2 String, key3 int, key4

[jira] [Updated] (SPARK-8441) ArrayIndexOutOfBoundsException when select all fields of a parqurt table with nested schema

2015-06-18 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-8441: -- Description: Table Info : {noformat} create table t1( key1 int, key2 String, key3 int, key4

[jira] [Updated] (SPARK-7824) Collapsing operator reordering and constant folding into a single batch to push down the single side.

2015-05-26 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7824: -- Summary: Collapsing operator reordering and constant folding into a single batch to push down

[jira] [Updated] (SPARK-7867) Support revoke role ...

2015-05-26 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7867: -- Description: sql like {noformat} revoke role role_a from user user1; {noformat} Support

[jira] [Created] (SPARK-7867) Support revoke role ...

2015-05-26 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-7867: - Summary: Support revoke role ... Key: SPARK-7867 URL: https://issues.apache.org/jira/browse/SPARK-7867 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-7824) Extracting 'and/or' condition optimizer and put it before PushPredicateThroughJoin to push down the single side.

2015-05-22 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7824: -- Description: SQL: {noformat} select * from tableA join tableB on (a 3 and b = d) or (a 3 and

[jira] [Updated] (SPARK-7824) Extracting 'and/or' condition optimizer and put it before PushPredicateThroughJoin to push down the single side.

2015-05-22 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7824: -- Description: SQL: {noformat} select * from tableA join tableB on (a 3 and b = d) or (a 3 and

[jira] [Created] (SPARK-7824) Extracting 'and/or' condition optimizer and put it before PushPredicateThroughJoin to push down the single side.

2015-05-22 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-7824: - Summary: Extracting 'and/or' condition optimizer and put it before PushPredicateThroughJoin to push down the single side. Key: SPARK-7824 URL:

[jira] [Updated] (SPARK-7824) Extracting and/or condition optimizer from BooleanSimplification optimizer and put it before PushPredicateThroughJoin optimizer to push down the single side.

2015-05-22 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7824: -- Summary: Extracting and/or condition optimizer from BooleanSimplification optimizer and put it

[jira] [Updated] (SPARK-7702) Is it necessary to limit the precision of a Decimal type?

2015-05-19 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7702: -- Issue Type: Bug (was: Question) Is it necessary to limit the precision of a Decimal type?

[jira] [Updated] (SPARK-7702) Is it necessary to limit the precision of a Decimal type?

2015-05-18 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7702: -- Description: SQL {noformat} select cast(12.8 as decimal(40,20)) as tmp; {noformat} use

[jira] [Updated] (SPARK-7702) Is it necessary to limit the precision of a Decimal type?

2015-05-18 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7702: -- Description: SQL {noformat} select cast(12.8 as decimal(40,20)) as tmp; {noformat} use

[jira] [Created] (SPARK-7702) Is it necessary to limit the precision of a Decimal type?

2015-05-18 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-7702: - Summary: Is it necessary to limit the precision of a Decimal type? Key: SPARK-7702 URL: https://issues.apache.org/jira/browse/SPARK-7702 Project: Spark

[jira] [Updated] (SPARK-7702) Is it necessary to limit the precision of a Decimal type?

2015-05-18 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7702: -- Description: SQL {noformat} select cast(12.8 as decimal(40,20)) as tmp; {noformat} use

[jira] [Updated] (SPARK-7702) Is it necessary to limit the precision of a Decimal type?

2015-05-18 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7702: -- Description: SQL {noformat} select cast(12.8 as decimal(40,20)) as tmp; {noformat} use

[jira] [Updated] (SPARK-7702) Is it necessary to limit the precision of a Decimal type?

2015-05-18 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7702: -- Description: SQL {noformat} select cast(12.8 as decimal(40,20)) as tmp; {noformat} use

[jira] [Closed] (SPARK-7026) LeftSemiJoin can not work when it has both equal condition and not equal condition.

2015-05-11 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-7026. - Resolution: Duplicate LeftSemiJoin can not work when it has both equal condition and not equal

[jira] [Closed] (SPARK-6198) Support select current_database()

2015-05-11 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-6198. - Resolution: Won't Fix Support select current_database() ---

[jira] [Closed] (SPARK-5129) make SqlContext support select date +/- XX DAYS from table

2015-05-11 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-5129. - Resolution: Won't Fix make SqlContext support select date +/- XX DAYS from table

[jira] [Closed] (SPARK-6768) Do not support float/double union decimal or decimal(a ,b) union decimal(c, d)

2015-05-11 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-6768. - Resolution: Fixed Do not support float/double union decimal or decimal(a ,b) union decimal(c,

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into true or false directly if all element of list is Literal

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Summary: Fold literal in (item1, item2, ..., literal, ...) into true or false directly if all

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into true or false directly if element of list is Literal

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Summary: Fold literal in (item1, item2, ..., literal, ...) into true or false directly if

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into false directly if not in.

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Description: Just Fold literal in (item1, item2, ..., literal, ...) into true directly if in

[jira] [Created] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into false directly if not in.

2015-05-07 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-7437: - Summary: Fold literal in (item1, item2, ..., literal, ...) into false directly if not in. Key: SPARK-7437 URL: https://issues.apache.org/jira/browse/SPARK-7437

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into false directly if not in.

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Description: just Fold literal in (item1, item2, ..., literal, ...) into true directly if in

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into true or false directly if all element of list is Literal

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Description: (was: Just Fold literal in (item1, item2, ..., literal, ...) into true

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into true or false directly if all elements of list is Literal

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Summary: Fold literal in (item1, item2, ..., literal, ...) into true or false directly if all

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into false directly if not in.

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Description: just Fold literal in (item1, item2, ..., literal, ...) into true directly if in

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into false directly if not in.

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Description: Just Fold literal in (item1, item2, ..., literal, ...) into true directly if in

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into false directly if not in.

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Description: Just Fold literal in (item1, item2, ..., literal, ...) into true directly if in

[jira] [Updated] (SPARK-7437) Fold literal in (item1, item2, ..., literal, ...) into true or false directly

2015-05-07 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7437: -- Summary: Fold literal in (item1, item2, ..., literal, ...) into true or false directly (was:

[jira] [Updated] (SPARK-7225) CombineLimits in Optimizer do not works

2015-04-29 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7225: -- Summary: CombineLimits in Optimizer do not works (was: CombineLimits do not works)

[jira] [Updated] (SPARK-7225) CombineLimits do not works

2015-04-29 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7225: -- Description: The optimized logical plan of select key from (select key from src limit 100)

[jira] [Updated] (SPARK-7225) CombineLimits in Optimizer does not works

2015-04-29 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7225: -- Summary: CombineLimits in Optimizer does not works (was: CombineLimits in Optimizer do not

[jira] [Created] (SPARK-7225) CombineLimits do not works

2015-04-29 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-7225: - Summary: CombineLimits do not works Key: SPARK-7225 URL: https://issues.apache.org/jira/browse/SPARK-7225 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7225) CombineLimits do not works

2015-04-29 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7225: -- Description: The optimized logical plan of select key from (select key from src limit 100)

[jira] [Updated] (SPARK-7225) CombineLimits optimizer does not work

2015-04-29 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7225: -- Summary: CombineLimits optimizer does not work (was: CombineLimits optimizer does not works)

[jira] [Updated] (SPARK-7225) CombineLimits optimizer does not works

2015-04-29 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7225: -- Summary: CombineLimits optimizer does not works (was: CombineLimits in Optimizer does not

[jira] [Updated] (SPARK-7267) Push down Project when it's child is Limit

2015-04-29 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7267: -- Description: SQL {quote} select key from (select key,value from t1 limit 100) t2 limit 10

[jira] [Updated] (SPARK-7267) Push down Project when it's child is Limit

2015-04-29 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7267: -- Description: SQL {quote} select key from (select key,value from t1 limit 100) t2 limit 10

[jira] [Created] (SPARK-7267) Push down Project when it's child is Limit

2015-04-29 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-7267: - Summary: Push down Project when it's child is Limit Key: SPARK-7267 URL: https://issues.apache.org/jira/browse/SPARK-7267 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Description: Run sql like that {quote} select * from web_sales ws1 left semi join web_sales

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has equal condition and not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Summary: LeftSemiJoin can not work when it has equal condition and not equal condition.

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Description: Run sql like that {panel} select * from web_sales ws1 left semi join web_sales

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Description: Run sql like that {panel} select * from web_sales ws1 left semi join web_sales

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has equal condition and not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Description: Run sql like that {panel} select * from web_sales ws1 left semi join web_sales

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has not equal condition and equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Summary: LeftSemiJoin can not work when it has not equal condition and equal condition.

[jira] [Created] (SPARK-7026) LeftSemiJoin can not work when it has not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-7026: - Summary: LeftSemiJoin can not work when it has not equal condition. Key: SPARK-7026 URL: https://issues.apache.org/jira/browse/SPARK-7026 Project: Spark

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has both equal condition and not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Summary: LeftSemiJoin can not work when it has both equal condition and not equal condition.

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has both of equal condition and not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Summary: LeftSemiJoin can not work when it has both of equal condition and not equal

[jira] [Updated] (SPARK-7026) LeftSemiJoin can not work when it has both equal condition and not equal condition.

2015-04-21 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7026: -- Description: Run sql like that {panel} select * from web_sales ws1 left semi join web_sales

[jira] [Updated] (SPARK-6976) drop table if exists src print ERROR info that should not be printed

2015-04-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6976: -- Summary: drop table if exists src print ERROR info that should not be printed (was: drop table

[jira] [Updated] (SPARK-6976) drop table if exists src print ERROR info

2015-04-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6976: -- Description: If table src not exists and run sql drop table if exists src, then some ERROR

[jira] [Updated] (SPARK-6976) drop table if exists src print ERROR info that should not be printed when src not exists.

2015-04-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6976: -- Summary: drop table if exists src print ERROR info that should not be printed when src not

[jira] [Created] (SPARK-6976) drop table if exists src print ERROR info

2015-04-17 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-6976: - Summary: drop table if exists src print ERROR info Key: SPARK-6976 URL: https://issues.apache.org/jira/browse/SPARK-6976 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6976) drop table if exists src print ERROR info

2015-04-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6976: -- Description: If table src not exists and run sql drop table if exists src, then some ERROR

[jira] [Updated] (SPARK-6976) drop table if exists src print ERROR info

2015-04-17 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6976: -- Description: If src not exists and run sql drop table if exists src print ERROR info

[jira] [Updated] (SPARK-6768) Do not support float/double union decimal and decimal(a ,b) union decimal(c, d)

2015-04-08 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6768: -- Description: Do not support sql like that : ``` select cast(12.2056999 as float) from testData

[jira] [Updated] (SPARK-6768) Do not support float/double union decimal or decimal(a ,b) union decimal(c, d)

2015-04-08 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6768: -- Summary: Do not support float/double union decimal or decimal(a ,b) union decimal(c, d) (was:

[jira] [Updated] (SPARK-6768) Do not support float/double union decimal or decimal(a ,b) union decimal(c, d)

2015-04-08 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6768: -- Description: Do not support sql like that : select cast(12.2056999 as float) from testData

[jira] [Created] (SPARK-6768) Do not support float/double union decimal and decimal(a ,b) union decimal(c, d)

2015-04-08 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-6768: - Summary: Do not support float/double union decimal and decimal(a ,b) union decimal(c, d) Key: SPARK-6768 URL: https://issues.apache.org/jira/browse/SPARK-6768

[jira] [Updated] (SPARK-6768) Do not support float/double union decimal and decimal(a ,b) union decimal(c, d)

2015-04-08 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6768: -- Description: Do not support sql like that : ``` select cast(12.2056999 as float) from testData

[jira] [Updated] (SPARK-6768) Do not support float/double union decimal and decimal(a ,b) union decimal(c, d)

2015-04-08 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6768: -- Description: Do not support sql like that : ... select cast(12.2056999 as float) from testData

[jira] [Updated] (SPARK-6768) Do not support float/double union decimal and decimal(a ,b) union decimal(c, d)

2015-04-08 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-6768: -- Description: Do not support sql like that : ... select cast(12.2056999 as float) from testData