[jira] [Commented] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,

2017-01-05 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803628#comment-15803628 ] JESSE CHEN commented on SPARK-19068: Well, though it does not affect the correctness of the results,

[jira] [Updated] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,Wr

2017-01-03 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-19068: --- Attachment: sparklog.tar.gz This is the Spark console output in which you can find settings and

[jira] [Updated] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,Wr

2017-01-03 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-19068: --- Description: On a large cluster with 45TB RAM and 1,000 cores, we used 1008 executors in order to

[jira] [Created] (SPARK-19068) Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,Wr

2017-01-03 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-19068: -- Summary: Large number of executors causing a ton of ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(41,WrappedArray()) Key:

[jira] [Updated] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-06 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-18745: --- Labels: (was: core dump) > java.lang.IndexOutOfBoundsException running query 68 Spark SQL on

[jira] [Updated] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-06 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-18745: --- Description: Running query 68 with decreased executor memory (using 12GB executors instead of 24GB)

[jira] [Created] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-06 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-18745: -- Summary: java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB) Key: SPARK-18745 URL: https://issues.apache.org/jira/browse/SPARK-18745 Project: Spark

[jira] [Updated] (SPARK-18458) core dumped running Spark SQL on large data volume (100TB)

2016-11-15 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-18458: --- Fix Version/s: (was: 2.0.0) > core dumped running Spark SQL on large data volume (100TB) >

[jira] [Updated] (SPARK-18458) core dumped running Spark SQL on large data volume (100TB)

2016-11-15 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-18458: --- Description: Running a query on 100TB parquet database using the Spark master dated 11/04 dump

[jira] [Updated] (SPARK-18458) core dumped running Spark SQL on large data volume (100TB)

2016-11-15 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-18458: --- Labels: core dump (was: tpcds-result-mismatch) > core dumped running Spark SQL on large data volume

[jira] [Updated] (SPARK-18458) core dumped running Spark SQL on large data volume (100TB)

2016-11-15 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-18458: --- Affects Version/s: (was: 1.6.0) 2.1.0 > core dumped running Spark SQL on

[jira] [Created] (SPARK-18458) core dumped running Spark SQL on large data volume (100TB)

2016-11-15 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-18458: -- Summary: core dumped running Spark SQL on large data volume (100TB) Key: SPARK-18458 URL: https://issues.apache.org/jira/browse/SPARK-18458 Project: Spark Issue

[jira] [Commented] (SPARK-13288) [1.6.0] Memory leak in Spark streaming

2016-06-23 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347338#comment-15347338 ] JESSE CHEN commented on SPARK-13288: [~AlexSparkJiang]The code is: val multiTweetStreams=(1 to

[jira] [Commented] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289356#comment-15289356 ] JESSE CHEN commented on SPARK-15372: [~freiss] I agree with you. In addition, in order to match TPC

[jira] [Commented] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289358#comment-15289358 ] JESSE CHEN commented on SPARK-15372: I will close this next, not a problem with Spark SQL. > TPC-DS

[jira] [Updated] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-17 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15372: --- Description: The official TPC-DS query 84 returns wrong results when compared to its official

[jira] [Updated] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-17 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15372: --- Description: The official TPC-DS query 84 returns wrong results when compared to its official

[jira] [Updated] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-17 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15372: --- Labels: SPARK-15071 (was: ) > TPC-DS Qury 84 returns wrong results against TPC official >

[jira] [Created] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-17 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-15372: -- Summary: TPC-DS Qury 84 returns wrong results against TPC official Key: SPARK-15372 URL: https://issues.apache.org/jira/browse/SPARK-15372 Project: Spark Issue

[jira] [Closed] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-09 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-15122. -- Verified successfully in 0508 build. Thanks! > TPC-DS Qury 41 fails with The correlated scalar subquery

[jira] [Commented] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-09 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276600#comment-15276600 ] JESSE CHEN commented on SPARK-15122: works great! now all 99 queries pass! nicely done! > TPC-DS

[jira] [Closed] (SPARK-14968) TPC-DS query 1 resolved attribute(s) missing

2016-05-05 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-14968. -- Resolution: Fixed Fix Version/s: 2.0.0 fixed per SPARK-14785 > TPC-DS query 1 resolved

[jira] [Commented] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-04 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271128#comment-15271128 ] JESSE CHEN commented on SPARK-15122: Query41 official version: {noformat} select

[jira] [Updated] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-04 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15122: --- Priority: Critical (was: Major) > TPC-DS Qury 41 fails with The correlated scalar subquery can only

[jira] [Updated] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-04 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15122: --- Description: The official TPC-DS query 41 fails with the following error: {noformat} Error in

[jira] [Created] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-04 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-15122: -- Summary: TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates Key: SPARK-15122 URL: https://issues.apache.org/jira/browse/SPARK-15122

[jira] [Updated] (SPARK-15122) TPC-DS Qury 41 fails with The correlated scalar subquery can only contain equality predicates

2016-05-04 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15122: --- Affects Version/s: (was: 1.6.1) 2.0.0 > TPC-DS Qury 41 fails with The

[jira] [Updated] (SPARK-14968) TPC-DS query 1 resolved attribute(s) missing

2016-04-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Description: This is a regression from a week ago. Failed to generate plan for query 1 in TPCDS

[jira] [Updated] (SPARK-14968) TPC-DS query 1 resolved attribute(s) missing

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Summary: TPC-DS query 1 resolved attribute(s) missing (was: TPC-DS query 1 fails to generate plan)

[jira] [Updated] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Description: This is a regression from a week ago. Failed to generate plan for query 1 in TPCDS

[jira] [Updated] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Affects Version/s: (was: 1.6.1) 2.0.0 > TPC-DS query 1 fails to generate

[jira] [Updated] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Priority: Critical (was: Major) > TPC-DS query 1 fails to generate plan >

[jira] [Updated] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Description: This is a regression from a week ago. Failed to generate plan for query 1 in TPCDS

[jira] [Created] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-14968: -- Summary: TPC-DS query 1 fails to generate plan Key: SPARK-14968 URL: https://issues.apache.org/jira/browse/SPARK-14968 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS

2016-04-25 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256836#comment-15256836 ] JESSE CHEN commented on SPARK-14521: This fix will allow us to use Kyro again (in spark-sql shell and

[jira] [Closed] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-04-21 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-14096. -- Resolution: Duplicate SPARK-14521 > SPARK-SQL CLI returns NPE > - > >

[jira] [Commented] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-04-21 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252597#comment-15252597 ] JESSE CHEN commented on SPARK-14096: But the simplest workaround is to use the spark.serializer

[jira] [Commented] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-04-21 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252592#comment-15252592 ] JESSE CHEN commented on SPARK-14096: duplicate of SPARK-14521 > SPARK-SQL CLI returns NPE >

[jira] [Closed] (SPARK-14616) TreeNodeException running Q44 and 58 on Parquet tables

2016-04-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-14616. -- Resolution: Not A Problem > TreeNodeException running Q44 and 58 on Parquet tables >

[jira] [Commented] (SPARK-14616) TreeNodeException running Q44 and 58 on Parquet tables

2016-04-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241860#comment-15241860 ] JESSE CHEN commented on SPARK-14616: Build from yesterday did not have this problem. Closing. >

[jira] [Updated] (SPARK-14616) TreeNodeException running Q44 and 58 on Parquet tables

2016-04-13 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14616: --- Description: {code:title=tpcds q44} select asceding.rnk, i1.i_product_name best_performing,

[jira] [Updated] (SPARK-14616) TreeNodeException running Q44 and 58 on Parquet tables

2016-04-13 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14616: --- Environment: (was: spark 1.5.1 (official binary distribution) running on hadoop yarn 2.6 with

[jira] [Updated] (SPARK-14616) TreeNodeException running Q44 and 58 on Parquet tables

2016-04-13 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14616: --- Affects Version/s: (was: 1.5.1) 2.0.0 > TreeNodeException running Q44 and

[jira] [Created] (SPARK-14616) TreeNodeException running Q44 and 58 on Parquet tables

2016-04-13 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-14616: -- Summary: TreeNodeException running Q44 and 58 on Parquet tables Key: SPARK-14616 URL: https://issues.apache.org/jira/browse/SPARK-14616 Project: Spark Issue

[jira] [Commented] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2016-04-11 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235649#comment-15235649 ] JESSE CHEN commented on SPARK-13860: [~tsuresh] Could you inform the correct course of action here

[jira] [Closed] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

2016-04-11 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13307. -- Resolution: Fixed Fix Version/s: 2.0.0 Thanks. > TPCDS query 66 degraded by 30% in 1.6.0

[jira] [Commented] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

2016-04-11 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235635#comment-15235635 ] JESSE CHEN commented on SPARK-13307: Performance back on track on Spark 2.0. Closing this. > TPCDS

[jira] [Closed] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-04-01 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-14318. -- Resolution: Not A Problem > TPCDS query 14 causes Spark SQL to hang >

[jira] [Commented] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-04-01 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221943#comment-15221943 ] JESSE CHEN commented on SPARK-14318: intersect should be used. Investigating further. > TPCDS query

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Attachment: threaddump-1459461915668.tdump here is the thread dump taken during the high CPU usage

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Commented] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220864#comment-15220864 ] JESSE CHEN commented on SPARK-14318: Q14 is as follows: {noformat} with cross_items as (select

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Labels: hangs (was: tpcds-result-mismatch) > TPCDS query 14 causes Spark SQL to hang >

[jira] [Created] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-14318: -- Summary: TPCDS query 14 causes Spark SQL to hang Key: SPARK-14318 URL: https://issues.apache.org/jira/browse/SPARK-14318 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Affects Version/s: 2.0.0 > TPCDS query 14 causes Spark SQL to hang >

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

2016-03-30 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218937#comment-15218937 ] JESSE CHEN commented on SPARK-13820: We are able to run 93 now. We should shoot for all 99. And this

[jira] [Commented] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216500#comment-15216500 ] JESSE CHEN commented on SPARK-13862: PR fixed the issue. New result is ordered correctly.

[jira] [Closed] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13862. -- PR fixed this issue. Thanks, [~smilegator] > TPCDS query 49 returns wrong results compared to TPC

[jira] [Closed] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13864. -- PR fixed the issue. Nice work, [~smilegator] > TPCDS query 74 returns wrong results compared to TPC

[jira] [Commented] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216483#comment-15216483 ] JESSE CHEN commented on SPARK-13864: Validated successfully. Returned the correct result set in

[jira] [Commented] (SPARK-13831) TPC-DS Query 35 fails with the following compile error

2016-03-28 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214834#comment-15214834 ] JESSE CHEN commented on SPARK-13831: Same in spark 2.0. Query 41 also returns the same error. >

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

2016-03-28 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214795#comment-15214795 ] JESSE CHEN commented on SPARK-13820: Happens in Spark 2.0 as well, in Spark 2.0 error is {noformat}

[jira] [Updated] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-03-23 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14096: --- Labels: (was: tpcds-result-mismatch) > SPARK-SQL CLI returns NPE > - > >

[jira] [Updated] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-03-23 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14096: --- Affects Version/s: (was: 1.6.0) 2.0.0 Description: Trying to

[jira] [Created] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-03-23 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-14096: -- Summary: SPARK-SQL CLI returns NPE Key: SPARK-14096 URL: https://issues.apache.org/jira/browse/SPARK-14096 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-22 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207239#comment-15207239 ] JESSE CHEN commented on SPARK-13864: Tried on two recent builds having issues running to completion.

[jira] [Closed] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-22 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13858. -- Resolution: Not A Bug Schema updates generated correct results in both spark 1.6 and 2.0. Good to

[jira] [Closed] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

2016-03-22 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13861. -- Resolution: Duplicate Fixed all schema discrepancies. > TPCDS query 40 returns wrong results

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200637#comment-15200637 ] JESSE CHEN commented on SPARK-13865: This maybe a TPC toolkit issue. Will be looking into this with

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200886#comment-15200886 ] JESSE CHEN commented on SPARK-13865: You rock! > TPCDS query 87 returns wrong results compared to

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200869#comment-15200869 ] JESSE CHEN commented on SPARK-13865: I am onto that. Thanks. Also, good to know the parsing error is

[jira] [Commented] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198558#comment-15198558 ] JESSE CHEN commented on SPARK-13858: Good job, Bo! I would like to test this on my cluster if you

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200850#comment-15200850 ] JESSE CHEN commented on SPARK-13865: Hive, big sql, db2 queries are all generated off corresponding

[jira] [Comment Edited] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200850#comment-15200850 ] JESSE CHEN edited comment on SPARK-13865 at 3/18/16 2:24 AM: - Hive, big sql,

[jira] [Commented] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200177#comment-15200177 ] JESSE CHEN commented on SPARK-13859: Tested both q87 and q38 on the lab's cluster. With this

[jira] [Closed] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13859. -- Resolution: Not A Bug Fix Version/s: 2.0.0 Solution is to revert back to original TPC query

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200877#comment-15200877 ] JESSE CHEN commented on SPARK-13865: I will open a bug against TPCDS toolkit for this. Will add bug

[jira] [Commented] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200149#comment-15200149 ] JESSE CHEN commented on SPARK-13863: Going to validate this also on my cluster. Nice find. > TPCDS

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198559#comment-15198559 ] JESSE CHEN commented on SPARK-13865: yes sir. > TPCDS query 87 returns wrong results compared to TPC

[jira] [Commented] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199885#comment-15199885 ] JESSE CHEN commented on SPARK-13859: Testing both Q87 and Q38. Back shortly with results. > TPCDS

[jira] [Commented] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202272#comment-15202272 ] JESSE CHEN commented on SPARK-13832: This is the vanilla TPC query: {noformat} select

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202280#comment-15202280 ] JESSE CHEN commented on SPARK-13865: Solution is to revert back to original TPC query with INTERSECT

[jira] [Closed] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13865. -- Resolution: Not A Bug Fix Version/s: 2.0.0 > TPCDS query 87 returns wrong results compared to

[jira] [Closed] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13863. -- Resolution: Workaround fixed schema. > TPCDS query 66 returns wrong results compared to TPC official

[jira] [Updated] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13859: --- Description: Testing Spark SQL using TPC queries. Query 38 returns wrong results compared to

[jira] [Updated] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13858: --- Description: Testing Spark SQL using TPC queries. Query 21 returns wrong results compared to

[jira] [Updated] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13865: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 87 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13864: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 74 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13862: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 49 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13861: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 40 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13863: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 66 returns wrong results compared to TPC

[jira] [Commented] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193800#comment-15193800 ] JESSE CHEN commented on SPARK-13862: tpcds-result-mismatch > TPCDS query 49 returns wrong results

[jira] [Updated] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13860: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 39 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13859: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 38 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13858: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 21 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13863: --- Description: Testing Spark SQL using TPC queries. Query 66 returns wrong results compared to

[jira] [Updated] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13865: --- Description: Testing Spark SQL using TPC queries. Query 87 returns wrong results compared to

[jira] [Created] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13863: -- Summary: TPCDS query 66 returns wrong results compared to TPC official result set Key: SPARK-13863 URL: https://issues.apache.org/jira/browse/SPARK-13863 Project: Spark

  1   2   >