[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255152#comment-14255152 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255150#comment-14255150 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255151#comment-14255151 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255149#comment-14255149 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255153#comment-14255153 ] Cheng Lian commented on SPARK-2973: --- How about adding a special {{LocalRDD}} that

[jira] [Issue Comment Deleted] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2973: -- Comment: was deleted (was: How about adding a special {{LocalRDD}} that inherits {{RDD}} but doesn't

[jira] [Issue Comment Deleted] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2973: -- Comment: was deleted (was: How about adding a special {{LocalRDD}} that inherits {{RDD}} but doesn't

[jira] [Issue Comment Deleted] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2973: -- Comment: was deleted (was: How about adding a special {{LocalRDD}} that inherits {{RDD}} but doesn't

[jira] [Issue Comment Deleted] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2973: -- Comment: was deleted (was: How about adding a special {{LocalRDD}} that inherits {{RDD}} but doesn't

[jira] [Commented] (SPARK-2973) Add a way to show tables without executing a job

2014-12-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255154#comment-14255154 ] Cheng Lian commented on SPARK-2973: --- (Sorry for spamming the comments, experienced some

[jira] [Created] (SPARK-4914) Two sets of datanucleus versions left in lib_managed after running dev/run-tests

2014-12-21 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-4914: - Summary: Two sets of datanucleus versions left in lib_managed after running dev/run-tests Key: SPARK-4914 URL: https://issues.apache.org/jira/browse/SPARK-4914 Project:

[jira] [Created] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-4963: - Summary: SchemaRDD.sample may return wrong results Key: SPARK-4963 URL: https://issues.apache.org/jira/browse/SPARK-4963 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259313#comment-14259313 ] Cheng Lian commented on SPARK-4963: --- [~yanboliang] Unfortunately I don't have the

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260766#comment-14260766 ] Cheng Lian commented on SPARK-4963: --- [~yanboliang] Making {{HiveTableScan}} return

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

2014-12-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260790#comment-14260790 ] Cheng Lian commented on SPARK-4963: --- OK I agree. However the {{_.copy()}} call should be

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-01-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263516#comment-14263516 ] Cheng Lian commented on SPARK-1529: --- Hi [~srowen], first of all we are not trying to put

[jira] [Updated] (SPARK-5236) java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.MutableAny cannot be cast to org.apache.spark.sql.catalyst.expressions.MutableInt

2015-01-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5236: -- Description: {code} 15/01/14 05:39:27 WARN scheduler.TaskSetManager: Lost task 0.0 in stage 18.0 (TID

[jira] [Created] (SPARK-5538) CachedTableSuite failure due to unpersisting RDDs in a non-blocking way

2015-02-02 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5538: - Summary: CachedTableSuite failure due to unpersisting RDDs in a non-blocking way Key: SPARK-5538 URL: https://issues.apache.org/jira/browse/SPARK-5538 Project: Spark

[jira] [Created] (SPARK-5528) Support schema merging while reading Parquet files

2015-02-02 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5528: - Summary: Support schema merging while reading Parquet files Key: SPARK-5528 URL: https://issues.apache.org/jira/browse/SPARK-5528 Project: Spark Issue Type:

[jira] [Created] (SPARK-5553) Reimplement SQL binary type with more efficient data structure

2015-02-03 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5553: - Summary: Reimplement SQL binary type with more efficient data structure Key: SPARK-5553 URL: https://issues.apache.org/jira/browse/SPARK-5553 Project: Spark

[jira] [Commented] (SPARK-5325) Simplifying Hive shim implementation

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283181#comment-14283181 ] Cheng Lian commented on SPARK-5325: --- Some test cases in {{HiveCompatibilitySuite}} fail

[jira] [Updated] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5327: -- Description: Git commit: e7884bc950a374408959b6118efe2c62fbe50608 Run the following SBT session to

[jira] [Updated] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5327: -- Description: Git commit: e7884bc950a374408959b6118efe2c62fbe50608 Run the following SBT session to

[jira] [Created] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5327: - Summary: HiveCompatibilitySuite fails when executed against Hive 0.12.0 Key: SPARK-5327 URL: https://issues.apache.org/jira/browse/SPARK-5327 Project: Spark

[jira] [Commented] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283190#comment-14283190 ] Cheng Lian commented on SPARK-5327: --- Should add dedicated Jenkins builder for Hive

[jira] [Commented] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283471#comment-14283471 ] Cheng Lian commented on SPARK-5327: --- Good point, I'll add that. Thanks for reminding!

[jira] [Commented] (SPARK-5325) Simplifying Hive shim implementation

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283520#comment-14283520 ] Cheng Lian commented on SPARK-5325: --- Fixed in PR #4107 Simplifying Hive shim

[jira] [Updated] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5327: -- Description: Git commit: e7884bc950a374408959b6118efe2c62fbe50608 Run the following SBT session to

[jira] [Commented] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283436#comment-14283436 ] Cheng Lian commented on SPARK-5327: --- Would like to add that the reason why I'd like to

[jira] [Commented] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283434#comment-14283434 ] Cheng Lian commented on SPARK-5327: --- [~adrian-wang] Thanks for pointing out the {{.q}}

[jira] [Commented] (SPARK-5327) HiveCompatibilitySuite fails when executed against Hive 0.12.0

2015-01-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283458#comment-14283458 ] Cheng Lian commented on SPARK-5327: --- We've already had separate blacklist in the Hive

[jira] [Created] (SPARK-5325) Simplifying Hive shim implementation

2015-01-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5325: - Summary: Simplifying Hive shim implementation Key: SPARK-5325 URL: https://issues.apache.org/jira/browse/SPARK-5325 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5346) Parquet filter pushdown is not enabled when parquet.task.side.metadata is set to true (default value)

2015-01-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5346: -- Description: When computing Parquet splits, reading Parquet metadata from executor side is more memory

[jira] [Updated] (SPARK-5346) Parquet filter pushdown is not enabled when parquet.task.side.metadata is set to true (default value)

2015-01-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5346: -- Priority: Blocker (was: Critical) Parquet filter pushdown is not enabled when

[jira] [Created] (SPARK-5346) Parquet filter pushdown is not enabled when parquet.task.side.metadata is set to true (default value)

2015-01-21 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5346: - Summary: Parquet filter pushdown is not enabled when parquet.task.side.metadata is set to true (default value) Key: SPARK-5346 URL: https://issues.apache.org/jira/browse/SPARK-5346

[jira] [Updated] (SPARK-5346) Parquet filter pushdown is not enabled when parquet.task.side.metadata is set to true (default value)

2015-01-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5346: -- Description: When computing Parquet splits, reading Parquet metadata from executor side is more memory

[jira] [Commented] (SPARK-4553) query for parquet table with string fields in spark sql hive get binary result

2015-02-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316687#comment-14316687 ] Cheng Lian commented on SPARK-4553: --- We still need {{spark.sql.parquet.binaryAsString}}

[jira] [Created] (SPARK-5746) INSERT OVERWRITE throws FileNotFoundException when the source and destination point to the same table.

2015-02-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5746: - Summary: INSERT OVERWRITE throws FileNotFoundException when the source and destination point to the same table. Key: SPARK-5746 URL: https://issues.apache.org/jira/browse/SPARK-5746

[jira] [Commented] (SPARK-5746) INSERT OVERWRITE throws FileNotFoundException when the source and destination point to the same table.

2015-02-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316891#comment-14316891 ] Cheng Lian commented on SPARK-5746: --- cc [~yhuai] INSERT OVERWRITE throws

[jira] [Created] (SPARK-5751) First test case of HiveThriftServer2Suite sometimes timeouts

2015-02-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5751: - Summary: First test case of HiveThriftServer2Suite sometimes timeouts Key: SPARK-5751 URL: https://issues.apache.org/jira/browse/SPARK-5751 Project: Spark Issue

[jira] [Created] (SPARK-5777) Completes data source filter types and remove CatalystScan

2015-02-12 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5777: - Summary: Completes data source filter types and remove CatalystScan Key: SPARK-5777 URL: https://issues.apache.org/jira/browse/SPARK-5777 Project: Spark Issue

[jira] [Created] (SPARK-5767) Migrate Parquet data source to the write support of data source API

2015-02-12 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5767: - Summary: Migrate Parquet data source to the write support of data source API Key: SPARK-5767 URL: https://issues.apache.org/jira/browse/SPARK-5767 Project: Spark

[jira] [Commented] (SPARK-3365) Failure to save Lists to Parquet

2015-02-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317949#comment-14317949 ] Cheng Lian commented on SPARK-3365: --- Hey [~tianyi], please open a PR for this. However,

[jira] [Commented] (SPARK-3365) Failure to save Lists to Parquet

2015-02-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319505#comment-14319505 ] Cheng Lian commented on SPARK-3365: --- Actually, after rethinking about this, your

[jira] [Resolved] (SPARK-3365) Failure to save Lists to Parquet

2015-02-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-3365. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4581

[jira] [Commented] (SPARK-5751) Flaky test: o.a.s.sql.hive.thriftserver.HiveThriftServer2Suite sometimes times out

2015-02-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14327053#comment-14327053 ] Cheng Lian commented on SPARK-5751: --- Hey [~joshrosen], thanks for the investigation! I

[jira] [Resolved] (SPARK-5909) Add a clearCache command to Spark SQL's cache manager

2015-02-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5909. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4694

[jira] [Assigned] (SPARK-5918) Spark Thrift server reports metadata for VARCHAR column as STRING in result set schema

2015-02-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-5918: - Assignee: Cheng Lian Spark Thrift server reports metadata for VARCHAR column as STRING in

[jira] [Commented] (SPARK-5918) Spark Thrift server reports metadata for VARCHAR column as STRING in result set schema

2015-02-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328944#comment-14328944 ] Cheng Lian commented on SPARK-5918: --- When reading a Hive VARCHAR column, Spark SQL

[jira] [Commented] (SPARK-5446) Parquet column pruning should work for Map and Struct

2015-01-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294943#comment-14294943 ] Cheng Lian commented on SPARK-5446: --- No, I believe it's irrelevant. Parquet column

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

2015-01-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-4258: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-5463 NPE with new Parquet Filters

[jira] [Created] (SPARK-5463) Fix Parquet filter push-down

2015-01-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5463: - Summary: Fix Parquet filter push-down Key: SPARK-5463 URL: https://issues.apache.org/jira/browse/SPARK-5463 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-5346) Parquet filter pushdown is not enabled when parquet.task.side.metadata is set to true (default value)

2015-01-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5346: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-5463 Parquet filter pushdown is not enabled

[jira] [Commented] (SPARK-5463) Fix Parquet filter push-down

2015-01-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295902#comment-14295902 ] Cheng Lian commented on SPARK-5463: --- SPARK-4258 is fixed in Parquet master. SPARK-5451

[jira] [Closed] (SPARK-5346) Parquet filter pushdown is not enabled when parquet.task.side.metadata is set to true (default value)

2015-01-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-5346. - Resolution: Not a Problem I verified that filter push-down actually is enabled even if we set

[jira] [Created] (SPARK-5509) SQL relational operators doesn't handle binary type properly

2015-01-31 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5509: - Summary: SQL relational operators doesn't handle binary type properly Key: SPARK-5509 URL: https://issues.apache.org/jira/browse/SPARK-5509 Project: Spark Issue

[jira] [Commented] (SPARK-5236) java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.MutableAny cannot be cast to org.apache.spark.sql.catalyst.expressions.MutableInt

2015-01-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295571#comment-14295571 ] Cheng Lian commented on SPARK-5236: --- Yes, that's exactly what I meant to say, thanks :)

[jira] [Commented] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2015-01-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264469#comment-14264469 ] Cheng Lian commented on SPARK-4908: --- Would like to add a comment about the root cause of

[jira] [Created] (SPARK-5177) Add environment variables in dev/run-tests to enable Hive 0.12 and Scala 2.11 Jenkins builder

2015-01-09 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5177: - Summary: Add environment variables in dev/run-tests to enable Hive 0.12 and Scala 2.11 Jenkins builder Key: SPARK-5177 URL: https://issues.apache.org/jira/browse/SPARK-5177

[jira] [Commented] (SPARK-4296) Throw Expression not in GROUP BY when using same expression in group by clause and select clause

2015-01-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14276278#comment-14276278 ] Cheng Lian commented on SPARK-4296: --- Yeah, I think whenever we use expressions that are

[jira] [Commented] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313788#comment-14313788 ] Cheng Lian commented on SPARK-5671: --- Thanks, Josh. PR submitted. Bump jets3t version

[jira] [Issue Comment Deleted] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5671: -- Comment: was deleted (was: Thanks, Josh. PR submitted.) Bump jets3t version from 0.9.0 to 0.9.2 in

[jira] [Commented] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313790#comment-14313790 ] Cheng Lian commented on SPARK-5671: --- Thanks, Josh. PR submitted. Bump jets3t version

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313793#comment-14313793 ] Cheng Lian commented on SPARK-5700: --- Thanks, Josh. PR submitted. Bump jets3t version

[jira] [Issue Comment Deleted] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5700: -- Comment: was deleted (was: Thanks, Josh. PR submitted.) Bump jets3t version from 0.9.2 to 0.9.3 in

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313794#comment-14313794 ] Cheng Lian commented on SPARK-5700: --- Thanks, Josh. PR submitted. Bump jets3t version

[jira] [Resolved] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5700. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4499

[jira] [Resolved] (SPARK-5696) HiveThriftServer2Suite fails because of extra log4j.properties in the driver classpath

2015-02-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5696. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4484

[jira] [Resolved] (SPARK-5699) Thrift server test suites are not executed even if SQL code is touched

2015-02-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5699. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4486

[jira] [Commented] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313294#comment-14313294 ] Cheng Lian commented on SPARK-5700: --- Also, after upgrading JetS3t to 0.9.3, we can

[jira] [Updated] (SPARK-5592) java.net.URISyntaxException when insert data to a partitioned table

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5592: -- Assignee: wangfei java.net.URISyntaxException when insert data to a partitioned table

[jira] [Resolved] (SPARK-5592) java.net.URISyntaxException when insert data to a partitioned table

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5592. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4368

[jira] [Updated] (SPARK-5592) java.net.URISyntaxException when insert data to a partitioned table

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5592: -- Description: {code} create table sc as select * from (select '2011-01-11', '2011-01-11+14:18:26' from

[jira] [Created] (SPARK-5696) HiveThriftServer2Suite fails because of extra log4j.properties in the driver classpath

2015-02-09 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5696: - Summary: HiveThriftServer2Suite fails because of extra log4j.properties in the driver classpath Key: SPARK-5696 URL: https://issues.apache.org/jira/browse/SPARK-5696

[jira] [Updated] (SPARK-5696) HiveThriftServer2Suite fails because of extra log4j.properties in the driver classpath

2015-02-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5696: -- Affects Version/s: 1.3.0 HiveThriftServer2Suite fails because of extra log4j.properties in the driver

[jira] [Commented] (SPARK-5696) HiveThriftServer2Suite fails because of extra log4j.properties in the driver classpath

2015-02-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312974#comment-14312974 ] Cheng Lian commented on SPARK-5696: --- Jets3t 0.9.2 breaks {{HiveThriftServer2Suite}} as

[jira] [Commented] (SPARK-5696) HiveThriftServer2Suite fails because of extra log4j.properties in the driver classpath

2015-02-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313027#comment-14313027 ] Cheng Lian commented on SPARK-5696: --- Never mind, this issue is kinda like a butterfly

[jira] [Created] (SPARK-5700) Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

2015-02-09 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5700: - Summary: Bump jets3t version from 0.9.2 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles Key: SPARK-5700 URL: https://issues.apache.org/jira/browse/SPARK-5700 Project: Spark

[jira] [Created] (SPARK-5699) Thrift server test suites are not executed even if SQL code is touched

2015-02-09 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5699: - Summary: Thrift server test suites are not executed even if SQL code is touched Key: SPARK-5699 URL: https://issues.apache.org/jira/browse/SPARK-5699 Project: Spark

[jira] [Assigned] (SPARK-5699) Thrift server test suites are not executed even if SQL code is touched

2015-02-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-5699: - Assignee: Cheng Lian Thrift server test suites are not executed even if SQL code is touched

[jira] [Commented] (SPARK-5696) HiveThriftServer2Suite fails because of extra log4j.properties in the driver classpath

2015-02-09 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313110#comment-14313110 ] Cheng Lian commented on SPARK-5696: --- Thanks, Josh! Also delivered a fix to comfort

[jira] [Created] (SPARK-5725) ParquetRelation2.equals throws when compared with non-Parquet relations

2015-02-10 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-5725: - Summary: ParquetRelation2.equals throws when compared with non-Parquet relations Key: SPARK-5725 URL: https://issues.apache.org/jira/browse/SPARK-5725 Project: Spark

[jira] [Resolved] (SPARK-5725) ParquetRelation2.equals throws when compared with non-Parquet relations

2015-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5725. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4513

[jira] [Updated] (SPARK-5296) Predicate Pushdown (BaseRelation) to have an interface that will accept more filters

2015-02-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5296: -- Summary: Predicate Pushdown (BaseRelation) to have an interface that will accept more filters (was:

[jira] [Commented] (SPARK-5296) Predicate Pushdown (BaseRelation) to have an interface that will accept more filters

2015-02-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322550#comment-14322550 ] Cheng Lian commented on SPARK-5296: --- Nested AND/OR/NOT filters can be processed in a way

[jira] [Resolved] (SPARK-5767) Migrate Parquet data source to the write support of data source API

2015-02-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5767. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4563

[jira] [Resolved] (SPARK-4553) query for parquet table with string fields in spark sql hive get binary result

2015-02-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-4553. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4563

[jira] [Updated] (SPARK-5833) Adds REFRESH TABLE command to refresh external data sources tables

2015-02-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5833: -- Description: This command can be used to refresh (possibly cached) metadata stored in external data

[jira] [Commented] (SPARK-4908) Spark SQL built for Hive 13 fails under concurrent metadata queries

2015-01-07 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268894#comment-14268894 ] Cheng Lian commented on SPARK-4908: --- It was considered as a quick fix because we hadn't

[jira] [Commented] (SPARK-4963) SchemaRDD.sample may return wrong results

2015-01-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14269322#comment-14269322 ] Cheng Lian commented on SPARK-4963: --- Commented the PR, thanks for working on this!

[jira] [Commented] (SPARK-4850) GROUP BY can't work if the schema of SchemaRDD contains struct or array type

2015-01-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14264862#comment-14264862 ] Cheng Lian commented on SPARK-4850: --- [~debugger87] The query you provided in the

[jira] [Closed] (SPARK-4850) GROUP BY can't work if the schema of SchemaRDD contains struct or array type

2015-01-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-4850. - Resolution: Invalid Not a bug. GROUP BY can't work if the schema of SchemaRDD contains struct or array

[jira] [Resolved] (SPARK-4296) Throw Expression not in GROUP BY when using same expression in group by clause and select clause

2015-01-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-4296. --- Resolution: Duplicate Fix Version/s: 1.2.0 Target Version/s: 1.2.0 (was: 1.3.0)

[jira] [Reopened] (SPARK-4296) Throw Expression not in GROUP BY when using same expression in group by clause and select clause

2015-01-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reopened SPARK-4296: --- Sorry, missed David's comment below. Throw Expression not in GROUP BY when using same expression in

[jira] [Resolved] (SPARK-5846) Spark SQL does not correctly set job description and scheduler pool

2015-02-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-5846. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4630

[jira] [Updated] (SPARK-2472) Spark SQL Thrift server sometimes assigns wrong job group name

2015-02-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2472: -- Fix Version/s: 1.2.2 1.3.0 Spark SQL Thrift server sometimes assigns wrong job

[jira] [Updated] (SPARK-5846) Spark SQL does not correctly set job description and scheduler pool

2015-02-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5846: -- Fix Version/s: 1.2.2 Spark SQL does not correctly set job description and scheduler pool

[jira] [Commented] (SPARK-2472) Spark SQL Thrift server sometimes assigns wrong job group name

2015-02-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326893#comment-14326893 ] Cheng Lian commented on SPARK-2472: --- This ticket is fixed by

[jira] [Resolved] (SPARK-2472) Spark SQL Thrift server sometimes assigns wrong job group name

2015-02-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-2472. --- Resolution: Fixed Assignee: Kay Ousterhout Target Version/s: 1.3.0 (was: 1.4.0)

[jira] [Commented] (SPARK-5463) Fix Parquet filter push-down

2015-02-18 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326902#comment-14326902 ] Cheng Lian commented on SPARK-5463: --- No, the new release hasn't been cut yet. Fix

<    1   2   3   4   5   6   7   8   9   10   >