[jira] [Created] (SPARK-1402) 3 more compression algorithms for in-memory columnar storage

2014-04-02 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-1402: - Summary: 3 more compression algorithms for in-memory columnar storage Key: SPARK-1402 URL: https://issues.apache.org/jira/browse/SPARK-1402 Project: Spark Issue

[jira] [Commented] (SPARK-1402) 3 more compression algorithms for in-memory columnar storage

2014-04-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13960937#comment-13960937 ] Cheng Lian commented on SPARK-1402: --- Corresponding PR:

[jira] [Updated] (SPARK-1429) Spark shell fails to start after sbt clean assemble-deps package

2014-04-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1429: -- Description: After Hive assembly is added into account in compute-classpath.sh, Spark shell fails to

[jira] [Updated] (SPARK-1429) Spark shell fails to start after sbt clean assemble-deps package

2014-04-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1429: -- Description: After Hive assembly is added into account in compute-classpath.sh, Spark shell fails to

[jira] [Created] (SPARK-1513) Specialized ColumnType for Timestamp

2014-04-16 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-1513: - Summary: Specialized ColumnType for Timestamp Key: SPARK-1513 URL: https://issues.apache.org/jira/browse/SPARK-1513 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-1521) Take character set size into account when compressing in-memory string columns

2014-04-17 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-1521: - Summary: Take character set size into account when compressing in-memory string columns Key: SPARK-1521 URL: https://issues.apache.org/jira/browse/SPARK-1521 Project:

[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2014-04-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975914#comment-13975914 ] Cheng Lian commented on SPARK-1529: --- After some investigation, I came to the conclusion

[jira] [Created] (SPARK-1669) SQLContext.cacheTable() should be idempotent

2014-04-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-1669: - Summary: SQLContext.cacheTable() should be idempotent Key: SPARK-1669 URL: https://issues.apache.org/jira/browse/SPARK-1669 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-1671) Cached tables should follow write-through policy

2014-04-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-1671: - Summary: Cached tables should follow write-through policy Key: SPARK-1671 URL: https://issues.apache.org/jira/browse/SPARK-1671 Project: Spark Issue Type:

[jira] [Commented] (SPARK-1678) Compression loses repeated values.

2014-04-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986348#comment-13986348 ] Cheng Lian commented on SPARK-1678: --- Pull request:

[jira] [Commented] (SPARK-1679) In-Memory compression needs to be configurable.

2014-04-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986347#comment-13986347 ] Cheng Lian commented on SPARK-1679: --- Pull request:

[jira] [Updated] (SPARK-975) Spark Replay Debugger

2014-04-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-975: - Attachment: RDD DAG.png Drawback of GraphViz Spark Replay Debugger -

[jira] [Commented] (SPARK-975) Spark Replay Debugger

2014-05-01 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986511#comment-13986511 ] Cheng Lian commented on SPARK-975: -- Thanks for being willing to help [~sarutak]! Actually

[jira] [Created] (SPARK-1694) Simplify ColumnBuilder/Accessor class hierarchy

2014-05-01 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-1694: - Summary: Simplify ColumnBuilder/Accessor class hierarchy Key: SPARK-1694 URL: https://issues.apache.org/jira/browse/SPARK-1694 Project: Spark Issue Type:

[jira] [Updated] (SPARK-1669) SQLContext.cacheTable() should be idempotent

2014-05-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1669: -- Description: Calling {{cacheTable()}} on some table {{t}} multiple times causes table {{t}} to be

[jira] [Commented] (SPARK-1368) HiveTableScan is slow

2014-05-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998619#comment-13998619 ] Cheng Lian commented on SPARK-1368: --- Corresponding PR:

[jira] [Commented] (SPARK-1913) column pruning problem of Parquet File

2014-05-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007026#comment-14007026 ] Cheng Lian commented on SPARK-1913: --- Attributes referenced only in those filters that

[jira] [Updated] (SPARK-1913) column pruning problem of Parquet File

2014-05-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1913: -- Description: When scanning Parquet tables, attributes referenced only in predicates that are pushed

[jira] [Updated] (SPARK-1913) column pruning problem of Parquet File

2014-05-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1913: -- Description: When scanning Parquet tables, attributes referenced only in predicates that are pushed

[jira] [Updated] (SPARK-1913) Column pruning for Parquet table

2014-05-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1913: -- Description: When scanning Parquet tables, attributes referenced only in predicates that are pushed

[jira] [Updated] (SPARK-1913) Column pruning for Parquet table

2014-05-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1913: -- Summary: Column pruning for Parquet table (was: column pruning problem of Parquet File) Column

[jira] [Commented] (SPARK-1914) Simplify CountFunction not to traverse to evaluate all child expressions.

2014-05-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008629#comment-14008629 ] Cheng Lian commented on SPARK-1914: --- Added steps to reproduce this bug in {{sbt

[jira] [Updated] (SPARK-1914) Simplify CountFunction not to traverse to evaluate all child expressions.

2014-05-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1914: -- Description: {{CountFunction}} should count up only if the child's evaluated value is not null.

[jira] [Updated] (SPARK-1915) AverageFunction should not count if the evaluated value is null.

2014-05-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1915: -- Description: Average values are difference between the calculation is done partially or not

[jira] [Commented] (SPARK-1915) AverageFunction should not count if the evaluated value is null.

2014-05-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010521#comment-14010521 ] Cheng Lian commented on SPARK-1915: --- Added bug reproduction steps. AverageFunction

[jira] [Created] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA

2014-05-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-1948: - Summary: Scalac crashes when building Spark in IntelliJ IDEA Key: SPARK-1948 URL: https://issues.apache.org/jira/browse/SPARK-1948 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA

2014-05-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-1948: -- Attachment: scalac-crash.log Scalac crashes when building Spark in IntelliJ IDEA

[jira] [Created] (SPARK-1959) String NULL is interpreted as null value

2014-05-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-1959: - Summary: String NULL is interpreted as null value Key: SPARK-1959 URL: https://issues.apache.org/jira/browse/SPARK-1959 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1959) String NULL is interpreted as null value

2014-05-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012031#comment-14012031 ] Cheng Lian commented on SPARK-1959: --- The problematic line should be [this

[jira] [Commented] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA

2014-05-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012366#comment-14012366 ] Cheng Lian commented on SPARK-1948: --- Hi [~sowen], thanks for the suggestion! I tried to

[jira] [Commented] (SPARK-1958) Calling .collect() on a SchemaRDD should call executeCollect() on the underlying query plan.

2014-06-01 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015158#comment-14015158 ] Cheng Lian commented on SPARK-1958: --- PR: https://github.com/apache/spark/pull/939

[jira] [Commented] (SPARK-1968) SQL commands for caching tables

2014-06-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026982#comment-14026982 ] Cheng Lian commented on SPARK-1968: --- PR: https://github.com/apache/spark/pull/1038 SQL

[jira] [Commented] (SPARK-2094) Ensure exactly once semantics for DDL / Commands

2014-06-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026989#comment-14026989 ] Cheng Lian commented on SPARK-2094: --- The basic idea is illustrated in

[jira] [Comment Edited] (SPARK-2081) Undefine output() from the abstract class Command and implement it in concrete subclasses

2014-06-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028245#comment-14028245 ] Cheng Lian edited comment on SPARK-2081 at 6/11/14 7:12 PM: To

[jira] [Created] (SPARK-2129) NPE thrown while lookup a view

2014-06-12 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2129: - Summary: NPE thrown while lookup a view Key: SPARK-2129 URL: https://issues.apache.org/jira/browse/SPARK-2129 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-2129) NPE thrown while lookup a view

2014-06-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2129: -- Description: {code} scala hql(create table t1(key int, value string)) ... scala hql(create view v as

[jira] [Commented] (SPARK-2129) NPE thrown while lookup a view

2014-06-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14029736#comment-14029736 ] Cheng Lian commented on SPARK-2129: --- Removed these two test cases in this PR:

[jira] [Created] (SPARK-2263) Can't insert MapK, V values to Hive tables

2014-06-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2263: - Summary: Can't insert MapK, V values to Hive tables Key: SPARK-2263 URL: https://issues.apache.org/jira/browse/SPARK-2263 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2263) Can't insert MapK, V values to Hive tables

2014-06-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042941#comment-14042941 ] Cheng Lian commented on SPARK-2263: --- PR: https://github.com/apache/spark/pull/1205

[jira] [Created] (SPARK-2283) PruningSuite fails if run right after HiveCompatibilitySuite

2014-06-25 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2283: - Summary: PruningSuite fails if run right after HiveCompatibilitySuite Key: SPARK-2283 URL: https://issues.apache.org/jira/browse/SPARK-2283 Project: Spark Issue

[jira] [Created] (SPARK-2422) Spark SQL migration guide for Shark users

2014-07-09 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2422: - Summary: Spark SQL migration guide for Shark users Key: SPARK-2422 URL: https://issues.apache.org/jira/browse/SPARK-2422 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-2410) Thrift/JDBC Server

2014-07-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14060388#comment-14060388 ] Cheng Lian commented on SPARK-2410: --- PR: https://github.com/apache/spark/pull/1399

[jira] [Created] (SPARK-2472) Spark SQL Thrift server sometimes assigns wrong job group name

2014-07-14 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2472: - Summary: Spark SQL Thrift server sometimes assigns wrong job group name Key: SPARK-2472 URL: https://issues.apache.org/jira/browse/SPARK-2472 Project: Spark

[jira] [Commented] (SPARK-2136) Spark SQL does not disply the job description on web ui/ event log

2014-07-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14060466#comment-14060466 ] Cheng Lian commented on SPARK-2136: --- The Thrift server has already supported this.

[jira] [Commented] (SPARK-2190) Specialized ColumnType for Timestamp

2014-07-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063431#comment-14063431 ] Cheng Lian commented on SPARK-2190: --- PR https://github.com/apache/spark/pull/1440

[jira] [Updated] (SPARK-2537) Workaround Timezone specific Hive tests

2014-07-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2537: -- Description: Several Hive tests in {{HiveCompatibilitySuite}} are timezone sensitive: -

[jira] [Updated] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

2014-07-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2551: -- Description: To workaround [PARQUET-16|https://issues.apache.org/jira/browse/PARQUET-16] and fix

[jira] [Created] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

2014-07-17 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2551: - Summary: Cleanup FilteringParquetRowInputFormat Key: SPARK-2551 URL: https://issues.apache.org/jira/browse/SPARK-2551 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2119) Reading Parquet InputSplits dominates query execution time when reading off S3

2014-07-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064701#comment-14064701 ] Cheng Lian commented on SPARK-2119: --- Agree. Created SPARK-2551 for removing those

[jira] [Created] (SPARK-2554) CountDistinct and SumDistinct should do partial aggregation

2014-07-17 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2554: - Summary: CountDistinct and SumDistinct should do partial aggregation Key: SPARK-2554 URL: https://issues.apache.org/jira/browse/SPARK-2554 Project: Spark Issue

[jira] [Updated] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

2014-07-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2551: -- Issue Type: Improvement (was: Bug) Cleanup FilteringParquetRowInputFormat

[jira] [Created] (SPARK-2589) Support HAVING clause generated by Tableau

2014-07-18 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2589: - Summary: Support HAVING clause generated by Tableau Key: SPARK-2589 URL: https://issues.apache.org/jira/browse/SPARK-2589 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2591) Add config property to disable incremental collection used in Thrift server

2014-07-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2591: - Summary: Add config property to disable incremental collection used in Thrift server Key: SPARK-2591 URL: https://issues.apache.org/jira/browse/SPARK-2591 Project: Spark

[jira] [Created] (SPARK-2592) Make CACHE TABLE statement eager

2014-07-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2592: - Summary: Make CACHE TABLE statement eager Key: SPARK-2592 URL: https://issues.apache.org/jira/browse/SPARK-2592 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-975) Spark Replay Debugger

2014-07-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071232#comment-14071232 ] Cheng Lian commented on SPARK-975: -- Hey [~phuocd], that image actually shows exactly the

[jira] [Commented] (SPARK-975) Spark Replay Debugger

2014-07-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071273#comment-14071273 ] Cheng Lian commented on SPARK-975: -- [~phuocd] Yea, exactly :) Spark Replay Debugger

[jira] [Commented] (SPARK-975) Spark Replay Debugger

2014-07-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071275#comment-14071275 ] Cheng Lian commented on SPARK-975: -- No it doesn't. I chose rectangles just because more

[jira] [Commented] (SPARK-975) Spark Replay Debugger

2014-07-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071284#comment-14071284 ] Cheng Lian commented on SPARK-975: -- Red lines indicate wide dependencies (shuffles are

[jira] [Updated] (SPARK-2678) `Spark-submit` overrides user application options

2014-07-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2678: -- Priority: Major (was: Minor) `Spark-submit` overrides user application options

[jira] [Created] (SPARK-2705) Wrong stage description in Web UI

2014-07-27 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2705: - Summary: Wrong stage description in Web UI Key: SPARK-2705 URL: https://issues.apache.org/jira/browse/SPARK-2705 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2705) Wrong stage description in Web UI

2014-07-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075609#comment-14075609 ] Cheng Lian commented on SPARK-2705: --- PR: https://github.com/apache/spark/pull/1524

[jira] [Commented] (SPARK-2729) Forgot to match Timestamp type in ColumnBuilder

2014-07-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080624#comment-14080624 ] Cheng Lian commented on SPARK-2729: --- Steps to reproduce this bug within {{sbt -Phive

[jira] [Created] (SPARK-2814) HiveThriftServer throws NPE when executing native commands

2014-08-03 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2814: - Summary: HiveThriftServer throws NPE when executing native commands Key: SPARK-2814 URL: https://issues.apache.org/jira/browse/SPARK-2814 Project: Spark Issue

[jira] [Updated] (SPARK-2814) HiveThriftServer throws NPE when executing native commands

2014-08-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2814: -- Description: After [PR #1686|https://github.com/apache/spark/pull/1686], {{HiveThriftServer2}} throws

[jira] [Commented] (SPARK-2650) Wrong initial sizes for in-memory column buffers

2014-08-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084397#comment-14084397 ] Cheng Lian commented on SPARK-2650: --- Did some experiments and came to some conclusions:

[jira] [Commented] (SPARK-2650) Wrong initial sizes for in-memory column buffers

2014-08-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085104#comment-14085104 ] Cheng Lian commented on SPARK-2650: --- Some additional comments after more experiments and

[jira] [Comment Edited] (SPARK-2650) Wrong initial sizes for in-memory column buffers

2014-08-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085104#comment-14085104 ] Cheng Lian edited comment on SPARK-2650 at 8/4/14 7:14 PM: --- Some

[jira] [Updated] (SPARK-2650) Wrong initial sizes for in-memory column buffers

2014-08-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2650: -- Target Version/s: 1.2.0 (was: 1.1.0) Wrong initial sizes for in-memory column buffers

[jira] [Created] (SPARK-2874) Spark SQL related scripts don't show complete usage message

2014-08-05 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2874: - Summary: Spark SQL related scripts don't show complete usage message Key: SPARK-2874 URL: https://issues.apache.org/jira/browse/SPARK-2874 Project: Spark Issue

[jira] [Updated] (SPARK-2590) Add config property to disable incremental collection used in Thrift server

2014-08-08 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-2590: -- Description: {{SparkSQLOperationManager}} uses {{RDD.toLocalIterator}} to collect the result set one

[jira] [Created] (SPARK-2929) Rewrite HiveThriftServer2Suite and CliSuite

2014-08-08 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-2929: - Summary: Rewrite HiveThriftServer2Suite and CliSuite Key: SPARK-2929 URL: https://issues.apache.org/jira/browse/SPARK-2929 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2970) spark-sql script ends with IOException when EventLogging is enabled

2014-08-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092860#comment-14092860 ] Cheng Lian commented on SPARK-2970: --- [~sarutak] Would you mind to update the issue

[jira] [Comment Edited] (SPARK-2963) There no documentation about building to use HiveServer and CLI for SparkSQL

2014-08-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092889#comment-14092889 ] Cheng Lian edited comment on SPARK-2963 at 8/11/14 3:31 PM:

[jira] [Created] (SPARK-3004) HiveThriftServer2 throws exception when the result set contains NULL

2014-08-13 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3004: - Summary: HiveThriftServer2 throws exception when the result set contains NULL Key: SPARK-3004 URL: https://issues.apache.org/jira/browse/SPARK-3004 Project: Spark

[jira] [Created] (SPARK-3013) Doctest of inferSchema in Spark SQL Python API fails

2014-08-13 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3013: - Summary: Doctest of inferSchema in Spark SQL Python API fails Key: SPARK-3013 URL: https://issues.apache.org/jira/browse/SPARK-3013 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-3062) ShutdownHookManager is only available in Hadoop 2.x

2014-08-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3062: - Summary: ShutdownHookManager is only available in Hadoop 2.x Key: SPARK-3062 URL: https://issues.apache.org/jira/browse/SPARK-3062 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3064) It would be very useful to specifies line terminate when use the textFile function

2014-08-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098388#comment-14098388 ] Cheng Lian commented on SPARK-3064: --- {{SparkContext.textFile}} uses {{TextInputFormat}}

[jira] [Commented] (SPARK-975) Spark Replay Debugger

2014-08-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100239#comment-14100239 ] Cheng Lian commented on SPARK-975: -- Usually we just filter them out by checking

[jira] [Created] (SPARK-3126) HiveThriftServer2Suite hangs

2014-08-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3126: - Summary: HiveThriftServer2Suite hangs Key: SPARK-3126 URL: https://issues.apache.org/jira/browse/SPARK-3126 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-3127) Modifying Spark SQL related scripts should trigger Spark SQL test suites

2014-08-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3127: - Summary: Modifying Spark SQL related scripts should trigger Spark SQL test suites Key: SPARK-3127 URL: https://issues.apache.org/jira/browse/SPARK-3127 Project: Spark

[jira] [Commented] (SPARK-2929) Rewrite HiveThriftServer2Suite and CliSuite

2014-08-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14102370#comment-14102370 ] Cheng Lian commented on SPARK-2929: --- Opened SPARK-3126 SPARK-3127 to track failure of

[jira] [Created] (SPARK-3214) Argument parsing loop in make-distribution.sh ends prematurely

2014-08-25 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3214: - Summary: Argument parsing loop in make-distribution.sh ends prematurely Key: SPARK-3214 URL: https://issues.apache.org/jira/browse/SPARK-3214 Project: Spark

[jira] [Commented] (SPARK-3214) Argument parsing loop in make-distribution.sh ends prematurely

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109765#comment-14109765 ] Cheng Lian commented on SPARK-3214: --- Didn't realize all Maven options must go after

[jira] [Closed] (SPARK-3214) Argument parsing loop in make-distribution.sh ends prematurely

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-3214. - Resolution: Not a Problem Argument parsing loop in make-distribution.sh ends prematurely

[jira] [Created] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3217: - Summary: Shaded Guava jar doesn't play well with Maven build Key: SPARK-3217 URL: https://issues.apache.org/jira/browse/SPARK-3217 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Affects Version/s: (was: 1.0.2) Shaded Guava jar doesn't play well with Maven build

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Labels: 1.2.0 (was: ) Shaded Guava jar doesn't play well with Maven build

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Target Version/s: 1.2.0 (was: 1.1.0) Shaded Guava jar doesn't play well with Maven build

[jira] [Commented] (SPARK-2921) Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110127#comment-14110127 ] Cheng Lian commented on SPARK-2921: --- [~andrewor14] {{spark.executor.extraLibraryPath}}

[jira] [Commented] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build

2014-08-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110142#comment-14110142 ] Cheng Lian commented on SPARK-3217: --- [~vanzin] Thanks, I did set

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build when SPARK_PREPEND_CLASSES is set

2014-08-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Summary: Shaded Guava jar doesn't play well with Maven build when SPARK_PREPEND_CLASSES is set (was:

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build when SPARK_PREPEND_CLASSES is set

2014-08-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Description: PR [#1813|https://github.com/apache/spark/pull/1813] shaded Guava jar file and moved

[jira] [Updated] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build when SPARK_PREPEND_CLASSES is set

2014-08-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3217: -- Priority: Major (was: Blocker) Shaded Guava jar doesn't play well with Maven build when

[jira] [Commented] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build when SPARK_PREPEND_CLASSES is set

2014-08-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1438#comment-1438 ] Cheng Lian commented on SPARK-3217: --- [~vanzin] Verified locally, everything is OK after

[jira] [Created] (SPARK-3234) SPARK_HADOOP_VERSION doesn't have a valid value by default in make-distribution.sh

2014-08-26 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3234: - Summary: SPARK_HADOOP_VERSION doesn't have a valid value by default in make-distribution.sh Key: SPARK-3234 URL: https://issues.apache.org/jira/browse/SPARK-3234 Project:

[jira] [Created] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3269: - Summary: SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set Key: SPARK-3269 URL: https://issues.apache.org/jira/browse/SPARK-3269 Project: Spark

[jira] [Updated] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3269: -- Target Version/s: 1.1.0 (was: 1.1.1) SparkSQLOperationManager.getNextRowSet OOMs when a large

[jira] [Updated] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3269: -- Affects Version/s: (was: 1.2.0) (was: 1.1.0)

[jira] [Updated] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-27 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3269: -- Description: {{SparkSQLOperationManager.getNextRowSet}} allocates an {{ArrayBuffer[Row]}} as large as

[jira] [Updated] (SPARK-3277) LZ4 compression cause the the ExternalSort exception

2014-08-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3277: -- Fix Version/s: (was: 1.1.0) LZ4 compression cause the the ExternalSort exception

  1   2   3   4   5   6   7   8   9   10   >