[jira] [Comment Edited] (SPARK-19222) Limit Query Performance issue

2017-01-15 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823389#comment-15823389 ] Yadong Qi edited comment on SPARK-19222 at 1/16/17 2:56 AM: Hi [~maropu],

[jira] [Commented] (SPARK-19222) Limit Query Performance issue

2017-01-15 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823389#comment-15823389 ] Yadong Qi commented on SPARK-19222: --- Hi [~maropu], sample means `TABLESAMPLE(x ROWS)` or `TABLESAMPLE(x

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReuseExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-17425: -- Summary: Override sameResult in HiveTableScanExec to make ReuseExchange work in text format table

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-17425: -- Description: When I run the below SQL(table src is text format): {code:sql} SELECT * FROM src t1 JOIN

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-17425: -- Description: When I run the below SQL(table src is text format): {code:sql} SELECT 1 FROM src t1 JOIN

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-17425: -- Description: When I run the below SQL(table src is text format): {code:sql} SELECT 1 FROM src t1 JOIN

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-17425: -- Description: When I run the below SQL(table src is text format): {code:sql} SELECT 1 FROM src t1 JOIN

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-17425: -- Description: When I run the below SQL(table src is text format): {code:sql} SELECT 1 FROM src t1 JOIN

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-17425: -- Affects Version/s: 2.0.0 Component/s: SQL > Override sameResult in HiveTableScanExec to make

[jira] [Created] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-17425: - Summary: Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table Key: SPARK-17425 URL: https://issues.apache.org/jira/browse/SPARK-17425

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReusedExchange work in text format table

2016-09-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-17425: -- Description: When I run the below SQL(table src is text format): {code:sql} select 1 from src t1 join

[jira] [Created] (SPARK-17358) Cached table(parquet/orc) should be shard between beelines

2016-09-01 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-17358: - Summary: Cached table(parquet/orc) should be shard between beelines Key: SPARK-17358 URL: https://issues.apache.org/jira/browse/SPARK-17358 Project: Spark Issue

[jira] [Updated] (SPARK-15549) Disable bucketing when the output doesn't contain all bucketing columns

2016-05-27 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-15549: -- Summary: Disable bucketing when the output doesn't contain all bucketing columns (was: Bucket column

[jira] [Updated] (SPARK-15549) Bucket column only need to be found in the output of relation when use bucketed table

2016-05-26 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-15549: -- Issue Type: Bug (was: Improvement) > Bucket column only need to be found in the output of relation

[jira] [Updated] (SPARK-15549) Bucket column only need to be found in the output of relation when use bucketed table

2016-05-26 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-15549: -- Summary: Bucket column only need to be found in the output of relation when use bucketed table (was:

[jira] [Updated] (SPARK-15549) Bucket column only need to be found in the output relation when use bucketed table

2016-05-26 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-15549: -- Summary: Bucket column only need to be found in the output relation when use bucketed table (was:

[jira] [Updated] (SPARK-15549) Bucket column only need to find in relation when use bucketed table

2016-05-26 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-15549: -- Description: I create a bucketed table test(i int, j int, k int) with bucket column i, {code:java}

[jira] [Updated] (SPARK-15549) Bucket column only need to find in relation when use bucketed table

2016-05-26 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-15549: -- Description: I create a bucketed table test(i int, j int, k int) with bucket column i, {code:scala}

[jira] [Updated] (SPARK-15549) Bucket column only need to find in relation when use bucketed table

2016-05-26 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-15549: -- Description: I create a bucketed table test(i int, j int, k int) with bucket column i, {code:scala}

[jira] [Created] (SPARK-15549) Bucket column only need to find in relation when use bucketed table

2016-05-26 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-15549: - Summary: Bucket column only need to find in relation when use bucketed table Key: SPARK-15549 URL: https://issues.apache.org/jira/browse/SPARK-15549 Project: Spark

[jira] [Updated] (SPARK-15549) Bucket column only need to find in relation when use bucketed table

2016-05-26 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-15549: -- Description: I create a bucketed table test(i int, j int, k int) with bucket column i, {code:scala}

[jira] [Updated] (SPARK-12352) Reuse the result of split in SQL

2015-12-15 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-12352: -- Description: When use split in sql, if we want to get the different value through index from same

[jira] [Created] (SPARK-12352) Reuse the result of split in SQL

2015-12-15 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-12352: - Summary: Reuse the result of split in SQL Key: SPARK-12352 URL: https://issues.apache.org/jira/browse/SPARK-12352 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-12352) Reuse the result of split in SQL

2015-12-15 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-12352: -- Priority: Critical (was: Major) > Reuse the result of split in SQL >

[jira] [Created] (SPARK-12317) Value should be configurated with unit(e.g. kb/mb/gb) in SQL

2015-12-13 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-12317: - Summary: Value should be configurated with unit(e.g. kb/mb/gb) in SQL Key: SPARK-12317 URL: https://issues.apache.org/jira/browse/SPARK-12317 Project: Spark

[jira] [Updated] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-13 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-12317: -- Summary: Support configurate value with unit(e.g. kb/mb/gb) in SQL (was: Value should be configurated

[jira] [Created] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-12167: - Summary: Invoke the right sameResult function when plan is warpped with SubQueries Key: SPARK-12167 URL: https://issues.apache.org/jira/browse/SPARK-12167 Project: Spark

[jira] [Commented] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044488#comment-15044488 ] Yadong Qi commented on SPARK-12167: --- SPARK-11246 has already fixed it > Invoke the right sameResult

[jira] [Closed] (SPARK-12167) Invoke the right sameResult function when plan is warpped with SubQueries

2015-12-06 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi closed SPARK-12167. - Resolution: Duplicate > Invoke the right sameResult function when plan is warpped with SubQueries >

[jira] [Created] (SPARK-12093) Fix the error of comment in DDLParser

2015-12-02 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-12093: - Summary: Fix the error of comment in DDLParser Key: SPARK-12093 URL: https://issues.apache.org/jira/browse/SPARK-12093 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-11580) Just do final aggregation when there is no Exchange

2015-11-08 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-11580: - Summary: Just do final aggregation when there is no Exchange Key: SPARK-11580 URL: https://issues.apache.org/jira/browse/SPARK-11580 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11580) Just do final aggregation when there is no Exchange

2015-11-08 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-11580: -- Description: I do the SQL as below: {code} cache table src as select * from src distribute by key;

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

2015-09-12 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742070#comment-14742070 ] Yadong Qi commented on SPARK-9213: -- [~rxin] I'm working on this, and already have a pull request as you

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

2015-09-12 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742070#comment-14742070 ] Yadong Qi edited comment on SPARK-9213 at 9/12/15 2:29 PM: --- [~rxin] I'm working

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

2015-09-12 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742070#comment-14742070 ] Yadong Qi edited comment on SPARK-9213 at 9/12/15 2:41 PM: --- [~rxin] I'm working

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

2015-09-12 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742070#comment-14742070 ] Yadong Qi edited comment on SPARK-9213 at 9/12/15 2:42 PM: --- [~rxin] I'm working

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-14 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696561#comment-14696561 ] Yadong Qi commented on SPARK-9213: -- [~rxin] Yes, I will do it as below: ``` case class

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-14 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696630#comment-14696630 ] Yadong Qi commented on SPARK-9213: -- I know, thanks! Improve regular expression

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-14 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696561#comment-14696561 ] Yadong Qi edited comment on SPARK-9213 at 8/14/15 6:34 AM: ---

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-14 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696561#comment-14696561 ] Yadong Qi edited comment on SPARK-9213 at 8/14/15 6:33 AM: ---

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-14 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696595#comment-14696595 ] Yadong Qi commented on SPARK-9213: -- [~rxin] There're many place use Like, It does not

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-13 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694928#comment-14694928 ] Yadong Qi commented on SPARK-9213: -- [~rxin] Use Joni regex instead of java regex, or add

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-13 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694928#comment-14694928 ] Yadong Qi edited comment on SPARK-9213 at 8/13/15 9:23 AM: ---

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-13 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696325#comment-14696325 ] Yadong Qi commented on SPARK-9213: -- 1. Use Joni regex instead of Java regex, I only need

[jira] [Updated] (SPARK-8813) Combine files when there're many small files in table

2015-08-12 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8813: - Summary: Combine files when there're many small files in table (was: Combine files when there're many

[jira] [Updated] (SPARK-8813) Combine files when there're many small files in tables

2015-08-12 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8813: - Summary: Combine files when there're many small files in tables (was: Support combine text/parquet

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-11 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681684#comment-14681684 ] Yadong Qi commented on SPARK-9213: -- Reynold Xin I will work on this. Improve regular

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-11 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681684#comment-14681684 ] Yadong Qi edited comment on SPARK-9213 at 8/11/15 11:53 AM:

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

2015-08-11 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681684#comment-14681684 ] Yadong Qi edited comment on SPARK-9213 at 8/11/15 12:08 PM:

[jira] [Created] (SPARK-9737) Add the suggested configuration when required executor memory is above the max threshold of this cluster on YARN mode

2015-08-07 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-9737: Summary: Add the suggested configuration when required executor memory is above the max threshold of this cluster on YARN mode Key: SPARK-9737 URL:

[jira] [Created] (SPARK-9189) Takes locality and the sum of partition length into account when partition is instance of HadoopPartition in operator coalesce

2015-07-20 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-9189: Summary: Takes locality and the sum of partition length into account when partition is instance of HadoopPartition in operator coalesce Key: SPARK-9189 URL:

[jira] [Created] (SPARK-8813) Support combine text/parquet format file in SQL.

2015-07-03 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-8813: Summary: Support combine text/parquet format file in SQL. Key: SPARK-8813 URL: https://issues.apache.org/jira/browse/SPARK-8813 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8813) Support combine text/parquet format file in SQL

2015-07-03 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8813: - Summary: Support combine text/parquet format file in SQL (was: Support combine text/parquet format file

[jira] [Created] (SPARK-8812) Support combine text/parquet format file in sql

2015-07-03 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-8812: Summary: Support combine text/parquet format file in sql Key: SPARK-8812 URL: https://issues.apache.org/jira/browse/SPARK-8812 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8650) Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8650: - Affects Version/s: 1.4.0 Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2

[jira] [Created] (SPARK-8650) Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-8650: Summary: Use spark.app.name priority when in SparkSQLCLIDriver or HiveThriftServer2 Key: SPARK-8650 URL: https://issues.apache.org/jira/browse/SPARK-8650 Project: Spark

[jira] [Updated] (SPARK-8650) Use the user-specified app name priority in SparkSQLCLIDriver or HiveThriftServer2

2015-06-25 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-8650: - Summary: Use the user-specified app name priority in SparkSQLCLIDriver or HiveThriftServer2 (was: Use

[jira] [Created] (SPARK-7968) Rename minPartitions to maxPartitions in wholeTextFiles/binaryFiles

2015-05-30 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-7968: Summary: Rename minPartitions to maxPartitions in wholeTextFiles/binaryFiles Key: SPARK-7968 URL: https://issues.apache.org/jira/browse/SPARK-7968 Project: Spark

[jira] [Closed] (SPARK-7024) Improve performance of function containsStar

2015-05-03 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi closed SPARK-7024. Resolution: Not A Problem Improve performance of function containsStar

[jira] [Created] (SPARK-7024) Improve performance of function containsStar

2015-04-20 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-7024: Summary: Improve performance of function containsStar Key: SPARK-7024 URL: https://issues.apache.org/jira/browse/SPARK-7024 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-6583) Support aggregated function in order by

2015-03-28 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-6583: Summary: Support aggregated function in order by Key: SPARK-6583 URL: https://issues.apache.org/jira/browse/SPARK-6583 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-6397) Check the missingInput simply

2015-03-18 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-6397: Summary: Check the missingInput simply Key: SPARK-6397 URL: https://issues.apache.org/jira/browse/SPARK-6397 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-6356) Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

2015-03-16 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-6356: Summary: Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext Key: SPARK-6356 URL: https://issues.apache.org/jira/browse/SPARK-6356 Project: Spark Issue

[jira] [Updated] (SPARK-6356) Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

2015-03-16 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-6356: - Description: Support for the expression below: ``` GROUP BY expression list WITH ROLLUP GROUP BY

[jira] [Updated] (SPARK-6356) Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

2015-03-16 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-6356: - Description: Support for the expression below: ``` GROUP BY expression list WITH ROLLUP GROUP BY

[jira] [Updated] (SPARK-6356) Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

2015-03-16 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-6356: - Description: Support for the expression below: ``` GROUP BY expression list WITH ROLLUP GROUP BY

[jira] [Updated] (SPARK-6356) Support the ROLLUP/CUBE/GROUPING SETS/grouping() in SQLContext

2015-03-16 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-6356: - Description: Support for the expression below: ` GROUP BY expression list WITH ROLLUP GROUP BY expression

[jira] [Updated] (SPARK-6040) Fix the percent bug in tablesample

2015-02-26 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-6040: - Summary: Fix the percent bug in tablesample (was: Fix the bug in tablesample) Fix the percent bug in

[jira] [Created] (SPARK-6040) Fix the bug in tablesample

2015-02-26 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-6040: Summary: Fix the bug in tablesample Key: SPARK-6040 URL: https://issues.apache.org/jira/browse/SPARK-6040 Project: Spark Issue Type: Bug Components: SQL

[jira] [Created] (SPARK-5741) Support comma in path in HiveContext

2015-02-11 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-5741: Summary: Support comma in path in HiveContext Key: SPARK-5741 URL: https://issues.apache.org/jira/browse/SPARK-5741 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-5741) Support the path contains comma in HiveContext

2015-02-11 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5741: - Description: When run ```select * from nzhang_part where hr = 'file,';```, it throws exception

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Fix Version/s: 1.3.0 Support 'show roles' in HiveContext ---

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Fix Version/s: (was: 1.3.0) Support 'show roles' in HiveContext ---

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Affects Version/s: 1.2.0 Support 'show roles' in HiveContext ---

[jira] [Created] (SPARK-5606) Support plus sign in HiveContext

2015-02-04 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-5606: Summary: Support plus sign in HiveContext Key: SPARK-5606 URL: https://issues.apache.org/jira/browse/SPARK-5606 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-5606) Support plus sign in HiveContext

2015-02-04 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5606: - Description: Now spark version is only support ```SELECT -key FROM DECIMAL_UDF;``` in HiveContext. This

[jira] [Created] (SPARK-5580) Grep bug in compute-classpath.sh

2015-02-03 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-5580: Summary: Grep bug in compute-classpath.sh Key: SPARK-5580 URL: https://issues.apache.org/jira/browse/SPARK-5580 Project: Spark Issue Type: Bug Reporter:

[jira] [Updated] (SPARK-5580) Grep bug in compute-classpath.sh

2015-02-03 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5580: - Affects Version/s: 1.2.0 Grep bug in compute-classpath.sh

[jira] [Updated] (SPARK-5580) Grep bug in compute-classpath.sh

2015-02-03 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5580: - Fix Version/s: 1.3.0 Grep bug in compute-classpath.sh

[jira] [Closed] (SPARK-5580) Grep bug in compute-classpath.sh

2015-02-03 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi closed SPARK-5580. Resolution: Fixed Grep bug in compute-classpath.sh

[jira] [Created] (SPARK-4535) Fix the error in comments

2014-11-21 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-4535: Summary: Fix the error in comments Key: SPARK-4535 URL: https://issues.apache.org/jira/browse/SPARK-4535 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-4294) The same function should have the same realization.

2014-11-06 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-4294: Summary: The same function should have the same realization. Key: SPARK-4294 URL: https://issues.apache.org/jira/browse/SPARK-4294 Project: Spark Issue Type:

[jira] [Created] (SPARK-3484) Can updateStateByKey hold only last 10 keys?

2014-09-11 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-3484: Summary: Can updateStateByKey hold only last 10 keys? Key: SPARK-3484 URL: https://issues.apache.org/jira/browse/SPARK-3484 Project: Spark Issue Type: Question

[jira] [Closed] (SPARK-3484) Can updateStateByKey hold only last 10 keys?

2014-09-11 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi closed SPARK-3484. Resolution: Not a Problem Can updateStateByKey hold only last 10 keys?

[jira] [Created] (SPARK-3325) Add a parameter to the method print in class DStream.

2014-08-30 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-3325: Summary: Add a parameter to the method print in class DStream. Key: SPARK-3325 URL: https://issues.apache.org/jira/browse/SPARK-3325 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3325) Add a parameter to the method print in class DStream.

2014-08-30 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-3325: - Component/s: (was: Spark Core) Streaming Add a parameter to the method print in

[jira] [Created] (SPARK-3285) Using values.sum is easier to understand than using values.foldLeft(0)(_ + _)

2014-08-28 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-3285: Summary: Using values.sum is easier to understand than using values.foldLeft(0)(_ + _) Key: SPARK-3285 URL: https://issues.apache.org/jira/browse/SPARK-3285 Project: Spark

[jira] [Created] (SPARK-2572) Can't delete local dir on executor automatically when running spark over Mesos.

2014-07-18 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-2572: Summary: Can't delete local dir on executor automatically when running spark over Mesos. Key: SPARK-2572 URL: https://issues.apache.org/jira/browse/SPARK-2572 Project: Spark