[jira] [Comment Edited] (SPARK-6678) select count(DISTINCT C_UID) from parquetdir may be can optimize

2016-10-12 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567965#comment-15567965 ] Littlestar edited comment on SPARK-6678 at 10/12/16 7:57 AM: - I compare it to

[jira] [Commented] (SPARK-6678) select count(DISTINCT C_UID) from parquetdir may be can optimize

2016-10-12 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567965#comment-15567965 ] Littlestar commented on SPARK-6678: --- I compre it to my other spark code, it do same thing: count

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

2015-08-20 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704534#comment-14704534 ] Littlestar commented on SPARK-2883: --- spark 1.4.1: The orc file writer relies on

[jira] [Commented] (SPARK-3644) REST API for Spark application info (jobs / stages / tasks / storage info)

2015-07-09 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620328#comment-14620328 ] Littlestar commented on SPARK-3644: --- Does there has any json api reference document for

[jira] [Commented] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

2015-06-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14604632#comment-14604632 ] Littlestar commented on SPARK-5281: --- Does this patch merge to spark 1.3 branch, thanks.

[jira] [Commented] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-04-29 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519515#comment-14519515 ] Littlestar commented on SPARK-6461: --- same to SPARK-7193 spark.executorEnv.PATH in

[jira] [Resolved] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-04-29 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar resolved SPARK-6461. --- Resolution: Duplicate missing enviroment on spark-1.3.1-hadoop2.4.0.tgz. MARK here: spark-env.sh on

[jira] [Commented] (SPARK-7193) Spark on Mesos may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516801#comment-14516801 ] Littlestar commented on SPARK-7193: --- {noformat} 15/04/28 18:45:53 INFO

[jira] [Comment Edited] (SPARK-7193) Spark on Mesos may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516801#comment-14516801 ] Littlestar edited comment on SPARK-7193 at 4/28/15 10:51 AM: -

[jira] [Comment Edited] (SPARK-7193) Spark on Mesos may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516801#comment-14516801 ] Littlestar edited comment on SPARK-7193 at 4/28/15 10:53 AM: -

[jira] [Commented] (SPARK-7193) Spark on Mesos may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516807#comment-14516807 ] Littlestar commented on SPARK-7193: --- exception on some mesos worknode log. {noformat}

[jira] [Resolved] (SPARK-7193) Spark on Mesos may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar resolved SPARK-7193. --- Resolution: Invalid I think official document missing some notes about Spark on Mesos I worked well

[jira] [Comment Edited] (SPARK-7193) Spark on Mesos may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518610#comment-14518610 ] Littlestar edited comment on SPARK-7193 at 4/29/15 2:40 AM: I

[jira] [Created] (SPARK-7193) Spark on Mesos may need more tests for spark 1.3.1 release

2015-04-28 Thread Littlestar (JIRA)
Littlestar created SPARK-7193: - Summary: Spark on Mesos may need more tests for spark 1.3.1 release Key: SPARK-7193 URL: https://issues.apache.org/jira/browse/SPARK-7193 Project: Spark Issue

[jira] [Comment Edited] (SPARK-6151) schemaRDD to parquetfile with saveAsParquetFile control the HDFS block size

2015-04-13 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491881#comment-14491881 ] Littlestar edited comment on SPARK-6151 at 4/14/15 1:04 AM:

[jira] [Commented] (SPARK-6151) schemaRDD to parquetfile with saveAsParquetFile control the HDFS block size

2015-04-12 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491881#comment-14491881 ] Littlestar commented on SPARK-6151: --- The HDFS Block Size is set once when you first

[jira] [Created] (SPARK-6678) select count(DISTINCT C_UID) from parquetdir may be can optimize

2015-04-02 Thread Littlestar (JIRA)
Littlestar created SPARK-6678: - Summary: select count(DISTINCT C_UID) from parquetdir may be can optimize Key: SPARK-6678 URL: https://issues.apache.org/jira/browse/SPARK-6678 Project: Spark

[jira] [Commented] (SPARK-6239) Spark MLlib fpm#FPGrowth minSupport should use long instead

2015-03-30 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387748#comment-14387748 ] Littlestar commented on SPARK-6239: --- If I want to set minCount=2, I must

[jira] [Comment Edited] (SPARK-6239) Spark MLlib fpm#FPGrowth minSupport should use long instead

2015-03-30 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387748#comment-14387748 ] Littlestar edited comment on SPARK-6239 at 3/31/15 1:09 AM: I

[jira] [Comment Edited] (SPARK-1702) Mesos executor won't start because of a ClassNotFoundException

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375599#comment-14375599 ] Littlestar edited comment on SPARK-1702 at 3/23/15 11:00 AM: -

[jira] [Comment Edited] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375580#comment-14375580 ] Littlestar edited comment on SPARK-6461 at 3/23/15 9:04 AM:

[jira] [Commented] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375572#comment-14375572 ] Littlestar commented on SPARK-1480: --- I meet this bug on spark 1.3.0 + mesos 0.21.1

[jira] [Created] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
Littlestar created SPARK-6461: - Summary: spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos Key: SPARK-6461 URL: https://issues.apache.org/jira/browse/SPARK-6461 Project: Spark

[jira] [Comment Edited] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375468#comment-14375468 ] Littlestar edited comment on SPARK-6461 at 3/23/15 8:39 AM:

[jira] [Comment Edited] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375580#comment-14375580 ] Littlestar edited comment on SPARK-6461 at 3/23/15 8:49 AM:

[jira] [Commented] (SPARK-1702) Mesos executor won't start because of a ClassNotFoundException

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375599#comment-14375599 ] Littlestar commented on SPARK-1702: --- I met this on spak 1.3.0 + mesos 0.21.1 Mesos

[jira] [Comment Edited] (SPARK-1702) Mesos executor won't start because of a ClassNotFoundException

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375599#comment-14375599 ] Littlestar edited comment on SPARK-1702 at 3/23/15 9:05 AM: I

[jira] [Commented] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375576#comment-14375576 ] Littlestar commented on SPARK-1480: --- same as

[jira] [Commented] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375468#comment-14375468 ] Littlestar commented on SPARK-6461: --- each mesos slave node has JAVA and HADOOP DataNode.

[jira] [Commented] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375583#comment-14375583 ] Littlestar commented on SPARK-1403: --- I want to reopen this bug, because I can reproduce

[jira] [Commented] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375580#comment-14375580 ] Littlestar commented on SPARK-6461: --- when I add MESOS_HADOOP_CONF_DIR at all

[jira] [Comment Edited] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375468#comment-14375468 ] Littlestar edited comment on SPARK-6461 at 3/23/15 9:29 AM:

[jira] [Commented] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375478#comment-14375478 ] Littlestar commented on SPARK-6461: --- in spark/bin, some shell script use usr/bin/env

[jira] [Commented] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375508#comment-14375508 ] Littlestar commented on SPARK-6461: ---

[jira] [Commented] (SPARK-6213) sql.catalyst.expressions.Expression is not friendly to java

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14375612#comment-14375612 ] Littlestar commented on SPARK-6213: --- may be change protected[sql] def

[jira] [Issue Comment Deleted] (SPARK-6461) spark.executorEnv.PATH in spark-defaults.conf is not pass to mesos

2015-03-23 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6461: -- Comment: was deleted (was: in spark/bin, some shell script use usr/bin/env bash I think changed

[jira] [Commented] (SPARK-6240) Spark MLlib fpm#FPGrowth genFreqItems use Array[Item] may outOfMemory for Large Sets

2015-03-10 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354890#comment-14354890 ] Littlestar commented on SPARK-6240: --- ok, I kown, Thanks. I just only notice that

[jira] [Commented] (SPARK-6239) Spark MLlib fpm#FPGrowth minSupport should use long instead

2015-03-10 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354829#comment-14354829 ] Littlestar commented on SPARK-6239: --- When use FPGrowthModel, the numbers of input

[jira] [Updated] (SPARK-6239) Spark MLlib fpm#FPGrowth minSupport should use long instead

2015-03-10 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6239: -- Description: Spark MLlib fpm#FPGrowth minSupport should use long instead == val minCount =

[jira] [Created] (SPARK-6240) Spark MLlib fpm#FPGrowth genFreqItems use Array[Item] may outOfMemory for Large Sets

2015-03-10 Thread Littlestar (JIRA)
Littlestar created SPARK-6240: - Summary: Spark MLlib fpm#FPGrowth genFreqItems use Array[Item] may outOfMemory for Large Sets Key: SPARK-6240 URL: https://issues.apache.org/jira/browse/SPARK-6240

[jira] [Commented] (SPARK-6239) Spark MLlib fpm#FPGrowth minSupport should use long instead

2015-03-10 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354450#comment-14354450 ] Littlestar commented on SPARK-6239: --- I just want to set minCount=2 for test

[jira] [Created] (SPARK-6239) Spark MLlib fpm#FPGrowth minSupport should use double instead

2015-03-10 Thread Littlestar (JIRA)
Littlestar created SPARK-6239: - Summary: Spark MLlib fpm#FPGrowth minSupport should use double instead Key: SPARK-6239 URL: https://issues.apache.org/jira/browse/SPARK-6239 Project: Spark Issue

[jira] [Commented] (SPARK-6213) sql.catalyst.expressions.Expression is not friendly to java

2015-03-07 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351479#comment-14351479 ] Littlestar commented on SPARK-6213: --- above similar scala code is very hard to translate

[jira] [Updated] (SPARK-6213) sql.catalyst.expressions.Expression is not friendly to java

2015-03-07 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6213: -- Description: sql.sources.CatalystScan# public RDDRow buildScan(SeqAttribute requiredColumns,

[jira] [Updated] (SPARK-6213) sql.catalyst.expressions.Expression is not friendly to java

2015-03-07 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6213: -- Description: sql.sources.CatalystScan# public RDDRow buildScan(SeqAttribute requiredColumns,

[jira] [Created] (SPARK-6213) sql.catalyst.expressions.Expression is not friendly to java

2015-03-06 Thread Littlestar (JIRA)
Littlestar created SPARK-6213: - Summary: sql.catalyst.expressions.Expression is not friendly to java Key: SPARK-6213 URL: https://issues.apache.org/jira/browse/SPARK-6213 Project: Spark Issue

[jira] [Updated] (SPARK-6213) sql.catalyst.expressions.Expression is not friendly to java

2015-03-06 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6213: -- Component/s: SQL Affects Version/s: 1.3.0 sql.catalyst.expressions.Expression is not

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-03-03 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344813#comment-14344813 ] Littlestar commented on SPARK-6049: --- I test 1.3.0 RC1, it fixed SPARK-3675 and

[jira] [Commented] (SPARK-5834) spark 1.2.1 officical package bundled with httpclient 4.1.2 is too old

2015-03-03 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346349#comment-14346349 ] Littlestar commented on SPARK-5834: --- Spark 1.3.0 RC1/RC2 bundle with httpclient 4.3.6,

[jira] [Updated] (SPARK-6151) schemaRDD to parquetfile with saveAsParquetFile control the HDFS block size

2015-03-03 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6151: -- Component/s: SQL schemaRDD to parquetfile with saveAsParquetFile control the HDFS block size

[jira] [Created] (SPARK-6151) schemaRDD to parquetfile with saveAsParquetFile control the HDFS block size

2015-03-03 Thread Littlestar (JIRA)
Littlestar created SPARK-6151: - Summary: schemaRDD to parquetfile with saveAsParquetFile control the HDFS block size Key: SPARK-6151 URL: https://issues.apache.org/jira/browse/SPARK-6151 Project: Spark

[jira] [Comment Edited] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-03-03 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14340018#comment-14340018 ] Littlestar edited comment on SPARK-6049 at 3/3/15 9:59 AM: ---

[jira] [Updated] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

2015-03-02 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6131: -- Description: I notice that [VOTE] Release Apache Spark 1.3.0 (RC1)

[jira] [Issue Comment Deleted] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

2015-03-02 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6131: -- Comment: was deleted (was: spark-1.2.1 is ok.

[jira] [Commented] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

2015-03-02 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344584#comment-14344584 ] Littlestar commented on SPARK-6131: --- spark-1.2.1 is ok.

[jira] [Updated] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

2015-03-02 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6131: -- Priority: Minor (was: Critical) Spark 1.3.0 (RC1) missing some source files in sql.api.java

[jira] [Commented] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

2015-03-02 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344604#comment-14344604 ] Littlestar commented on SPARK-6131: --- spark 1.2.1:

[jira] [Created] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

2015-03-02 Thread Littlestar (JIRA)
Littlestar created SPARK-6131: - Summary: Spark 1.3.0 (RC1) missing some source files in sql.api.java Key: SPARK-6131 URL: https://issues.apache.org/jira/browse/SPARK-6131 Project: Spark Issue

[jira] [Updated] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

2015-03-02 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6131: -- Description: I notice that [VOTE] Release Apache Spark 1.3.0 (RC1)

[jira] [Updated] (SPARK-6131) Spark 1.3.0 (RC1) missing some source files in sql.api.java

2015-03-02 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-6131: -- Description: I notice that [VOTE] Release Apache Spark 1.3.0 (RC1)

[jira] [Resolved] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar resolved SPARK-6049. --- Resolution: Invalid very sorry, HiveThriftServer2.startWithContext can be called by java. I will open

[jira] [Comment Edited] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14340096#comment-14340096 ] Littlestar edited comment on SPARK-6049 at 2/27/15 2:43 PM:

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14340018#comment-14340018 ] Littlestar commented on SPARK-6049: --- thanks. I call ok by static methods, but not tables

[jira] [Commented] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339980#comment-14339980 ] Littlestar commented on SPARK-6049: --- HiveThriftServer2.scala is can't call directly in

[jira] [Comment Edited] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-27 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339980#comment-14339980 ] Littlestar edited comment on SPARK-6049 at 2/27/15 10:33 AM: -

[jira] [Created] (SPARK-6049) HiveThriftServer2 may expose Inheritable methods

2015-02-26 Thread Littlestar (JIRA)
Littlestar created SPARK-6049: - Summary: HiveThriftServer2 may expose Inheritable methods Key: SPARK-6049 URL: https://issues.apache.org/jira/browse/SPARK-6049 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-16 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14323529#comment-14323529 ] Littlestar commented on SPARK-5829: --- The following code as same as

[jira] [Commented] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-16 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14323619#comment-14323619 ] Littlestar commented on SPARK-5829: --- But it depends on org.apache.spark.streaming.Time,

[jira] [Commented] (SPARK-3638) Commons HTTP client dependency conflict in extras/kinesis-asl module

2015-02-16 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322559#comment-14322559 ] Littlestar commented on SPARK-3638: --- Oh, It was introduced in kinesis-asl profile only.

[jira] [Updated] (SPARK-5834) spark 1.2.1 officical package bundled with httpclient 4.1.2 is too old

2015-02-16 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5834: -- Description: I see

[jira] [Created] (SPARK-5834) spark 1.2.1 officical package bundled with httpclient 4.1.2 is too old

2015-02-16 Thread Littlestar (JIRA)
Littlestar created SPARK-5834: - Summary: spark 1.2.1 officical package bundled with httpclient 4.1.2 is too old Key: SPARK-5834 URL: https://issues.apache.org/jira/browse/SPARK-5834 Project: Spark

[jira] [Updated] (SPARK-5834) spark 1.2.1 officical package bundled with httpclient 4.1.2 is too old

2015-02-16 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5834: -- Description: I see

[jira] [Commented] (SPARK-5826) JavaStreamingContext.fileStream cause Configuration NotSerializableException

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321862#comment-14321862 ] Littlestar commented on SPARK-5826: --- I put some txt files into /testspark/watchdir, It

[jira] [Created] (SPARK-5826) JavaStreamingContext.fileStream cause Configuration NotSerializableException

2015-02-15 Thread Littlestar (JIRA)
Littlestar created SPARK-5826: - Summary: JavaStreamingContext.fileStream cause Configuration NotSerializableException Key: SPARK-5826 URL: https://issues.apache.org/jira/browse/SPARK-5826 Project: Spark

[jira] [Updated] (SPARK-5826) JavaStreamingContext.fileStream cause Configuration NotSerializableException

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5826: -- Attachment: TestStream.java JavaStreamingContext.fileStream cause Configuration

[jira] [Updated] (SPARK-5826) JavaStreamingContext.fileStream cause Configuration NotSerializableException

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5826: -- Attachment: (was: TestStream.java) JavaStreamingContext.fileStream cause Configuration

[jira] [Commented] (SPARK-5795) api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not friendly to java

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321848#comment-14321848 ] Littlestar commented on SPARK-5795: --- works for me, thanks.

[jira] [Comment Edited] (SPARK-5826) JavaStreamingContext.fileStream cause Configuration NotSerializableException

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321849#comment-14321849 ] Littlestar edited comment on SPARK-5826 at 2/15/15 7:51 AM:

[jira] [Comment Edited] (SPARK-5795) api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not friendly to java

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321848#comment-14321848 ] Littlestar edited comment on SPARK-5795 at 2/15/15 8:05 AM: I

[jira] [Updated] (SPARK-5826) JavaStreamingContext.fileStream cause Configuration NotSerializableException

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5826: -- Attachment: TestStream.java testcode upload. !TestStream.java! JavaStreamingContext.fileStream cause

[jira] [Updated] (SPARK-5826) JavaStreamingContext.fileStream cause Configuration NotSerializableException

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5826: -- Component/s: Streaming JavaStreamingContext.fileStream cause Configuration NotSerializableException

[jira] [Commented] (SPARK-5826) JavaStreamingContext.fileStream cause Configuration NotSerializableException

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322317#comment-14322317 ] Littlestar commented on SPARK-5826: --- I merge pull/4612 and rebuild, it works for me, no

[jira] [Created] (SPARK-5829) JavaStreamingContext.fileStream run task repeated empty when no more new files

2015-02-15 Thread Littlestar (JIRA)
Littlestar created SPARK-5829: - Summary: JavaStreamingContext.fileStream run task repeated empty when no more new files Key: SPARK-5829 URL: https://issues.apache.org/jira/browse/SPARK-5829 Project:

[jira] [Commented] (SPARK-5829) JavaStreamingContext.fileStream run task repeated empty when no more new files

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322321#comment-14322321 ] Littlestar commented on SPARK-5829: --- when I add new files into /testspark/watchdir, it

[jira] [Updated] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5829: -- Summary: JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

[jira] [Updated] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5829: -- Priority: Minor (was: Major) JavaStreamingContext.fileStream run task loop repeated empty when no

[jira] [Comment Edited] (SPARK-5829) JavaStreamingContext.fileStream run task loop repeated empty when no more new files found

2015-02-15 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322408#comment-14322408 ] Littlestar edited comment on SPARK-5829 at 2/16/15 6:05 AM:

[jira] [Created] (SPARK-5795) api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not friendly to java

2015-02-13 Thread Littlestar (JIRA)
Littlestar created SPARK-5795: - Summary: api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not friendly to java Key: SPARK-5795 URL: https://issues.apache.org/jira/browse/SPARK-5795 Project: Spark

[jira] [Commented] (SPARK-5795) api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not friendly to java

2015-02-13 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319769#comment-14319769 ] Littlestar commented on SPARK-5795: --- org.apache.spark.api.java.JavaPairRDDK, V

[jira] [Updated] (SPARK-5795) api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not friendly to java

2015-02-13 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Littlestar updated SPARK-5795: -- Attachment: TestStreamCompile.java my testcase on java 1.7 and spark 1.3 trunk. Thanks.

[jira] [Commented] (SPARK-5795) api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not friendly to java

2015-02-13 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320109#comment-14320109 ] Littlestar commented on SPARK-5795: --- Does it same problem as SPARK-5297, thanks.

[jira] [Commented] (SPARK-5795) api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not friendly to java

2015-02-13 Thread Littlestar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320083#comment-14320083 ] Littlestar commented on SPARK-5795: --- error info... The method