[
https://issues.apache.org/jira/browse/SPARK-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15567965#comment-15567965
]
Littlestar edited comment on SPARK-6678 at 10/12/16 7:57 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15567965#comment-15567965
]
Littlestar commented on SPARK-6678:
---
I compre it to my other spark code, it do same thin
[
https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14704534#comment-14704534
]
Littlestar commented on SPARK-2883:
---
spark 1.4.1: The orc file writer relies on HiveCont
[
https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620328#comment-14620328
]
Littlestar commented on SPARK-3644:
---
Does there has any json api reference document for
[
https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604632#comment-14604632
]
Littlestar commented on SPARK-5281:
---
Does this patch merge to spark 1.3 branch, thanks.
[
https://issues.apache.org/jira/browse/SPARK-2691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530311#comment-14530311
]
Littlestar commented on SPARK-2691:
---
Does these has plan to merge this patch to spark 1.
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar resolved SPARK-6461.
---
Resolution: Duplicate
missing enviroment on spark-1.3.1-hadoop2.4.0.tgz.
MARK here:
spark-env.sh on d
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519515#comment-14519515
]
Littlestar commented on SPARK-6461:
---
same to SPARK-7193
> spark.executorEnv.PATH in spa
[
https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518610#comment-14518610
]
Littlestar edited comment on SPARK-7193 at 4/29/15 2:40 AM:
I
[
https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar resolved SPARK-7193.
---
Resolution: Invalid
I think official document missing some notes about "Spark on Mesos"
I worked well
[
https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516807#comment-14516807
]
Littlestar commented on SPARK-7193:
---
exception on some mesos worknode log.
{noformat}
Ex
[
https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516801#comment-14516801
]
Littlestar edited comment on SPARK-7193 at 4/28/15 10:53 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516801#comment-14516801
]
Littlestar edited comment on SPARK-7193 at 4/28/15 10:51 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516801#comment-14516801
]
Littlestar commented on SPARK-7193:
---
{noformat}
15/04/28 18:45:53 INFO spark.SparkContex
Littlestar created SPARK-7193:
-
Summary: "Spark on Mesos" may need more tests for spark 1.3.1
release
Key: SPARK-7193
URL: https://issues.apache.org/jira/browse/SPARK-7193
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-6151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491881#comment-14491881
]
Littlestar edited comment on SPARK-6151 at 4/14/15 1:04 AM:
>>
[
https://issues.apache.org/jira/browse/SPARK-6151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491881#comment-14491881
]
Littlestar commented on SPARK-6151:
---
>>The HDFS Block Size is set once when you first in
Littlestar created SPARK-6678:
-
Summary: select count(DISTINCT C_UID) from parquetdir may be can
optimize
Key: SPARK-6678
URL: https://issues.apache.org/jira/browse/SPARK-6678
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387748#comment-14387748
]
Littlestar edited comment on SPARK-6239 at 3/31/15 1:09 AM:
>>
[
https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387748#comment-14387748
]
Littlestar commented on SPARK-6239:
---
>>If I want to set minCount=2, I must use.setMinSup
[
https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375599#comment-14375599
]
Littlestar edited comment on SPARK-1702 at 3/23/15 11:00 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6461:
--
Comment: was deleted
(was: in spark/bin, some shell script use "usr/bin/env bash"
I think changed #!/u
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375468#comment-14375468
]
Littlestar edited comment on SPARK-6461 at 3/23/15 9:29 AM:
ea
[
https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375612#comment-14375612
]
Littlestar commented on SPARK-6213:
---
may be change protected[sql] def selectFilters(filt
[
https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375599#comment-14375599
]
Littlestar edited comment on SPARK-1702 at 3/23/15 9:05 AM:
I
[
https://issues.apache.org/jira/browse/SPARK-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375599#comment-14375599
]
Littlestar commented on SPARK-1702:
---
I met this on spak 1.3.0 + mesos 0.21.1
> Mesos ex
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375580#comment-14375580
]
Littlestar edited comment on SPARK-6461 at 3/23/15 9:04 AM:
wh
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375580#comment-14375580
]
Littlestar edited comment on SPARK-6461 at 3/23/15 8:49 AM:
wh
[
https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375583#comment-14375583
]
Littlestar commented on SPARK-1403:
---
I want to reopen this bug, because I can reproduce
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375580#comment-14375580
]
Littlestar commented on SPARK-6461:
---
when I add MESOS_HADOOP_CONF_DIR at all mesos-maste
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375468#comment-14375468
]
Littlestar edited comment on SPARK-6461 at 3/23/15 8:39 AM:
ea
[
https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375576#comment-14375576
]
Littlestar commented on SPARK-1480:
---
same as https://issues.apache.org/jira/browse/SPARK
[
https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375572#comment-14375572
]
Littlestar commented on SPARK-1480:
---
I meet this bug on spark 1.3.0 + mesos 0.21.1
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375508#comment-14375508
]
Littlestar commented on SPARK-6461:
---
http://spark.apache.org/docs/latest/running-on-meso
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375478#comment-14375478
]
Littlestar commented on SPARK-6461:
---
in spark/bin, some shell script use "usr/bin/env ba
[
https://issues.apache.org/jira/browse/SPARK-6461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14375468#comment-14375468
]
Littlestar commented on SPARK-6461:
---
each mesos slave node has JAVA and HADOOP DataNode.
Littlestar created SPARK-6461:
-
Summary: spark.executorEnv.PATH in spark-defaults.conf is not pass
to mesos
Key: SPARK-6461
URL: https://issues.apache.org/jira/browse/SPARK-6461
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-6240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354890#comment-14354890
]
Littlestar commented on SPARK-6240:
---
ok, I kown, Thanks.
I just only notice that Array[
[
https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354829#comment-14354829
]
Littlestar commented on SPARK-6239:
---
When use FPGrowthModel, the numbers of input record
[
https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354450#comment-14354450
]
Littlestar commented on SPARK-6239:
---
I just want to set minCount=2 for test 10*1*100
Littlestar created SPARK-6240:
-
Summary: Spark MLlib fpm#FPGrowth genFreqItems use Array[Item] may
outOfMemory for Large Sets
Key: SPARK-6240
URL: https://issues.apache.org/jira/browse/SPARK-6240
Project:
[
https://issues.apache.org/jira/browse/SPARK-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6239:
--
Description:
Spark MLlib fpm#FPGrowth minSupport should use long instead
==
val minCount =
Littlestar created SPARK-6239:
-
Summary: Spark MLlib fpm#FPGrowth minSupport should use double
instead
Key: SPARK-6239
URL: https://issues.apache.org/jira/browse/SPARK-6239
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6213:
--
Description:
sql.sources.CatalystScan#
public RDD buildScan(Seq requiredColumns, Seq
filters)
I use ja
[
https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6213:
--
Description:
sql.sources.CatalystScan#
public RDD buildScan(Seq requiredColumns, Seq
filters)
I use ja
[
https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351479#comment-14351479
]
Littlestar commented on SPARK-6213:
---
above similar scala code is very hard to translate
[
https://issues.apache.org/jira/browse/SPARK-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6213:
--
Component/s: SQL
Affects Version/s: 1.3.0
> sql.catalyst.expressions.Expression is not friendl
Littlestar created SPARK-6213:
-
Summary: sql.catalyst.expressions.Expression is not friendly to
java
Key: SPARK-6213
URL: https://issues.apache.org/jira/browse/SPARK-6213
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346349#comment-14346349
]
Littlestar commented on SPARK-5834:
---
Spark 1.3.0 RC1/RC2 bundle with httpclient 4.3.6, w
[
https://issues.apache.org/jira/browse/SPARK-6151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6151:
--
Component/s: SQL
> schemaRDD to parquetfile with saveAsParquetFile control the HDFS block size
> ---
Littlestar created SPARK-6151:
-
Summary: schemaRDD to parquetfile with saveAsParquetFile control
the HDFS block size
Key: SPARK-6151
URL: https://issues.apache.org/jira/browse/SPARK-6151
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340018#comment-14340018
]
Littlestar edited comment on SPARK-6049 at 3/3/15 9:59 AM:
---
than
[
https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14344813#comment-14344813
]
Littlestar commented on SPARK-6049:
---
I test 1.3.0 RC1, it fixed SPARK-3675 and SPARK-486
[
https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6131:
--
Comment: was deleted
(was: spark-1.2.1 is ok.
spark-1.2.1-src.jar\sql\core\src\main\scala\org\apache\spa
[
https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6131:
--
Priority: Minor (was: Critical)
> Spark 1.3.0 (RC1) missing some source files in sql.api.java
> ---
[
https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14344604#comment-14344604
]
Littlestar commented on SPARK-6131:
---
spark 1.2.1:
sql\core\src\main\scala\org\apache\sp
[
https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14344584#comment-14344584
]
Littlestar commented on SPARK-6131:
---
spark-1.2.1 is ok.
spark-1.2.1-src.jar\sql\core\src
[
https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6131:
--
Description:
I notice that [VOTE] Release Apache Spark 1.3.0 (RC1)
http://apache-spark-developers-list.
[
https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6131:
--
Description:
I notice that [VOTE] Release Apache Spark 1.3.0 (RC1)
http://apache-spark-developers-list.
[
https://issues.apache.org/jira/browse/SPARK-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-6131:
--
Description:
I notice that [VOTE] Release Apache Spark 1.3.0 (RC1)
http://apache-spark-developers-list.
Littlestar created SPARK-6131:
-
Summary: Spark 1.3.0 (RC1) missing some source files in
sql.api.java
Key: SPARK-6131
URL: https://issues.apache.org/jira/browse/SPARK-6131
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340096#comment-14340096
]
Littlestar edited comment on SPARK-6049 at 2/27/15 2:43 PM:
ve
[
https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar resolved SPARK-6049.
---
Resolution: Invalid
very sorry, HiveThriftServer2.startWithContext can be called by java.
I will open
[
https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340018#comment-14340018
]
Littlestar commented on SPARK-6049:
---
thanks. I call ok by static methods, but not tables
[
https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339980#comment-14339980
]
Littlestar edited comment on SPARK-6049 at 2/27/15 10:33 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339980#comment-14339980
]
Littlestar commented on SPARK-6049:
---
HiveThriftServer2.scala is can't call directly in o
Littlestar created SPARK-6049:
-
Summary: HiveThriftServer2 may expose Inheritable methods
Key: SPARK-6049
URL: https://issues.apache.org/jira/browse/SPARK-6049
Project: Spark
Issue Type: Improvem
[
https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323619#comment-14323619
]
Littlestar commented on SPARK-5829:
---
But it depends on "org.apache.spark.streaming.Time"
[
https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323529#comment-14323529
]
Littlestar commented on SPARK-5829:
---
The following code as same as saveAsNewAPIHadoopFi
[
https://issues.apache.org/jira/browse/SPARK-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5834:
--
Description:
I see
spark-1.2.1-bin-hadoop2.4.tgz\spark-1.2.1-bin-hadoop2.4\lib\spark-assembly-1.2.1-ha
[
https://issues.apache.org/jira/browse/SPARK-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5834:
--
Description:
I see
spark-1.2.1-bin-hadoop2.4.tgz\spark-1.2.1-bin-hadoop2.4\lib\spark-assembly-1.2.1-ha
Littlestar created SPARK-5834:
-
Summary: spark 1.2.1 officical package bundled with httpclient
4.1.2 is too old
Key: SPARK-5834
URL: https://issues.apache.org/jira/browse/SPARK-5834
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322559#comment-14322559
]
Littlestar commented on SPARK-3638:
---
Oh, It was introduced in kinesis-asl profile only.
[
https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322514#comment-14322514
]
Littlestar commented on SPARK-3638:
---
https://github.com/apache/spark/pull/2489/files (
[
https://issues.apache.org/jira/browse/SPARK-3638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322511#comment-14322511
]
Littlestar commented on SPARK-3638:
---
>>I can see in the spark 1.1.1 hadoop 2.4 in the
>
[
https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322408#comment-14322408
]
Littlestar edited comment on SPARK-5829 at 2/16/15 6:05 AM:
Fi
[
https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322408#comment-14322408
]
Littlestar commented on SPARK-5829:
---
FileInputDStream.scala
override def compute(valid
[
https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5829:
--
Summary: JavaStreamingContext.fileStream run task loop repeated empty when
no more new files found (wa
[
https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5829:
--
Priority: Minor (was: Major)
> JavaStreamingContext.fileStream run task loop repeated empty when no mo
[
https://issues.apache.org/jira/browse/SPARK-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322321#comment-14322321
]
Littlestar commented on SPARK-5829:
---
when I add new files into /testspark/watchdir, it
Littlestar created SPARK-5829:
-
Summary: JavaStreamingContext.fileStream run task repeated empty
when no more new files
Key: SPARK-5829
URL: https://issues.apache.org/jira/browse/SPARK-5829
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322317#comment-14322317
]
Littlestar commented on SPARK-5826:
---
I merge pull/4612 and rebuild, it works for me, no
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14322287#comment-14322287
]
Littlestar commented on SPARK-5826:
---
hi,
I see pull/4612, https://github.com/apache/s
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5826:
--
Attachment: TestStream.java
> JavaStreamingContext.fileStream cause Configuration NotSerializableExcepti
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321862#comment-14321862
]
Littlestar commented on SPARK-5826:
---
I put some txt files into /testspark/watchdir, It t
Littlestar created SPARK-5826:
-
Summary: JavaStreamingContext.fileStream cause Configuration
NotSerializableException
Key: SPARK-5826
URL: https://issues.apache.org/jira/browse/SPARK-5826
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321848#comment-14321848
]
Littlestar commented on SPARK-5795:
---
works for me, thanks.
> api.java.JavaPairDStream.s
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5826:
--
Attachment: (was: TestStream.java)
> JavaStreamingContext.fileStream cause Configuration NotSerializ
[
https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321848#comment-14321848
]
Littlestar edited comment on SPARK-5795 at 2/15/15 8:05 AM:
I
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5826:
--
Attachment: TestStream.java
testcode upload.
!TestStream.java!
> JavaStreamingContext.fileStream cause
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321849#comment-14321849
]
Littlestar edited comment on SPARK-5826 at 2/15/15 7:51 AM:
te
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5826:
--
Component/s: Streaming
> JavaStreamingContext.fileStream cause Configuration NotSerializableException
>
[
https://issues.apache.org/jira/browse/SPARK-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321851#comment-14321851
]
Littlestar commented on SPARK-5826:
---
I think Checkpoint must not serialize Configuration
[
https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320109#comment-14320109
]
Littlestar commented on SPARK-5795:
---
Does it same problem as SPARK-5297, thanks.
> api
[
https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Littlestar updated SPARK-5795:
--
Attachment: TestStreamCompile.java
my testcase on java 1.7 and spark 1.3 trunk.
Thanks.
> api.java.Java
[
https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320083#comment-14320083
]
Littlestar commented on SPARK-5795:
---
error info...
The method saveAsNewAPIHadoopFiles(St
[
https://issues.apache.org/jira/browse/SPARK-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319769#comment-14319769
]
Littlestar commented on SPARK-5795:
---
org.apache.spark.api.java.JavaPairRDD
{noformat}
/*
Littlestar created SPARK-5795:
-
Summary: api.java.JavaPairDStream.saveAsNewAPIHadoopFiles may not
friendly to java
Key: SPARK-5795
URL: https://issues.apache.org/jira/browse/SPARK-5795
Project: Spark
98 matches
Mail list logo