Re: Spark shell and StackOverFlowError

2015-09-01 Thread ponkin
Hi, Can not reproduce your error on Spark 1.2.1 . It is not enough information. What is your command line arguments wцру you starting spark-shell? what data are you reading? etc. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-shell

Re: Spark shell and StackOverFlowError

2015-08-31 Thread Ted Yu
8350 s >> >> >> >>>>>> res1: Long = 1 >> >> >> >>>>>> >> >> >> >>>>>> Ashish: >> >> >> >>>>>> Please refine your example to mimic more close

Re: Spark shell and StackOverFlowError

2015-08-31 Thread Ashish Shrowty
>> >>>>>> >>> >> >> >>>>>> scala> rdd.count() >>> >> >> >>>>>> ... >>> >> >> >>

Re: Spark shell and StackOverFlowError

2015-08-31 Thread Ted Yu
;>>> MutableList() >>>> >> >> >>>>>> >>>> >> >> >>>>>> scala> >>>> Range(0,1).foreach(i=>lst+=(("10","10",i:Double))) >>>> >> >> >>>

Re: Spark shell and StackOverFlowError

2015-08-31 Thread Ashish Shrowty
>>> >>>>> >> >> >>>>>> Using Spark shell : >>>>> >> >> >>>>>> >>>>> >> >> >>>>>> scala> import scala.collection.mutable.MutableList >>>>

Re: Spark shell and StackOverFlowError

2015-08-31 Thread Ted Yu
; >> >>>>> happens >>>>>> >> >> >>>>> when I try to pass a variable into the closure. The >>>>>> example you >>>>>> >> >> >>>>> have >>>>>> >> >> >>>>>

Re: Spark shell and StackOverFlowError

2015-08-31 Thread Sean Owen
>>>> > StackOverFlowError each time I try to run the following code >> >>>>>>> > (the >> >>>>>>> > code >> >>>>>>> > itself is just representative of other logic where I need to >> >>>>>&

Re: Spark shell and StackOverFlowError

2015-08-31 Thread Sean Owen
; must be executing something different. >> >> >>>>>>> >> >> >>>>>>> On Sun, Aug 30, 2015 at 4:21 AM, ashrowty &g

Re: Spark shell and StackOverFlowError

2015-08-30 Thread Sean Owen
,i:Double))) sc.makeRDD(lst).map(i= if(a==10) 1 else 0) Any help appreciated! Thanks, Ashish -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-shell-and-StackOverFlowError-tp24508.html Sent from the Apache Spark User List mailing list archive

Re: Spark shell and StackOverFlowError

2015-08-30 Thread Sean Owen
in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-shell-and-StackOverFlowError-tp24508.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr

Re: Spark shell and StackOverFlowError

2015-08-30 Thread Ashish Shrowty
))) sc.makeRDD(lst).map(i= if(a==10) 1 else 0) Any help appreciated! Thanks, Ashish -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-shell-and-StackOverFlowError-tp24508.html Sent from the Apache Spark User List mailing list archive

Re: Spark shell and StackOverFlowError

2015-08-30 Thread Ted Yu
/Spark-shell-and-StackOverFlowError-tp24508.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h

Re: Spark shell and StackOverFlowError

2015-08-30 Thread Ted Yu
in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-shell-and-StackOverFlowError-tp24508.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user

Re: Spark shell and StackOverFlowError

2015-08-30 Thread Ashish Shrowty
)]() Range(0,1).foreach(i=lst+=((10,10,i:Double))) sc.makeRDD(lst).map(i= if(a==10) 1 else 0) Any help appreciated! Thanks, Ashish -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-shell-and-StackOverFlowError-tp24508.html Sent

Spark shell and StackOverFlowError

2015-08-29 Thread ashrowty
(i=lst+=((10,10,i:Double))) sc.makeRDD(lst).map(i= if(a==10) 1 else 0) Any help appreciated! Thanks, Ashish -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-shell-and-StackOverFlowError-tp24508.html Sent from the Apache Spark User List mailing list