execution sequence puzzle

2016-10-01 Thread chen yong
Hello everybody, I am puzzled by the execution sequence of the following scala program. Please tell me if it run in the same sequence on your computer,.and it is normal. Thanks execution sequence according to line number: 26-7-20-27-9-10-12-13-15-7-20-17-18-9-10-12-13-15-7-20-17-18 1. imp

答复: get different results when debugging and running scala program

2016-10-01 Thread chen yong
: chen yong 抄送: user@spark.apache.org 主题: Re: get different results when debugging and running scala program There is no image attached, I'm not sure how the apache mailing lists handle them. Can you provide the output as text? best, --Jakob On Fri, Sep 30, 2016 at 8:25 AM, chen yong wrote: &g

get different results when debugging and running scala program

2016-09-30 Thread chen yong
Hello All, I am using IDEA 15.0.4 to debug a scala program. It is strange to me that the results were different when I debug or run the program. The differences can be seen in the attached filed run.jpg and debug.jpg. The code lines of the scala program are shown below. Thank you all

it does not stop at the breakpoint line within an anonymous function concerning RDD

2016-09-19 Thread chen yong
Hello ALL, I am new to spark. I use IDEA ver 14.0.3 to debug spark recently.It is strange to me that any breakpoint set within an anonymous function concerning RDD,such as breakpoint-1 in the below code snippet, is invalid(a red X appears on the left of the line, mouse hovering message showing

it does not stop at the breakpoint line within an anonymous function concerning RDD

2016-09-19 Thread chen yong
Hello ALL, I am new to spark. I use IDEA ver 14.0.3 to debug spark recently.It is strange to me that any breakpoint set within an anonymous function concerning RDD,such as breakpoint-1 in the below code snippet, is invalid(a red X appears on the left of the line, mouse hovering message showing

答复: 答复: it does not stop at breakpoints which is in an anonymous function

2016-09-18 Thread chen yong
map { i => val x = random * 2 - 1 (breakpoint-1) val y = random * 2 - 1 if (x*x + y*y < 1) 1 else 0 }.reduce(_ + _) println("Pi is roughly " + 4.0 * count / (n - 1)) spark.stop() } } 发件人: Dirceu Semighini Filh

答复: it does not stop at breakpoints which is in an anonymous function

2016-09-16 Thread chen yong
Semighini Filho 发送时间: 2016年9月16日 21:07 收件人: chen yong 抄送: user@spark.apache.org 主题: Re: 答复: 答复: 答复: 答复: t it does not stop at breakpoints which is in an anonymous function Hello Felix, No, this line isn't the one that is triggering the execution of the function, the count does that, unless

答复: it does not stop at breakpoints which is in an anonymous function

2016-09-16 Thread chen yong
ow me the line it is which triggeres the evaluation. Thanks you very much 发件人: Dirceu Semighini Filho 发送时间: 2016年9月16日 21:07 收件人: chen yong 抄送: user@spark.apache.org 主题: Re: 答复: 答复: 答复: 答复: t it does not stop at breakpoints which is in an anonymous function Hello

答复: 答复: 答复: 答复: t it does not stop at breakpoints which is in an anonymous function

2016-09-15 Thread chen yong
breakpont-1, right? 发件人: Dirceu Semighini Filho 发送时间: 2016年9月16日 0:39 收件人: chen yong 抄送: user@spark.apache.org 主题: Re: 答复: 答复: 答复: t it does not stop at breakpoints which is in an anonymous function Hi Felix, Are sure your n is greater than 0? Here it stop

答复: 答复: 答复: t it does not stop at breakpoints which is in an anonymous function

2016-09-15 Thread chen yong
}.reduce(_ + _) val test = x (breakpoint-2 set in this line) 发件人: Dirceu Semighini Filho 发送时间: 2016年9月14日 23:32 收件人: chen yong 主题: Re: 答复: 答复: t it does not stop at breakpoints which is in an anonymous function I don't know which IDE do you use. I use In

答复: 答复: t it does not stop at breakpoints which is in an anonymous function

2016-09-14 Thread chen yong
lp badly needed! 发件人: Dirceu Semighini Filho 发送时间: 2016年9月14日 23:07 收件人: chen yong 主题: Re: 答复: t it does not stop at breakpoints which is in an anonymous function You can call a count in the ide just to debug, or you can wait until it reaches the code, so you can debug. Some ides provide you a

答复: t it does not stop at breakpoints which is in an anonymous function

2016-09-14 Thread chen yong
送时间: 2016年9月14日 22:33 收件人: chen yong 抄送: user@spark.apache.org 主题: Re: t it does not stop at breakpoints which is in an anonymous function Hello Felix, Spark functions run lazy, and that's why it doesn't stop in those breakpoints. They will be executed only when you call some metho

t it does not stop at breakpoints which is in an anonymous function

2016-09-14 Thread chen yong
Hi all, I am newbie to spark. I am learning spark by debugging the spark code. It is strange to me that it does not stop at breakpoints which is in an anonymous function, it is normal in ordianry function, though. It that normal. How to obverse variables in an anonymous function. Please