Re: println not appearing in libraries when running job using spark-submit --master local

2016-03-28 Thread Kevin Peng 
Ted,

What triggerAndWait does is perform a rest call to a specified url and then
waits until the status message that gets returned by that url in a json a
field says complete.  The issues is I put a println at the very top of the
method and that doesn't get printed out, and I know that println isn't
causing an issues because there is an exception that I throw further down
the line and that exception is what I am currently getting, but none of the
println along the way are showing:


  def triggerAndWait(url: String, pollInterval: Int = 1000 * 30,

timeOut: Int = 1000 * 60 * 60, connectTimeout: Int = 3,

readTimeout: Int = 3, requestMethod: String = "GET"): Boolean = {

println("Entering triggerAndWait function - url: " + url +

  " pollInterval: " + pollInterval.toString() + " timeOut: " +

  timeOut.toString() + " connectionTimeout: " +

  connectTimeout.toString() + " readTimeout: " + readTimeout.toString()
+

  " requestMethod: " + requestMethod)


.


Thanks,


KP

On Mon, Mar 28, 2016 at 1:52 PM, Ted Yu <yuzhih...@gmail.com> wrote:

> Can you describe what gets triggered by triggerAndWait ?
>
> Cheers
>
> On Mon, Mar 28, 2016 at 1:39 PM, kpeng1 <kpe...@gmail.com> wrote:
>
>> Hi All,
>>
>> I am currently trying to debug a spark application written in scala.  I
>> have
>> a main method:
>>   def main(args: Array[String]) {
>> ...
>>  SocialUtil.triggerAndWait(triggerUrl)
>> ...
>>
>> The SocialUtil object is included in a seperate jar.  I launched the
>> spark-submit command using --jars passing the SocialUtil jar.  Inside the
>> triggerAndWait function I have a println statement that is the first thing
>> in the method, but it doesn't seem to be coming out.  All println that
>> happen inside the main function directly are appearing though.  I was
>> wondering if anyone knows what is going on in this situation and how I can
>> go about making the println in the SocialUtil object appear.
>>
>> Thanks,
>>
>> KP
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/println-not-appearing-in-libraries-when-running-job-using-spark-submit-master-local-tp26617.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> -
>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>> For additional commands, e-mail: user-h...@spark.apache.org
>>
>>
>

Re: println not appearing in libraries when running job using spark-submit --master local

2016-03-28 Thread Ted Yu 
Can you describe what gets triggered by triggerAndWait ?

Cheers

On Mon, Mar 28, 2016 at 1:39 PM, kpeng1 <kpe...@gmail.com> wrote:

> Hi All,
>
> I am currently trying to debug a spark application written in scala.  I
> have
> a main method:
>   def main(args: Array[String]) {
> ...
>  SocialUtil.triggerAndWait(triggerUrl)
> ...
>
> The SocialUtil object is included in a seperate jar.  I launched the
> spark-submit command using --jars passing the SocialUtil jar.  Inside the
> triggerAndWait function I have a println statement that is the first thing
> in the method, but it doesn't seem to be coming out.  All println that
> happen inside the main function directly are appearing though.  I was
> wondering if anyone knows what is going on in this situation and how I can
> go about making the println in the SocialUtil object appear.
>
> Thanks,
>
> KP
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/println-not-appearing-in-libraries-when-running-job-using-spark-submit-master-local-tp26617.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>

println not appearing in libraries when running job using spark-submit --master local

2016-03-28 Thread kpeng1 
Hi All,

I am currently trying to debug a spark application written in scala.  I have
a main method: 
  def main(args: Array[String]) {
...
 SocialUtil.triggerAndWait(triggerUrl)
...

The SocialUtil object is included in a seperate jar.  I launched the
spark-submit command using --jars passing the SocialUtil jar.  Inside the
triggerAndWait function I have a println statement that is the first thing
in the method, but it doesn't seem to be coming out.  All println that
happen inside the main function directly are appearing though.  I was
wondering if anyone knows what is going on in this situation and how I can
go about making the println in the SocialUtil object appear.

Thanks,

KP




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/println-not-appearing-in-libraries-when-running-job-using-spark-submit-master-local-tp26617.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org