new to Spark - trying to get a basic example to run - could use some help

2016-02-12 Thread Taylor, Ronald C
Hello folks, This is my first msg to the list. New to Spark, and trying to run the SparkPi example shown in the Cloudera documentation. We have Cloudera 5.5.1 running on a small cluster at our lab, with Spark 1.5. My trial invocation is given below. The output that I get *says* that I "SUCCEE

Re: new to Spark - trying to get a basic example to run - could use some help

2016-02-13 Thread Chandeep Singh
Try looking at stdout logs. I ran the exactly same job as you and did not see anything on the console as well but found it in stdout. [csingh@<> ~]$ spark-submit --class org.apache.spark.examples.SparkPi --master yarn--deploy-mode cluster--name RT_SparkPi /opt/cloudera/parcels/CDH-5.5.1

Re: new to Spark - trying to get a basic example to run - could use some help

2016-02-13 Thread Ted Yu
Maybe a comment should be added to SparkPi.scala, telling user to look for the value in stdout log ? Cheers On Sat, Feb 13, 2016 at 3:12 AM, Chandeep Singh wrote: > Try looking at stdout logs. I ran the exactly same job as you and did not > see anything on the console as well but found it in st