spark
program, lets say, intellij idea or eclipse.
Thanks,
Sun.
fightf...@163.com
From: Xi Shen
Date: 2015-03-06 09:19
To: user@spark.apache.org
Subject: Spark code development practice
Hi,
I am new to Spark. I see every spark program has a main
Hi,
You can first establish a scala ide to develop and debug your spark program,
lets say, intellij idea or eclipse.
Thanks,
Sun.
fightf...@163.com
From: Xi Shen
Date: 2015-03-06 09:19
To: user@spark.apache.org
Subject: Spark code development practice
Hi,
I am new to Spark. I see every
,
Sun.
--
fightf...@163.com
*From:* Xi Shen davidshe...@gmail.com
*Date:* 2015-03-06 09:19
*To:* user@spark.apache.org
*Subject:* Spark code development practice
Hi,
I am new to Spark. I see every spark program has a main() function. I
wonder if I can run
establish a scala ide to develop and debug your spark program,
lets say, intellij idea or eclipse.
Thanks,
Sun.
fightf...@163.com
From: Xi Shen
Date: 2015-03-06 09:19
To: user@spark.apache.org
Subject: Spark code development practice
Hi,
I am new to Spark. I see every spark
Hi,
I am new to Spark. I see every spark program has a main() function. I
wonder if I can run the spark program directly, without using spark-submit.
I think it will be easier for early development and debug.
Thanks,
David
Hi Xi,
Yes,
You can do the following:
val sc = new SparkContext(local[2], mptest)
// or .. val sc = new SparkContext(spark://master:7070, mptest)
val fileDataRdd = sc.textFile(/path/to/dir)
val fileLines = fileDataRdd.take(100)
The key here - i.e. the answer to your specific question -
