Re: use spark-shell in the source

2014-06-12 Thread Andrew Or
Not sure if this is what you're looking for, but have you looked at java's ProcessBuilder? You can do something like for (line - lines) { val command = line.split( ) // You may need to deal with quoted strings val process = new ProcessBuilder(command) // redirect output of process to main

Re: use spark-shell in the source

2014-06-12 Thread Kevin Jung
Thanks for answer. Yes, I tried to launch an interactive REPL in the middle of my application :) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/use-spark-shell-in-the-source-tp7453p7539.html Sent from the Apache Spark User List mailing list archive

use spark-shell in the source

2014-06-11 Thread JaeBoo Jung
Title: Samsung Enterprise Portal mySingle Hi all, Can I use spark-shell programmatically in my spark application(in java or scala)? Because I want toconvert scalalines to string array and run automatically in my application. For example, for( var line - lines){ //run this line in spark