Re: Integrating Spark with other applications

2014-11-07 Thread Thomas Risberg
Hi, I'm a committer on that spring-hadoop project and I'm also interested in integrating Spark with other Java applications. I would love to see some guidance from the Spark community for the best way to accomplish this. We have plans to add features to work with Spark Apps in similar ways we now

How to set JAVA_HOME with --deploy-mode cluster

2014-10-27 Thread Thomas Risberg
Hi, I'm trying to run the SparkPi example using `--deploy-mode cluster`. Not having much luck. Looks like the JAVA_HOME on my Mac is used for launching the app on the Spark cluster running on CentOS. How can I set the JAVA_HOME or better yet, how can I configure Spark to use the JAVA_HOME