SPARK-22256
Hello, my name is David McWhorter and I created a new pull request to address the SPARK-22256 ticket at https://github.com/apache/spark/pull/30739. This change adds a memory overhead setting for the spark driver running on mesos. This is a reopening of a prior pull request that was never merged. I am wondering if I could request that someone review the change and merge it if it looks acceptable? I'm happy to do any further testing or make further changes if they are needed but it looked good from the prior review. Many thanks, David McWhorter
Re: spark-yarn_2.10 1.2.0 artifacts
Thank you, Sean, using spark-network-yarn seems to do the trick. On 12/19/2014 12:13 PM, Sean Owen wrote: I believe spark-yarn does not exist from 1.2 onwards. Have a look at spark-network-yarn for where some of that went, I believe. On Fri, Dec 19, 2014 at 5:09 PM, David McWhorter mcwhor...@ccri.com wrote: Hi all, Thanks for your work on spark! I am trying to locate spark-yarn jars for the new 1.2.0 release. The jars for spark-core, etc, are on maven central, but the spark-yarn jars are missing. Confusingly and perhaps relatedly, I also can't seem to get the spark-yarn artifact to install on my local computer when I run 'mvn -Pyarn -Phadoop-2.2 -Dhadoop.version=2.2.0 -DskipTests clean install'. At the install plugin stage, maven reports: [INFO] --- maven-install-plugin:2.5.1:install (default-install) @ spark-yarn_2.10 --- [INFO] Skipping artifact installation Any help or insights into how to use spark-yarn_2.10 1.2.0 in a maven build would be appreciated. David -- David McWhorter Software Engineer Commonwealth Computer Research, Inc. 1422 Sachem Place, Unit #1 Charlottesville, VA 22901 mcwhor...@ccri.com | 434.299.0090x204 - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org -- David McWhorter Software Engineer Commonwealth Computer Research, Inc. 1422 Sachem Place, Unit #1 Charlottesville, VA 22901 mcwhor...@ccri.com | 434.299.0090x204 - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
spark-yarn_2.10 1.2.0 artifacts
Hi all, Thanks for your work on spark! I am trying to locate spark-yarn jars for the new 1.2.0 release. The jars for spark-core, etc, are on maven central, but the spark-yarn jars are missing. Confusingly and perhaps relatedly, I also can't seem to get the spark-yarn artifact to install on my local computer when I run 'mvn -Pyarn -Phadoop-2.2 -Dhadoop.version=2.2.0 -DskipTests clean install'. At the install plugin stage, maven reports: [INFO] --- maven-install-plugin:2.5.1:install (default-install) @ spark-yarn_2.10 --- [INFO] Skipping artifact installation Any help or insights into how to use spark-yarn_2.10 1.2.0 in a maven build would be appreciated. David -- David McWhorter Software Engineer Commonwealth Computer Research, Inc. 1422 Sachem Place, Unit #1 Charlottesville, VA 22901 mcwhor...@ccri.com | 434.299.0090x204 - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
