Re: How to submit Pyspark job in mesos?
Maybe mesos or spark was not configured correctly, could you check the log files in mesos slaves? It should log the reason when mesos can not lunch the executor. On Tue, Jul 29, 2014 at 10:39 PM, daijia jia_...@intsig.com wrote: Actually, it runs okay in my slaves deployed by standalone mode. When I switch to mesos, the error just occurs. Anyway, thanks for your reply and any ideas will help. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-submit-Pyspark-job-in-mesos-tp10905p10918.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Wanna know more about Pyspark Internals
https://cwiki.apache.org/confluence/display/SPARK/PySpark+Internals Hope it's useful for you. Davies On Thu, Jul 10, 2014 at 8:49 PM, Baofeng Zhang pelickzh...@qq.com wrote: In addition to wiki on Confluence https://cwiki.apache.org/confluence/display/SPARK/PySpark+Internals or reading source code, where/how can I get more information about Pyspark internals, for I am so familiar with python :( -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Wanna-know-more-about-Pyspark-Internals-tp9387.html Sent from the Apache Spark User List mailing list archive at Nabble.com. -- - Davies
