I also noticed that spark.replClassServer.host and spark.replClassServer.port
aren’t used anymore. The transport now happens over the main RpcEnv.
Kind regards,
Radek Gruchalski
ra...@gruchalski.com (mailto:ra...@gruchalski.com)
(mailto:ra...@gruchalski.com)
There was a talk in this thread about removing the fine-grained Mesos
scheduler. I think it would a loss to lose it completely, however, I understand
that it might be a burden to keep it under development for Mesos only.
Having been thinking about it for a while, it would be great if the
Dear all,
I am currently looking at modifying NettyRpcEnv for this PR:
https://github.com/apache/spark/pull/9608
The functionality which I’m trying to achieve is the following: if there is a
configuration property spark.driver.advertisedPort, make executors reply to
advertisedPort instead of
-named person and may be
confidential and/or legally privileged.
If it has come to you in error you must take no action based on it, nor must
you copy or show it to anyone; please delete/destroy and inform the sender
immediately.
On Thursday, 26 November 2015 at 20:45, Rad Gruchalski wrote
Bowen,
One project to look at could be spark-notebook:
https://github.com/andypetrella/spark-notebook
It uses Spark you in the way you intend to use it.
Kind regards,
Radek Gruchalski
ra...@gruchalski.com (mailto:ra...@gruchalski.com)
(mailto:ra...@gruchalski.com)
zhang wrote:
> Thanks Rad for info. I looked into the repo and see some .snb file using
> spark mllib. Can you give me a more specific place to look for when invoking
> the mllib functions? What if I just want to invoke some of the ML functions
> in my HelloWorld.java?
>
Dear Team,
We, Virdata, would like to present the result of the last few months of our
work with Mesos and Spark. Our requirement was to run Spark on Mesos in Docker
for multi-tenant.
This required adapting Spark to run in Docker with Bridge networking.
The result (and patches) of our work
