Hey all,

I was wondering if there is a way to access/edit the command on Spark
Executors while using Docker on Mesos.

The reason is this: I am using the MapR File Client, and the Spark Driver
is trying to execute things as my user "user1" and since the executors are
running as root inside and the MapR file client is trying to get user
information for my user which doesn't exist in the docker container.

This is something I've handled on my cluster by having a user sync file and
a docker file that you can specify the user you are running as in the
command

So for example, when I run Zeppelin, I instead of
$ZEPPELIN_HOME/bin/zeppelin.sh, in Marathon I execute

/mapr/clustername/dockersync.sh user1 && su -c
$ZEPPELIN_HOME/bin/zeppelin.sh user1

Now my user I am running as, and all the groups that user is in is
installed into the docker container and when I start Zeppelin it's running
as that user (with the correct UIDs and GIDs)

so with the Mesos images, I'd like to be able to alter the command and
prepend my docker sync file to install the users so credentials etc can be
preserved.  There may be other uses as well, but since we can access the
image, the volumes, and the port maps, allowing us to edit the command
(have the default be "what works" and if we edit in such a way, it's our
own fault)  could give us the freedom to do things like this... does this
capability exist?

Thanks,

John

Reply via email to