Georgy created ZEPPELIN-3106:
--------------------------------
Summary: User impersonation in SPARK is not working
Key: ZEPPELIN-3106
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3106
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.8.0
Environment: Hadoop: HDP 2.5.3 (Hadoop 2.7.3)
Zeppelin 0.8 build from master branch
Reporter: Georgy
Hi guys,
Tried to enable user impersonation for spark interpreter as it was described in
doc file in PR for https://issues.apache.org/jira/browse/ZEPPELIN-3016. It
doesn't work and I can't find any helpful information in zeppelin or yarn logs.
Found that username is not passed to interpreter.sh script, execution string
looks so:
12572 13384 12560 4302 pts/2 16246 S 602 0:00 \_ /bin/bash
/opt/zeppelin-0.8.0-SNAPSHOT/bin/interpreter.sh -d
/opt/zeppelin-0.8.0-SNAPSHOT/interpreter/spark -c 10.42.85.113 -p 31652 -r : -l
/opt/zeppelin-0.8.0-SNAPSHOT/local-repo/2D2X6G38H -g spark
As you can see there is no "u" flag, so user is not specified. But if I use
Zeppelin 0.7.3 from HDP 2.6.3 user impersonation works good and execution
string is:
16527 16687 16518 4302 pts/2 16816 S 602 0:00 \_ /bin/bash
/usr/hdp/current/zeppelin-server/bin/interpreter.sh -d
/usr/hdp/current/zeppelin-server/interpreter/spark -p 28284 -u %username% -l
/usr/hdp/current/zeppelin-server/local-repo/2D3X1UVG2 -g spark
Is there some problem with zeppelin configuration?
My zeppelin-env.sh:
export SPARK_HOME="/usr/lib/spark"
export PYTHONPATH="${SPARK_HOME}/python:${SPARK_HOME}/python/build:$PYTHONPATH"
export PYSPARK_PYTHON="/usr/bin/python"
export JAVA_HOME="/usr/java/latest"
export HADOOP_CONF_DIR="/etc/hadoop/conf"
export YARN_QUEUE="%myqueue%"
export SPARK_SCALA_VERSION="2.11"
export ZEPPELIN_WAR_TEMPDIR="/tmp/zeppelin-war"
export ZEPPELIN_IMPERSONATE_SPARK_PROXY_USER="true"
All configs for Zeppelin 0.7.3 from HDP 2.6.3 and Zeppelin 0.8 are the same. So
can't find the reason why it doesn't work for 0.8 version. Can attach other
config files if you need them.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
