[
https://issues.apache.org/jira/browse/TOREE-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16164948#comment-16164948
]
ASF GitHub Bot commented on TOREE-97:
-------------------------------------
Github user ribamar-santarosa commented on a diff in the pull request:
https://github.com/apache/incubator-toree/pull/141#discussion_r138678195
--- Diff: etc/pip_install/toree/toreeapp.py ---
@@ -57,6 +59,12 @@ class ToreeInstall(InstallKernelSpec):
spark_home = Unicode(os.getenv(SPARK_HOME, '/usr/local/spark'),
config=True,
help='''Specify where the spark files can be found.'''
)
+ hadoop_conf_dir = Unicode(os.getenv(HADOOP_CONF_DIR,
'/usr/local/hadoop'), config=True,
+ help='''Specify where the hadoop config files can be found.'''
+ )
+ spark_conf_dir = Unicode(os.getenv(SPARK_CONF_DIR,
'/usr/local/spark'), config=True,
+ help='''Specify where the spark config files can be found.'''
--- End diff --
sure, it has to be the place where `spark-env.sh` is found.
> How to support Spark on Yarn model?
> -----------------------------------
>
> Key: TOREE-97
> URL: https://issues.apache.org/jira/browse/TOREE-97
> Project: TOREE
> Issue Type: Bug
> Reporter: Anne623
>
> Hi, All
> Now I test spark-kernel in IPython3.0 released and Spark On Yarn model.
> kernel.json like as below
> {code}
> {
> "display_name": "SparkOnYarn",
> "language": "scala",
> "argv": [
> "/root/local/bin/sparkkernel",
> "--master",
> "yarn-client",
> "--profile",
> "{connection_file}"
> ],
> "codemirror_mode": "scala"
> }
> {code}
> while kernel can not be started.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
