Hari Shreedharan created SPARK-5342:
---------------------------------------
Summary: Allow long running Spark apps to run on secure YARN/HDFS
Key: SPARK-5342
URL: https://issues.apache.org/jira/browse/SPARK-5342
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.2.0
Reporter: Hari Shreedharan
Currently, Spark apps cannot write to HDFS after the delegation tokens reach
their expiry, which maxes out at 7 days. We must find a way to ensure that we
can run applications for longer - for example, spark streaming apps are
expected to run forever.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
