Also, I have YARN aggregated enabled. But because logs are gone locally,
after the job is killed or failed. I don't have aggregated logs on HDFS.
On Tue, Aug 25, 2015 at 5:39 PM, Chen Song wrote:
> Thanks Navina.
>
> What I found is that containers logs were gone after days locally even
> when t
Thanks Navina.
What I found is that containers logs were gone after days locally even when
the job is still running.
Chen
On Mon, Aug 3, 2015 at 6:06 PM, Navina Ramesh
wrote:
> Hi Chen,
> You can set the yarn.nodemanage.delete.debug-delay-sec config in
> yarn-site.xml, in order to retain the l
Hi Chen,
You can set the yarn.nodemanage.delete.debug-delay-sec config in
yarn-site.xml, in order to retain the logs after the job crashes. Refer
https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-common/yarn-default.xml
(This was intended for debug purpose).
If you need to retain lo
Dump question.
When running samza job on YARN, I found that container logs gone after
days. Is there a YARN config to keep the logs from being deleted for
long-lived streaming job?
--
Chen Song
