See http://search-hadoop.com/m/JW1q5AneoE1
Cheers
On Mon, Mar 9, 2015 at 7:29 AM, rok <rokros...@gmail.com> wrote:
> I'm using log aggregation on YARN with Spark and I am not able to see the
> logs through the YARN web UI after the application completes:
>
> Failed redirect for container_1425390894284_0066_01_000001
>
> Failed while trying to construct the redirect url to the log server. Log
> Server url may not be configured
> java.lang.Exception: Unknown container. Container either has not started or
> has already completed or doesn't belong to this node at all.
>
> I tried setting
>
>
> log4j.appender.file_appender.File=${spark.yarn.app.container.log.dir}/spark.log
>
> in log4j.properties as suggested in the documentation, but didn't seem to
> change anything.
>
> Note that I can see the logs fine using "yarn logs" from the command line,
> so aggregation is working properly. For regular mapreduce jobs, the YARN UI
> displays the logs correctly as well. Is there a spark configuration option
> that needs to be set if aggregation is used?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/failure-to-display-logs-on-YARN-UI-with-log-aggregation-on-tp21974.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>
