1) Application container logs from Web RM UI never load on browser. I eventually have to kill the browser. 2) /apache/hadoop/bin/yarn logs -applicationId application_1429087638744_151059 | less emits logs only after the application has completed.
Are there no better ways to see the logs as they are emitted. Something similar to hadoop world ? On Mon, Apr 27, 2015 at 1:58 PM, Zoltán Zvara <zoltan.zv...@gmail.com> wrote: > You can check container logs from RM web UI or when log-aggregation is > enabled with the yarn command. There are other, but less convenient > options. > > On Mon, Apr 27, 2015 at 8:53 AM ÐΞ€ρ@Ҝ (๏̯͡๏) <deepuj...@gmail.com> wrote: > >> Spark 1.3 >> >> 1. View stderr/stdout from executor from Web UI: when the job is running >> i figured out the executor that am suppose to see, and those two links show >> 4 special characters on browser. >> >> 2. Tail on Yarn logs: >> >> /apache/hadoop/bin/yarn logs -applicationId >> application_1429087638744_151059 | less >> Threw me: Application has not completed. Logs are only available after an >> application completes >> >> >> Any other ideas that i can try ? >> >> >> >> On Sat, Apr 25, 2015 at 12:07 AM, Sven Krasser <kras...@gmail.com> wrote: >> >>> On Fri, Apr 24, 2015 at 11:31 AM, Marcelo Vanzin <van...@cloudera.com> >>> wrote: >>> >>>> >>>> Spark 1.3 should have links to the executor logs in the UI while the >>>> application is running. Not yet in the history server, though. >>> >>> >>> You're absolutely correct -- didn't notice it until now. This is a great >>> addition! >>> >>> -- >>> www.skrasser.com <http://www.skrasser.com/?utm_source=sig> >>> >> >> >> >> -- >> Deepak >> >> -- Deepak
