Thank you Sean that does the trick.
On Wed, Apr 1, 2015 at 12:05 PM, Sean Owen <so...@cloudera.com> wrote: > You can disable with spark.ui.showConsoleProgress=false but I also > wasn't sure why this writes straight to System.err, at first. I assume > it's because it's writing carriage returns to achieve the animation > and this won't work via a logging framework. stderr is where log-like > output goes, because stdout is for program output. > > On Wed, Apr 1, 2015 at 10:56 AM, Theodore Vasiloudis > <theodoros.vasilou...@gmail.com> wrote: > > Since switching to Spark 1.2.1 I'm seeing logging for the stage progress > > (ex.): > > > > [error] [Stage 2154:====> (14 + 8) / 48][Stage 2210:> > > (0 + 0) / 48] > > > > Any reason why these are error level logs? Shouldn't they be info level? > > > > In any case is there a way to disable them other than disabling logging > > completely? > > I would like to see my info level logs on stdout (i.e. my printouts) but > not > > these stage progress logs. > > > > > > > > -- > > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Disable-stage-logging-to-stdout-tp22336.html > > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > > For additional commands, e-mail: user-h...@spark.apache.org > > >
