You can disable with spark.ui.showConsoleProgress=false but I also wasn't sure why this writes straight to System.err, at first. I assume it's because it's writing carriage returns to achieve the animation and this won't work via a logging framework. stderr is where log-like output goes, because stdout is for program output.
On Wed, Apr 1, 2015 at 10:56 AM, Theodore Vasiloudis <theodoros.vasilou...@gmail.com> wrote: > Since switching to Spark 1.2.1 I'm seeing logging for the stage progress > (ex.): > > [error] [Stage 2154:====> (14 + 8) / 48][Stage 2210:> > (0 + 0) / 48] > > Any reason why these are error level logs? Shouldn't they be info level? > > In any case is there a way to disable them other than disabling logging > completely? > I would like to see my info level logs on stdout (i.e. my printouts) but not > these stage progress logs. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Disable-stage-logging-to-stdout-tp22336.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
