Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19061#discussion_r142570065 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -598,6 +598,15 @@ object SparkSubmit extends CommandLineUtils with Logging { } } + // In case of shells, spark.ui.showConsoleProgress can be true by default or by user. + if (isShell(args.primaryResource)) { + if (!sparkConf.contains("spark.ui.showConsoleProgress")) { + sysProps("spark.ui.showConsoleProgress") = "true" + } + } else { + sysProps("spark.ui.showConsoleProgress") = "false" --- End diff -- Or, yes. It can be removed because `SparkContext` also accepts user's configuration. In that case, you're right. This is not needed.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org