[
https://issues.apache.org/jira/browse/SPARK-18933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15787331#comment-15787331
]
Sean Owen commented on SPARK-18933:
-----------------------------------
stdout and stderr exist for all processes. You can redirect them as you like.
> Different log output between Terminal screen and stderr file
> ------------------------------------------------------------
>
> Key: SPARK-18933
> URL: https://issues.apache.org/jira/browse/SPARK-18933
> Project: Spark
> Issue Type: Bug
> Components: Deploy, Documentation, Web UI
> Affects Versions: 1.6.3
> Environment: Yarn mode and standalone mode
> Reporter: Sean Wong
> Original Estimate: 612h
> Remaining Estimate: 612h
>
> First of all, I use the default log4j.properties in the Spark conf/
> But I found that the log output(e.g., INFO) is different between Terminal
> screen and stderr File. Some INFO logs exist in both of them. Some INFO logs
> exist in either of them. Why this happens? Is it supposed that the output
> logs are same between the terminal screen and stderr file?
> Then I did a Test. I modified the source code in SparkContext.scala and add
> one line log code "logInfo("This is textFile")" in the textFile function.
> However, after running an application, I found the log "This is textFile"
> shown in the terminal screen. no such log in the stderr file. I am not sure
> if this is a bug. So, hope you can solve this question. Thanks
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
