[ https://issues.apache.org/jira/browse/SPARK-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14255111#comment-14255111 ]
Tomas Hudik commented on SPARK-2261: ------------------------------------ hi Marcelo, is this https://issues.apache.org/jira/browse/SPARK-4910 issue in your scope? thx, Tomas > Spark application event logs are not very NameNode-friendly > ----------------------------------------------------------- > > Key: SPARK-2261 > URL: https://issues.apache.org/jira/browse/SPARK-2261 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 1.0.0 > Reporter: Marcelo Vanzin > Assignee: Marcelo Vanzin > Priority: Minor > Fix For: 1.3.0 > > > Currently, EventLoggingListener will generate application logs using, in the > worst case, five different entries in the file system: > * The directory to hold the files > * One file for the Spark version > * One file for the event logs > * One file to identify the compression codec of the event logs > * One file to say the application is finished. > It would be better to be more friendly to the NameNodes and use a single > entry for all of those. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org