[ https://issues.apache.org/jira/browse/SPARK-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147274#comment-14147274 ]
Kousuke Saruta edited comment on SPARK-3610 at 9/25/14 2:35 AM: ---------------------------------------------------------------- Hi [~SK], I'm trying to resolve similar issue and I think I can resolve this issue using Application ID. See https://github.com/apache/spark/pull/2432 was (Author: sarutak): Hi [~skrishna...@gmail.com], I'm trying to resolve similar issue and I think I can resolve this issue using Application ID. See https://github.com/apache/spark/pull/2432 > History server log name should not be based on user input > --------------------------------------------------------- > > Key: SPARK-3610 > URL: https://issues.apache.org/jira/browse/SPARK-3610 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.1.0 > Reporter: SK > Priority: Critical > > Right now we use the user-defined application name when creating the logging > file for the history server. We should use some type of GUID generated from > inside of Spark instead of allowing user input here. It can cause errors if > users provide characters that are not valid in filesystem paths. > Original bug report: > {quote} > The default log files for the Mllib examples use a rather long naming > convention that includes special characters like parentheses and comma.For > e.g. one of my log files is named > "binaryclassifier-with-params(input.txt,100,1.0,svm,l2,0.1)-1410566770032". > When I click on the program on the history server page (at port 18080), to > view the detailed application logs, the history server crashes and I need to > restart it. I am using Spark 1.1 on a mesos cluster. > I renamed the log file by removing the special characters and then it loads > up correctly. I am not sure which program is creating the log files. Can it > be changed so that the default log file naming convention does not include > special characters? > {quote} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org