[ https://issues.apache.org/jira/browse/SPARK-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169663#comment-14169663 ]
Nan Zhu commented on SPARK-1192: -------------------------------- yes, I resubmitted https://github.com/apache/spark/pull/2312 for Matei's request (removed some, add some....) it's still valid > Around 30 parameters in Spark are used but undocumented and some are having > confusing name > ------------------------------------------------------------------------------------------ > > Key: SPARK-1192 > URL: https://issues.apache.org/jira/browse/SPARK-1192 > Project: Spark > Issue Type: Improvement > Components: Documentation > Affects Versions: 1.0.0 > Reporter: Nan Zhu > Assignee: Nan Zhu > > I grep the code in core component, I found that around 30 parameters in the > implementation is actually used but undocumented. By reading the source code, > I found that some of them are actually very useful for the user. > I suggest to make a complete document on the parameters. > Also some parameters are having confusing names > spark.shuffle.copier.threads - this parameters is to control how many threads > you will use when you start a Netty-based shuffle service....but from the > name, we cannot get this information > spark.shuffle.sender.port - the similar problem with the above one, when you > use Netty-based shuffle receiver, you will have to setup a Netty-based > sender...this parameter is to setup the port used by the Netty sender, but > the name cannot convey this information -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org