[
https://issues.apache.org/jira/browse/SPARK-1182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334361#comment-14334361
]
Reynold Xin edited comment on SPARK-1182 at 2/24/15 4:01 AM:
-------------------------------------------------------------
Actually when I filed this ticket, I don't think there was extensive high level
grouping of config options (there was maybe two or three). I took a look at the
latest grouping and they looked reasonable.
A few problems with the existing grouping:
1. Networking section actually contains some shuffle settings. Those should be
moved into shuffle.
2. Application Properties contains some serialization settings. Those should be
moved into Compression and Serialization.
3. Runtime Environment contains some Mesos specific setting. All the way down
on the page we link to each resource manager's own page for resource manager
specific settings.
4. Scheduling section contains a mesos specific setting (spark.mesos.coarse).
5. It is sort of arbitrary that "Dynamic allocation" has its own section (at
the very least, "a" should be upper case.)
6. "spark.ui.view.acls" is in security, but it also belongs in UI. Where do we
put stuff like this?
was (Author: rxin):
Actually when I filed this ticket, I don't think there was any extensive high
level grouping of config options (there was maybe two or three). I took a look
at the latest grouping and they looked reasonable.
A few problems with the existing grouping:
1. Networking section actually contains some shuffle settings. Those should be
moved into shuffle.
2. Application Properties contains some serialization settings. Those should be
moved into Compression and Serialization.
3. Runtime Environment contains some Mesos specific setting. All the way down
on the page we link to each resource manager's own page for resource manager
specific settings.
4. Scheduling section contains a mesos specific setting (spark.mesos.coarse).
5. It is sort of arbitrary that "Dynamic allocation" has its own section (at
the very least, "a" should be upper case.)
6. "spark.ui.view.acls" is in security, but it also belongs in UI. Where do we
put stuff like this?
> Sort the configuration parameters in configuration.md
> -----------------------------------------------------
>
> Key: SPARK-1182
> URL: https://issues.apache.org/jira/browse/SPARK-1182
> Project: Spark
> Issue Type: Task
> Components: Documentation
> Reporter: Reynold Xin
> Assignee: prashant
> Priority: Minor
>
> It is a little bit confusing right now since the config options are all over
> the place in some arbitrarily sorted order.
> https://github.com/apache/spark/blob/master/docs/configuration.md
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
