[ https://issues.apache.org/jira/browse/SPARK-21792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated SPARK-21792: ------------------------------ Priority: Minor (was: Major) Not Major. Not all params are meant to be public; these may be considered experimental. I'd check with the author of the file before committing to these. Questions should go to the same, on the mailing list. > Document Spark Streaming Dynamic Allocation Configuration > --------------------------------------------------------- > > Key: SPARK-21792 > URL: https://issues.apache.org/jira/browse/SPARK-21792 > Project: Spark > Issue Type: Documentation > Components: Documentation, DStreams > Affects Versions: 2.2.0 > Reporter: Karthik Palaniappan > Priority: Minor > > Support for dynamic allocation was added in > https://issues.apache.org/jira/browse/SPARK-12133, and it included new config > parameters in > https://github.com/apache/spark/blob/branch-2.0/streaming/src/main/scala/org/apache/spark/streaming/scheduler/ExecutorAllocationManager.scala#L189. > These new parameters should be added to > http://spark.apache.org/docs/latest/configuration.html. > Out of curiosity: why can't Core's dynamic allocation and Streaming's dynamic > allocation both be enabled? It seems like Streaming's dynamic allocation > properties should always be used for streaming applications, and Core's > should always be ignored. (Either way this should be highlighted in the > documentation). -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org