[
https://issues.apache.org/jira/browse/SPARK-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14297449#comment-14297449
]
Wing Yew Poon commented on SPARK-5485:
--------------------------------------
It should be "spark.streaming.receiver.writeAheadLog.enable" (no 's' in "Log").
> typo in spark streaming configuration parameter
> -----------------------------------------------
>
> Key: SPARK-5485
> URL: https://issues.apache.org/jira/browse/SPARK-5485
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 1.2.0
> Reporter: Wing Yew Poon
>
> In
> https://spark.apache.org/docs/1.2.0/streaming-programming-guide.html#deploying-applications,
> under "Requirements", the bullet point on "Configuring write ahead logs" says
> "This can be enabled by setting the configuration parameter
> spark.streaming.receiver.writeAheadLogs.enable to true."
> There is an unfortunate typo in the name of the parameter, which I
> copied-and-pasted into my deployment where I was testing it out and seeing
> data loss as a result.
> The same typo occurs in
> https://spark.apache.org/docs/1.2.0/configuration.html, which is even more
> unfortunate.
> Documentation should not have typos like this for configuration parameters. I
> later found the correct parameter on
> http://databricks.com/blog/2015/01/15/improved-driver-fault-tolerance-and-zero-data-loss-in-spark-streaming.html.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
