Repository: spark Updated Branches: refs/heads/branch-2.2 93790313b -> df6cd35ec
[SPARK-21508][DOC] Fix example code provided in Spark Streaming Documentation ## What changes were proposed in this pull request? JIRA ticket : [SPARK-21508](https://issues.apache.org/jira/projects/SPARK/issues/SPARK-21508) correcting a mistake in example code provided in Spark Streaming Custom Receivers Documentation The example code provided in the documentation on 'Spark Streaming Custom Receivers' has an error. doc link : https://spark.apache.org/docs/latest/streaming-custom-receivers.html ``` // Assuming ssc is the StreamingContext val customReceiverStream = ssc.receiverStream(new CustomReceiver(host, port)) val words = lines.flatMap(_.split(" ")) ... ``` instead of `lines.flatMap(_.split(" "))` it should be `customReceiverStream.flatMap(_.split(" "))` ## How was this patch tested? this documentation change is tested manually by jekyll build , running below commands ``` jekyll build jekyll serve --watch ``` screen-shots provided below   Author: Remis Haroon <remis.har...@insdc01.pwc.com> Closes #18770 from remisharoon/master. (cherry picked from commit c14382030b373177cf6aa3c045e27d754368a927) Signed-off-by: Sean Owen <so...@cloudera.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/df6cd35e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/df6cd35e Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/df6cd35e Branch: refs/heads/branch-2.2 Commit: df6cd35ecb710b99911f39b9d7d16cac08468b4d Parents: 9379031 Author: Remis Haroon <remis.har...@insdc01.pwc.com> Authored: Sat Jul 29 13:26:10 2017 +0100 Committer: Sean Owen <so...@cloudera.com> Committed: Sat Jul 29 13:26:19 2017 +0100 ---------------------------------------------------------------------- docs/streaming-custom-receivers.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/df6cd35e/docs/streaming-custom-receivers.md ---------------------------------------------------------------------- diff --git a/docs/streaming-custom-receivers.md b/docs/streaming-custom-receivers.md index d4ddcb1..44ae52e 100644 --- a/docs/streaming-custom-receivers.md +++ b/docs/streaming-custom-receivers.md @@ -175,7 +175,7 @@ an input DStream using data received by the instance of custom receiver, as show {% highlight scala %} // Assuming ssc is the StreamingContext val customReceiverStream = ssc.receiverStream(new CustomReceiver(host, port)) -val words = lines.flatMap(_.split(" ")) +val words = customReceiverStream.flatMap(_.split(" ")) ... {% endhighlight %} @@ -187,7 +187,7 @@ The full source code is in the example [CustomReceiver.scala]({{site.SPARK_GITHU {% highlight java %} // Assuming ssc is the JavaStreamingContext JavaDStream<String> customReceiverStream = ssc.receiverStream(new JavaCustomReceiver(host, port)); -JavaDStream<String> words = lines.flatMap(s -> ...); +JavaDStream<String> words = customReceiverStream.flatMap(s -> ...); ... {% endhighlight %} --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
