[ https://issues.apache.org/jira/browse/SPARK-24507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16518287#comment-16518287 ]
Cody Koeninger commented on SPARK-24507: ---------------------------------------- You're welcome to submit a doc PR that clarifies that section is referring to receiver based implementations, and link to the kafka integration guide for the direct stream. I don't think it makes sense to remove it altogether, as there are still multiple other implementations that extend Receiver. > Description in "Level of Parallelism in Data Receiving" section of Spark > Streaming Programming Guide in is not relevan for the recent Kafka direct > apprach > ----------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: SPARK-24507 > URL: https://issues.apache.org/jira/browse/SPARK-24507 > Project: Spark > Issue Type: Documentation > Components: Documentation, DStreams > Affects Versions: 2.3.1 > Reporter: Lev Greenberg > Priority: Minor > > [https://spark.apache.org/docs/2.2.0/streaming-programming-guide.html#level-of-parallelism-in-data-receiving] > describes deprecated "Receiver-based approach" e.g.,: > _"... each input DStream creates a single receiver (running on a worker > machine) that receives a single stream of data"._ > _The first paragraph of > [level-of-parallelism-in-data-receiving|https://spark.apache.org/docs/2.2.0/streaming-programming-guide.html#level-of-parallelism-in-data-receiving] > section including the following code example should be removed._ -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org