[ 
https://issues.apache.org/jira/browse/SPARK-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371330#comment-14371330
 ] 

Cody Koeninger commented on SPARK-6434:
---------------------------------------

Yeah, I didn't notice alberto had also created a ticket, we can mark one as 
duplicate.

The thing is, I definitely would expect the stream to fail if I typo the name 
of the topic.  I'm not 100% certain without trying it out whether you can tell 
the difference between a topic that doesn't exist and a topic that doesn't have 
messages, solely through the metadata api.

> [Streaming][Kafka] CreateDirectStream for empty topics
> ------------------------------------------------------
>
>                 Key: SPARK-6434
>                 URL: https://issues.apache.org/jira/browse/SPARK-6434
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming
>    Affects Versions: 1.3.0
>            Reporter: Cody Koeninger
>            Priority: Minor
>             Fix For: 1.3.1
>
>
> http://apache-spark-developers-list.1001551.n3.nabble.com/Exception-using-the-new-createDirectStream-util-method-td11118.html
> Looks like kafka metadata apis don't return leaders for topics that don't 
> have messages yet.
> Should either try to work around this, or document that topics need messages 
> before starting the stream.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to