[jira] [Resolved] (SPARK-8412) java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement HasOffsetRanges

2015-06-18 Thread Sean Owen (JIRA) 

 [ 
https://issues.apache.org/jira/browse/SPARK-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Owen resolved SPARK-8412.
--
Resolution: Duplicate

Good point on the example, and looks like Cody is already on that in SPARK-8390

 java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement 
 HasOffsetRanges
 --

 Key: SPARK-8412
 URL: https://issues.apache.org/jira/browse/SPARK-8412
 Project: Spark
  Issue Type: Bug
  Components: Streaming
Affects Versions: 1.3.0
Reporter: jweinste
Priority: Critical

 // Create direct kafka stream with brokers and topics
 final JavaPairInputDStreamString, String messages = 
 KafkaUtils.createDirectStream(jssc, String.class, String.class, 
 StringDecoder.class,
 StringDecoder.class, kafkaParams, topics);
 messages.foreachRDD(new FunctionJavaPairRDDString, String, 
 Void() {
 @Override
 public Void call(final JavaPairRDDString, String rdd) 
 throws Exception {
 if (rdd instanceof HasOffsetRanges) {
 //will never happen.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Resolved] (SPARK-8412) java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement HasOffsetRanges

2015-06-17 Thread Sean Owen (JIRA) 

 [ 
https://issues.apache.org/jira/browse/SPARK-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Owen resolved SPARK-8412.
--
Resolution: Not A Problem

The JavaPairRDD doesn't implementing it, but the underlying RDD ({{.rdd()}}) 
does.

 java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement 
 HasOffsetRanges
 --

 Key: SPARK-8412
 URL: https://issues.apache.org/jira/browse/SPARK-8412
 Project: Spark
  Issue Type: Bug
  Components: Streaming
Affects Versions: 1.3.0
Reporter: jweinste
Priority: Critical

 // Create direct kafka stream with brokers and topics
 final JavaPairInputDStreamString, String messages = 
 KafkaUtils.createDirectStream(jssc, String.class, String.class, 
 StringDecoder.class,
 StringDecoder.class, kafkaParams, topics);
 messages.foreachRDD(new FunctionJavaPairRDDString, String, 
 Void() {
 @Override
 public Void call(final JavaPairRDDString, String rdd) 
 throws Exception {
 if (rdd instanceof HasOffsetRanges) {
 //will never happen.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org