?
On Tue, Jul 28, 2015 at 9:30 AM, Nicolas Phung nicolas.ph...@gmail.com
wrote:
Hi,
After using KafkaUtils.createDirectStream[Object, Object,
KafkaAvroDecoder, KafkaAvroDecoder, Option[AnalyticEventEnriched]](ssc,
kafkaParams, map, messageHandler), I'm encountering the following issue:
15/07/28
help Cody.
Regards,
Nicolas PHUNG
On Tue, Jul 21, 2015 at 4:53 PM, Cody Koeninger c...@koeninger.org wrote:
Yeah, I'm referring to that api.
If you want to filter messages in addition to catching that exception,
have your mesageHandler return an option, so the type R would end up being
Option
...@koeninger.org wrote:
Yeah, in the function you supply for the messageHandler parameter to
createDirectStream, catch the exception and do whatever makes sense for
your application.
On Mon, Jul 20, 2015 at 11:58 AM, Nicolas Phung nicolas.ph...@gmail.com
wrote:
Hello,
Using the old Spark
or
suggestions, please tell me.
Regards,
Nicolas PHUNG
On Thu, Jul 16, 2015 at 7:08 PM, Cody Koeninger c...@koeninger.org wrote:
Not exactly the same issue, but possibly related:
https://issues.apache.org/jira/browse/KAFKA-1196
On Thu, Jul 16, 2015 at 12:03 PM, Cody Koeninger c...@koeninger.org
or KafkaUtils.createDirectStream ?
Regards,
Nicolas PHUNG
On Mon, Jul 20, 2015 at 3:46 PM, Cody Koeninger c...@koeninger.org wrote:
I'd try logging the offsets for each message, see where problems start,
then try using the console consumer starting at those offsets and see if
you can reproduce
the checkpoint as expected without missing data. Did someone encounters
something similar ? How did you solve this ?
Regards,
Nicolas PHUNG
ADAMKryoRegistrator.scala
https://github.com/bigdatagenomics/adam/blob/master/adam-core/src/main/scala/org/bdgenomics/adam/serialization/ADAMKryoRegistrator.scala
too
but it doesn't work either.
Regards,
Nicolas PHUNG
Hello,
@Akhil Das I'm trying to use the experimental API
https://github.com/apache/spark/blob/master/examples/scala-2.10/src/main/scala/org/apache/spark/examples/streaming/DirectKafkaWordCount.scala
to write this with
kafka topic with multiple partitions.
Regards,
Nicolas PHUNG
