Re: run-example streaming.KafkaWordCount fails on CDH 5.7.0

2016-05-04 Thread Cody Koeninger 
Kafka 0.8.2 should be fine.

If it works on your laptop but not on CDH, as Sean said you'll
probably get better help on CDH forums.

On Wed, May 4, 2016 at 4:19 AM, Michel Hubert <mich...@phact.nl> wrote:
> We're running Kafka 0.8.2.2
> Is that the problem, why?
>
> -Oorspronkelijk bericht-
> Van: Sean Owen [mailto:so...@cloudera.com]
> Verzonden: woensdag 4 mei 2016 10:41
> Aan: Michel Hubert <mich...@phact.nl>
> CC: user@spark.apache.org
> Onderwerp: Re: run-example streaming.KafkaWordCount fails on CDH 5.7.0
>
> Please try the CDH forums; this is the Spark list:
> http://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/bd-p/Spark
>
> Before you even do that, I can tell you to double check you're running Kafka 
> 0.9.
>
> On Wed, May 4, 2016 at 9:29 AM, Michel Hubert <mich...@phact.nl> wrote:
>>
>>
>> Hi,
>>
>>
>>
>> After an upgrade to CDH 5.7.0 we have troubles with the Kafka to Spark
>> Streaming.
>>
>>
>>
>> The example jar doesn’t work:
>>
>>
>>
>> /opt/cloudera/parcels/CDH/lib/spark/bin/run-example
>> streaming.KafkaWordCount ….
>>
>>
>>
>> Attached is a log file.
>>
>>
>>
>> 16/05/04 10:06:23 WARN consumer.ConsumerFetcherThread:
>> [ConsumerFetcherThread-wordcount1_host81436-cld.domain.com-14623491821
>> 72-13b9f2e7-0-2], Error in fetch
>> kafka.consumer.ConsumerFetcherThread$FetchRequest@47fb7e6d.
>> Possible cause: java.nio.BufferUnderflowException
>>
>> 16/05/04 10:06:24 WARN consumer.ConsumerFetcherThread:
>> [ConsumerFetcherThread-wordcount1_host81436-cld.domain.com-14623491821
>> 72-13b9f2e7-0-1], Error in fetch
>> kafka.consumer.ConsumerFetcherThread$FetchRequest@73b9a762.
>> Possible cause: java.lang.IllegalArgumentException
>>
>>
>>
>> We have no problem running this from my development pc, only in
>> product op CDH 5.7.0 environment.
>>
>>
>>
>>
>>
>> Any ideas?
>>
>>
>>
>> Thanks,
>>
>> Michel
>>
>>
>>
>>
>>
>> -
>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For
>> additional commands, e-mail: user-h...@spark.apache.org
>

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

RE: run-example streaming.KafkaWordCount fails on CDH 5.7.0

2016-05-04 Thread Michel Hubert 
We're running Kafka 0.8.2.2
Is that the problem, why?

-Oorspronkelijk bericht-
Van: Sean Owen [mailto:so...@cloudera.com] 
Verzonden: woensdag 4 mei 2016 10:41
Aan: Michel Hubert <mich...@phact.nl>
CC: user@spark.apache.org
Onderwerp: Re: run-example streaming.KafkaWordCount fails on CDH 5.7.0

Please try the CDH forums; this is the Spark list:
http://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/bd-p/Spark

Before you even do that, I can tell you to double check you're running Kafka 
0.9.

On Wed, May 4, 2016 at 9:29 AM, Michel Hubert <mich...@phact.nl> wrote:
>
>
> Hi,
>
>
>
> After an upgrade to CDH 5.7.0 we have troubles with the Kafka to Spark 
> Streaming.
>
>
>
> The example jar doesn’t work:
>
>
>
> /opt/cloudera/parcels/CDH/lib/spark/bin/run-example 
> streaming.KafkaWordCount ….
>
>
>
> Attached is a log file.
>
>
>
> 16/05/04 10:06:23 WARN consumer.ConsumerFetcherThread:
> [ConsumerFetcherThread-wordcount1_host81436-cld.domain.com-14623491821
> 72-13b9f2e7-0-2], Error in fetch 
> kafka.consumer.ConsumerFetcherThread$FetchRequest@47fb7e6d.
> Possible cause: java.nio.BufferUnderflowException
>
> 16/05/04 10:06:24 WARN consumer.ConsumerFetcherThread:
> [ConsumerFetcherThread-wordcount1_host81436-cld.domain.com-14623491821
> 72-13b9f2e7-0-1], Error in fetch 
> kafka.consumer.ConsumerFetcherThread$FetchRequest@73b9a762.
> Possible cause: java.lang.IllegalArgumentException
>
>
>
> We have no problem running this from my development pc, only in 
> product op CDH 5.7.0 environment.
>
>
>
>
>
> Any ideas?
>
>
>
> Thanks,
>
> Michel
>
>
>
>
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For 
> additional commands, e-mail: user-h...@spark.apache.org

Re: run-example streaming.KafkaWordCount fails on CDH 5.7.0

2016-05-04 Thread Sean Owen 
Please try the CDH forums; this is the Spark list:
http://community.cloudera.com/t5/Advanced-Analytics-Apache-Spark/bd-p/Spark

Before you even do that, I can tell you to double check you're running
Kafka 0.9.

On Wed, May 4, 2016 at 9:29 AM, Michel Hubert  wrote:
>
>
> Hi,
>
>
>
> After an upgrade to CDH 5.7.0 we have troubles with the Kafka to Spark
> Streaming.
>
>
>
> The example jar doesn’t work:
>
>
>
> /opt/cloudera/parcels/CDH/lib/spark/bin/run-example streaming.KafkaWordCount
> ….
>
>
>
> Attached is a log file.
>
>
>
> 16/05/04 10:06:23 WARN consumer.ConsumerFetcherThread:
> [ConsumerFetcherThread-wordcount1_host81436-cld.domain.com-1462349182172-13b9f2e7-0-2],
> Error in fetch kafka.consumer.ConsumerFetcherThread$FetchRequest@47fb7e6d.
> Possible cause: java.nio.BufferUnderflowException
>
> 16/05/04 10:06:24 WARN consumer.ConsumerFetcherThread:
> [ConsumerFetcherThread-wordcount1_host81436-cld.domain.com-1462349182172-13b9f2e7-0-1],
> Error in fetch kafka.consumer.ConsumerFetcherThread$FetchRequest@73b9a762.
> Possible cause: java.lang.IllegalArgumentException
>
>
>
> We have no problem running this from my development pc, only in product op
> CDH 5.7.0 environment.
>
>
>
>
>
> Any ideas?
>
>
>
> Thanks,
>
> Michel
>
>
>
>
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org