Re: Kafka connection logs in Spark

2016-05-26 Thread Cody Koeninger
Sounds like you better talk to Horton Works then

On Thu, May 26, 2016 at 2:33 PM, Mail.com  wrote:
> Hi Cody,
>
> I used Horton Works jars for spark streaming that would enable get messages  
> from Kafka with kerberos.
>
> Thanks,
> Pradeep
>
>
>> On May 26, 2016, at 11:04 AM, Cody Koeninger  wrote:
>>
>> I wouldn't expect kerberos to work with anything earlier than the beta
>> consumer for kafka 0.10
>>
>>> On Wed, May 25, 2016 at 9:41 PM, Mail.com  wrote:
>>> Hi All,
>>>
>>> I am connecting Spark 1.6 streaming  to Kafka 0.8.2 with Kerberos. I ran 
>>> spark streaming in debug mode, but do not see any log saying it connected 
>>> to Kafka or  topic etc. How could I enable that.
>>>
>>> My spark streaming job runs but no messages are fetched from the RDD. 
>>> Please suggest.
>>>
>>> Thanks,
>>> Pradeep
>>>
>>> -
>>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>>> For additional commands, e-mail: user-h...@spark.apache.org
>>
>> -
>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>> For additional commands, e-mail: user-h...@spark.apache.org
>>
>

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Re: Kafka connection logs in Spark

2016-05-26 Thread Mail.com
Hi Cody,

I used Horton Works jars for spark streaming that would enable get messages  
from Kafka with kerberos.

Thanks,
Pradeep


> On May 26, 2016, at 11:04 AM, Cody Koeninger  wrote:
> 
> I wouldn't expect kerberos to work with anything earlier than the beta
> consumer for kafka 0.10
> 
>> On Wed, May 25, 2016 at 9:41 PM, Mail.com  wrote:
>> Hi All,
>> 
>> I am connecting Spark 1.6 streaming  to Kafka 0.8.2 with Kerberos. I ran 
>> spark streaming in debug mode, but do not see any log saying it connected to 
>> Kafka or  topic etc. How could I enable that.
>> 
>> My spark streaming job runs but no messages are fetched from the RDD. Please 
>> suggest.
>> 
>> Thanks,
>> Pradeep
>> 
>> -
>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>> For additional commands, e-mail: user-h...@spark.apache.org
> 
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
> 


-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Re: Kafka connection logs in Spark

2016-05-26 Thread Cody Koeninger
I wouldn't expect kerberos to work with anything earlier than the beta
consumer for kafka 0.10

On Wed, May 25, 2016 at 9:41 PM, Mail.com  wrote:
> Hi All,
>
> I am connecting Spark 1.6 streaming  to Kafka 0.8.2 with Kerberos. I ran 
> spark streaming in debug mode, but do not see any log saying it connected to 
> Kafka or  topic etc. How could I enable that.
>
> My spark streaming job runs but no messages are fetched from the RDD. Please 
> suggest.
>
> Thanks,
> Pradeep
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Kafka connection logs in Spark

2016-05-25 Thread Mail.com
Hi All,

I am connecting Spark 1.6 streaming  to Kafka 0.8.2 with Kerberos. I ran spark 
streaming in debug mode, but do not see any log saying it connected to Kafka or 
 topic etc. How could I enable that. 

My spark streaming job runs but no messages are fetched from the RDD. Please 
suggest.

Thanks,
Pradeep

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org