got problems with kafka falling
>>>>> over for half an hour, I'd look at fixing that before worrying about spark
>>>>> monitoring...
>>>>>
>>>>>
>>>>> On Mon, Nov 9, 2015 at 12:26 PM, swetha <swethakasire...@gmail.com>
ack, hoping that kafka has those offsets.
>>>
>>> -adrian
>>>
>>> From: swetha kasireddy
>>> Date: Monday, November 9, 2015 at 10:40 PM
>>> To: Cody Koeninger
>>> Cc: "user@spark.apache.org"
>>> Subject: Re: Kafka Dire
>>>>
>>>>>>> The question of what kind of monitoring you need is more a question
>>>>>>> for your particular infrastructure and what you're already using for
int folder to help the job
> recover? E.g. Go 2 steps back, hoping that kafka has those offsets.
>
> -adrian
>
> From: swetha kasireddy
> Date: Monday, November 9, 2015 at 10:40 PM
> To: Cody Koeninger
> Cc: "user@spark.apache.org"
> Subject: Re: Kafka Direct does
;Thanks,
>Swetha
>
>
>
>--
>View this message in context:
>http://apache-spark-user-list.1001560.n3.nabble.com/Kafka-Direct-does-not-recover-automatically-when-the-Kafka-Stream-gets-messed-up-tp25331.html
>S
e that Kafka Direct recovers automatically
when the broker fails for sometime say 30 minutes? What kind of monitors
should be in place to recover the job?
Thanks,
Swetha
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Kafka-Direct-does-not-recover-automatic
for sometime say 30 minutes? What kind of monitors
> should be in place to recover the job?
>
> Thanks,
> Swetha
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Kafka-Direct-does-not-recover-automatically-when-the-Kafka-
gets messed up and the entire
>>> Streaming job blows up unlike some other consumers which do recover
>>> automatically. How can I make sure that Kafka Direct recovers
>>> automatically
>>> when the broker fails for sometime say 30 minutes? What kind of monitors
>>
>>>> How to recover Kafka Direct automatically when the there is a problem
>>>> with
>>>> Kafka brokers? Sometimes our Kafka Brokers gets messed up and the entire
>>>> Streaming job blows up unlike some other consumers which do recover
>&g
;> How to recover Kafka Direct automatically when the there is a problem
>>>>> with
>>>>> Kafka brokers? Sometimes our Kafka Brokers gets messed up and the
>>>>> entire
>>>>>
before worrying about spark
>>>>> monitoring...
>>>>>
>>>>>
>>>>> On Mon, Nov 9, 2015 at 12:26 PM, swetha <swethakasire...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hi,
>>>>>&
11 matches
Mail list logo