Re: kafka shutdown automatically

2015-01-20 Thread Guozhang Wang
>From the logs I can only see that controller of broker-0 is shutdown, and
before that happens broker-0 saw only itself from ZK, no broker-1 exist. It
is not clear how two brokers shutdown themselves automatically.

Can this scenario easily re-producible?


On Tue, Jan 20, 2015 at 12:36 AM, Yonghui Zhao 
wrote:

> 0.8.1.1 we have 2 brokers. broker-0 and broker-1
>
> 2015-01-20 8:43 GMT+08:00 Guozhang Wang :
>
> > Yonghui, which version of Kafka are you using? And does your cluster only
> > have one (broker-0) server?
> >
> > Guozhang
> >
> > On Sat, Jan 17, 2015 at 11:53 PM, Yonghui Zhao 
> > wrote:
> >
> > > Hi,
> > >
> > > our kafka cluster is shut down automatically today, here is the log.
> > >
> > > I don't find any error log.  Anything wrong?
> > >
> > >
> > > [2015-01-18 05:01:01,788] INFO [BrokerChangeListener on Controller 0]:
> > > Broker change listener fired for path /brokers/ids with children 0
> > > (kafka.controller.ReplicaStateMachine$BrokerChangeListener)
> > >
> > > [2015-01-18 05:01:01,791] INFO [Controller-0-to-broker-1-send-thread],
> > > Shutting down (kafka.controller.RequestSendThread)
> > >
> > > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-1-send-thread],
> > > Stopped  (kafka.controller.RequestSendThread)
> > >
> > > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-1-send-thread],
> > > Shutdown completed (kafka.controller.RequestSendThread)
> > >
> > > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> > > Shutting down (kafka.controller.RequestSendThread)
> > >
> > > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> > > Stopped  (kafka.controller.RequestSendThread)
> > >
> > > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> > > Shutdown completed (kafka.controller.RequestSendThread)
> > >
> > > [2015-01-18 05:01:01,792] INFO [Controller 0]: Controller shutdown
> > complete
> > > (kafka.controller.KafkaController)
> > >
> >
> >
> >
> > --
> > -- Guozhang
> >
>



-- 
-- Guozhang


Re: kafka shutdown automatically

2015-01-20 Thread Yonghui Zhao
0.8.1.1 we have 2 brokers. broker-0 and broker-1

2015-01-20 8:43 GMT+08:00 Guozhang Wang :

> Yonghui, which version of Kafka are you using? And does your cluster only
> have one (broker-0) server?
>
> Guozhang
>
> On Sat, Jan 17, 2015 at 11:53 PM, Yonghui Zhao 
> wrote:
>
> > Hi,
> >
> > our kafka cluster is shut down automatically today, here is the log.
> >
> > I don't find any error log.  Anything wrong?
> >
> >
> > [2015-01-18 05:01:01,788] INFO [BrokerChangeListener on Controller 0]:
> > Broker change listener fired for path /brokers/ids with children 0
> > (kafka.controller.ReplicaStateMachine$BrokerChangeListener)
> >
> > [2015-01-18 05:01:01,791] INFO [Controller-0-to-broker-1-send-thread],
> > Shutting down (kafka.controller.RequestSendThread)
> >
> > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-1-send-thread],
> > Stopped  (kafka.controller.RequestSendThread)
> >
> > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-1-send-thread],
> > Shutdown completed (kafka.controller.RequestSendThread)
> >
> > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> > Shutting down (kafka.controller.RequestSendThread)
> >
> > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> > Stopped  (kafka.controller.RequestSendThread)
> >
> > [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> > Shutdown completed (kafka.controller.RequestSendThread)
> >
> > [2015-01-18 05:01:01,792] INFO [Controller 0]: Controller shutdown
> complete
> > (kafka.controller.KafkaController)
> >
>
>
>
> --
> -- Guozhang
>


Re: kafka shutdown automatically

2015-01-19 Thread Guozhang Wang
Yonghui, which version of Kafka are you using? And does your cluster only
have one (broker-0) server?

Guozhang

On Sat, Jan 17, 2015 at 11:53 PM, Yonghui Zhao 
wrote:

> Hi,
>
> our kafka cluster is shut down automatically today, here is the log.
>
> I don't find any error log.  Anything wrong?
>
>
> [2015-01-18 05:01:01,788] INFO [BrokerChangeListener on Controller 0]:
> Broker change listener fired for path /brokers/ids with children 0
> (kafka.controller.ReplicaStateMachine$BrokerChangeListener)
>
> [2015-01-18 05:01:01,791] INFO [Controller-0-to-broker-1-send-thread],
> Shutting down (kafka.controller.RequestSendThread)
>
> [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-1-send-thread],
> Stopped  (kafka.controller.RequestSendThread)
>
> [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-1-send-thread],
> Shutdown completed (kafka.controller.RequestSendThread)
>
> [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> Shutting down (kafka.controller.RequestSendThread)
>
> [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> Stopped  (kafka.controller.RequestSendThread)
>
> [2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
> Shutdown completed (kafka.controller.RequestSendThread)
>
> [2015-01-18 05:01:01,792] INFO [Controller 0]: Controller shutdown complete
> (kafka.controller.KafkaController)
>



-- 
-- Guozhang


kafka shutdown automatically

2015-01-17 Thread Yonghui Zhao
Hi,

our kafka cluster is shut down automatically today, here is the log.

I don't find any error log.  Anything wrong?


[2015-01-18 05:01:01,788] INFO [BrokerChangeListener on Controller 0]:
Broker change listener fired for path /brokers/ids with children 0
(kafka.controller.ReplicaStateMachine$BrokerChangeListener)

[2015-01-18 05:01:01,791] INFO [Controller-0-to-broker-1-send-thread],
Shutting down (kafka.controller.RequestSendThread)

[2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-1-send-thread],
Stopped  (kafka.controller.RequestSendThread)

[2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-1-send-thread],
Shutdown completed (kafka.controller.RequestSendThread)

[2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
Shutting down (kafka.controller.RequestSendThread)

[2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
Stopped  (kafka.controller.RequestSendThread)

[2015-01-18 05:01:01,792] INFO [Controller-0-to-broker-0-send-thread],
Shutdown completed (kafka.controller.RequestSendThread)

[2015-01-18 05:01:01,792] INFO [Controller 0]: Controller shutdown complete
(kafka.controller.KafkaController)