new broker instance can't sync up one partition from peers

2014-09-08 Thread Steven Wu
I did a push. new instance comes up and tries to fetch log/data from other peers/replicas. Out of 60 partitions assigned for broker 0, it sync'ed up 59. but for whatever reason, it didn't try to fetch this partition/topic. [out-of-sync replica] BrokerId: 0, Topic: foo, PartitionId: 6, Leader: 5,

zookeeper shows partition in-sync but local disk doesn't have the data dirs

2014-09-08 Thread Steven Wu
did a push in cloud. after new instance for broker 0 comes up, I see a lot of WARNs in log file. 2014-09-09 04:21:09,271 WARN kafka.utils.Logging$class:83 [request-expiration-task] [warn] [KafkaApi-0] Fetch request with correlation id 51893 from client 1409779957450-6014fc32-0-0 on partition

Re: new broker instance can't sync up one partition from peers

2014-09-08 Thread Jun Rao
Which version of Kafka are you using? Any error in the controller/state-change log? Thanks, Jun On Mon, Sep 8, 2014 at 9:07 PM, Steven Wu stevenz...@gmail.com wrote: I did a push. new instance comes up and tries to fetch log/data from other peers/replicas. Out of 60 partitions assigned for