Sure I can collect the logs. However, the strange thing in my case is
that the zookeeper-server-stop.sh script (kill -SIGINT) didn't
actually kill the zookeeper process in my server. When you tried
shutting down zookeeper in your step, did you double check to see if
the zookeeper process had been k
I tried doing the following, but couldn't reproduce your issue -
1. Start zookeeper and kafka
2. Send some messages
3. Shutdown kafka and zookeeper
4. Start zookeeper and Kafka
5. Consume all messages
Do you mind sending around the entire Kafka and Consumer logs ?
Thanks,
Neha
On Thu, Feb 28,
Hello,
I actually tried to load the data back with the same instance of kafka
on server A so the broker id must be the same. The reason I brought
this up at the first place is because we've had some issues
recognizing the messages on a server stop/restart. I was able to
reproduce our issue with fo
I'm guessing the brokerid of the new broker is not the same as the old one
maybe ? This will work only if you copy the data over and maintain the same
broker id.
If not, then this could be a bug.
Thanks,
Neha
On Thu, Feb 28, 2013 at 3:21 AM, Jason Huang wrote:
> I've started by only coping $l
I've started by only coping $log.dir from server A to server B. Both
server A and server B ran same version of kafka 0.8 with same
configuration files.
However, after running kafka 0.8 on server B I get the following
exception when I tried to fetch the message:
2013-02-28 05:56:35,851] WARN [Kafka
As Jun described, the purpose of broker.id is to be able to move data from
one broker to the other without changes. I believe this should work in 0.8
as well. However, we've never tried it so not sure if there are bugs. Let
us know how it goes.
Thanks,
Neha
On Wed, Feb 27, 2013 at 1:31 PM, Jason
Thanks for the response.
I apologize - I should have mentioned that we are trying out kafka 0.8
because of its new exciting features.
So for 0.8, what do I need to do with the zookeeper data? copy
zookeeper file from $dataDir in zookeeper.properties from server A to
server B, and then run server
Jason,
Assuming this question is for 0.7, you can just copy the data in the log
directory and restart the new broker. You don't need to copy the zookeeper
data.
Thanks,
Neha
On Feb 27, 2013 2:11 AM, "Jason Huang" wrote:
> Hello,
>
> Is there a way to migrate kafka data from server A to another
Yes, you can. You just need to copy data in log.dir on disk to the new
machine and keep the broker.id in broker config the same. No need to change
anything in ZK since broker will re-register on startup. The main purpose
of broker.id is to allow people to move data logically from 1 broker to
anothe
Hello,
Is there a way to migrate kafka data from server A to another server B?
Can I just copy the data from $log.dir in server.properties and
zookeeper file from $dataDir in zookeeper.properties from server A to
server B, and then run server B's kafka instance?
thanks,
Jason
10 matches
Mail list logo
