Re: Kafka data directory Move without data loss

2023-07-18 Thread sunil chaudhari
I suggest you practice this thing in some dev or test environment before doing it to prod environment. And copy the data, Not move. On Tue, 18 Jul 2023 at 8:22 PM, sunil chaudhari wrote: > > Better you have a rollback plan. In case the new mountpount has some issue > then you should be able

Re: Kafka data directory Move without data loss

2023-07-18 Thread sunil chaudhari
Better you have a rollback plan. In case the new mountpount has some issue then you should be able to point to the old fs and restart the broker. On Tue, 18 Jul 2023 at 5:23 PM, Gaurav Pande wrote: > Okay and this process doesn't corrupt the files/file system right? > > And to perform this

Re: Kafka data directory Move without data loss

2023-07-18 Thread Gaurav Pande
Okay and this process doesn't corrupt the files/file system right? And to perform this copy activity do we need to stop Kafka broker as well? Regards, GP On Tue, 18 Jul, 2023, 16:24 sunil chaudhari, wrote: > Actually the broker refers to the base directory. > Example: > log.paths:

Re: Kafka data directory Move without data loss

2023-07-18 Thread sunil chaudhari
Actually the broker refers to the base directory. Example: log.paths: /var/log/mykafka/data/ then copy. /data/. to the new path completely and refer it in the server.properties On Tue, 18 Jul 2023 at 1:09 PM, Gaurav Pande wrote: > Okay so the data directory has some files like checkpoints,

Re: Kafka data directory Move without data loss

2023-07-18 Thread Gaurav Pande
Okay so the data directory has some files like checkpoints, meta.properties in existing file system all of these should also be copied to new disk/file system? Regards, GP On Tue, 18 Jul, 2023, 12:32 sunil chaudhari, wrote: > I think you can copy whole data directory to new one. I dont think

Re: Kafka data directory Move without data loss

2023-07-18 Thread sunil chaudhari
I think you can copy whole data directory to new one. I dont think there will be loss or corruption On Tue, 18 Jul 2023 at 12:20 PM, Gaurav Pande wrote: > Hi Guys, > > Any help on this query please. > > Regards, > GP > > On Mon, 17 Jul, 2023, 21:00 Gaurav Pande, wrote: > > > Hi Guys, > > > > I

Re: Kafka data directory Move without data loss

2023-07-18 Thread Gaurav Pande
Hi Guys, Any help on this query please. Regards, GP On Mon, 17 Jul, 2023, 21:00 Gaurav Pande, wrote: > Hi Guys, > > I have 3 node Kafka cluster running on version 2.7.0 . On one of the > broker out of three iam noticing data directory getting filled and broker > going down. > > Presently the

Kafka data directory Move without data loss

2023-07-17 Thread Gaurav Pande
Hi Guys, I have 3 node Kafka cluster running on version 2.7.0 . On one of the broker out of three iam noticing data directory getting filled and broker going down. Presently the data is being written to / mount point(which is wrong) so I want to add a disk on my VM. For this my query is how

Kafka Data Directory

2017-11-10 Thread Rishikesh Gawade
Hello there! I am newbie in the world of Apache Kafka and I have just implemented a standalone cluster of Kafka. I also tested it by running one producer process and 2 consumer processes and no issues were found. However, I would just like to know in which directory in the LocalFileSystem the data