Fw: Alerting on Kafka certificate

2020-08-09 Thread Aninditya SAHA
From: Aninditya SAHA Sent: 04 August 2020 10:12 To: users@kafka.apache.org Subject: Alerting on Kafka certificate EXTERNAL MAIL: users-return-41018-a.saha=f5@kafka.apache.org Hi, I wish to address a problem that I was facing few days back. Here's the prob

Re: backup

2020-08-09 Thread kumar
Hi Liam - I did not understand cloning kafka broker volumes. if you have 1 TB disk , Assuming the usage is 65% data in the volume is changing so fast. take 650 GB every hour or every min ? how do we restore if there was failure? Oracle database provides point in time recovery(incremental+full

Re: backup

2020-08-09 Thread Manoj.Agrawal2
I'm also working on mirror maker 2.0 . Do you have any documentation for mirror maker 2.0 config setup or can you share the mirror maker 2.0 config . Have you encounter any issue On 8/9/20, 5:02 AM, "Liam Clarke-Hutchinson" wrote: [External] Hi Dor, Yep, we're using Mirrormaker

Re: backup

2020-08-09 Thread Liam Clarke-Hutchinson
Hi Dor, Yep, we're using Mirrormaker 2.0 currently, migrated from MM 1 with no real issues. Admittedly the documentation is a bit lacking currently, but between the KIP and the occasional code reading, we got there fine

RE: backup

2020-08-09 Thread Dor Ben Dov
Hi Liam, No actual problem just wondering, still you answered most of the things I already know so no I am convinced that I am ok. Still, wondering about the mmk2. How reliable is it, have you used it in production for instance? Regards, Dor -Original Message- From: Liam Clarke-Hutchi

Re: backup

2020-08-09 Thread Liam Clarke-Hutchinson
Hi Dor, There are multiple approaches. 1) Clone your Kafka broker volumes 2) Use Kafka Connect to stream all data to a different storage system such as Hadoop, S3, etc. 3) Use Mirrormaker to replicate all data to a backup cluster. Which approach is right for you really depends on your needs, but

RE: backup

2020-08-09 Thread Dor Ben Dov
Hi Sunil. I am aware of. Still, let's assume you have many events in one of your queues and from some reason the whole dc Is crashed. I want to understand possible ways to back it up. I know this isn't a db of course. Dor -Original Message- From: sunil chaudhari Sent: Sunday, Augus

Re: backup

2020-08-09 Thread sunil chaudhari
Hi Don, Kafka is not meant to be a general purpose database. Its a streaming platform. So think about retention of kafka messages rather than taking backup. Kafka itself has retention capability. So you can tune it as per your need. Regards, Sunil. On Sun, 9 Aug 2020 at 5:13 PM, Dor Ben Dov wrot

backup

2020-08-09 Thread Dor Ben Dov
Hi All, What is the best recommended way, and tool to backup kafka in production? Regards, Dor This email and the information contained herein is proprietary and confidential and subject to the Amdocs Email Terms of Service, which you may review at https://www.amdocs.com/about/email-terms-of-se