RE: Spark kafka structured streaming - how to prevent dataloss

Hi all, Any suggestion? Regards, Gnana From: Gnanasoundari Soundarajan Sent: Tuesday, March 8, 2022 10:02 PM To: user@spark.apache.org Subject: Spark kafka structured streaming - how to prevent dataloss Hi, In spark, it uses checkpoints to keep track of offsets in kafka. If there is any

Spark kafka structured streaming - how to prevent dataloss

Hi, In spark, it uses checkpoints to keep track of offsets in kafka. If there is any data loss, can we edit the file and reduce the data loss? Please suggest the best practices to reduce the data loss under exceptional scenarios. Regards, Gnana