Hi Purushotham, Thanks for raising the github issue. Internally, we do have long-running deltastreamer tests with data quality assertions. I have responded to the issue with some clarifications. Let's continue our discussion there.
Regards, Sagar On Thu, Jan 26, 2023 at 9:03 PM Purushotham Pushpavanthar < [email protected]> wrote: > Hello everyone, > > I'm finding data inconsistency(mostly missing) in COW Hudi tables when > Deltastreamer is run in continuous mode. This is a serious issue for us as > we rely on Hudi to ingest all tables. > Can you please redirect me regarding how and where to look for the root > cause? > More details about the issue is filled here ( > https://github.com/apache/hudi/issues/7757). I can share driver logs if it > helps in analysing this issue. > Thanks in advance. > > Regards, > Purushotham Pushpavanth >
