maheshguptags commented on issue #12738: URL: https://github.com/apache/hudi/issues/12738#issuecomment-2699894544
@cshuo, the issue was resolved after modifying the code: ``` From .setStartingOffsets(OffsetsInitializer.committedOffsets(OffsetResetStrategy.LATEST)) TO .setStartingOffsets(OffsetsInitializer.committedOffsets(OffsetResetStrategy.EARLIEST)) ``` I tested it with a new table, an existing Kafka topic, and Hudi 1.0.0. Summary : The same code worked fine with version 0.15, but MDT is not enabled by default in that version(running in prod). In contrast, MDT is enabled by default in Hudi 1.0.0, which was causing the issue mentioned above. After changing the OffsetResetStrategy, everything is functioning as expected. A big thank you to @cshuo for the continuous help and support throughout this issue! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
