Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

sampan-s-nayak commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2048953246 Closing this, will raise another PR to solve this more generally -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

sampan-s-nayak closed pull request #10890: [HUDI-7517] Add ability to reset the checkpoint for kafka source URL: https://github.com/apache/hudi/pull/10890 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

nsivabalan commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2015304585 I get it now, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

rmahindra123 commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2014352491 > hey @sampan-s-nayak : we already support resetting checkpoint by just setting --checkpoint in deltastreamer top level config. may I know why that does not work ? @nsivabalan

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

sampan-s-nayak commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2014352156 > hey @sampan-s-nayak : we already support resetting checkpoint by just setting --checkpoint in deltastreamer top level config. may I know why that does not work ? @nsivabala

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

sampan-s-nayak commented on code in PR #10890: URL: https://github.com/apache/hudi/pull/10890#discussion_r1535049167 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/helpers/TestKafkaOffsetGen.java: ## @@ -119,6 +122,28 @@ public void testGetNextOffsetRangesFrom

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

nsivabalan commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2013745361 hey @sampan-s-nayak : we already support resetting checkpoint by just setting --checkpoint in deltastreamer top level config. may I know why that does not work ? -- This is an autom

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

hudi-bot commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2009007655 ## CI report: * 71941da6eb713bc672a28f4c81ff814f2106acb2 UNKNOWN * 9b543450ae480698daae48f48fa2c16dacad10d7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

hudi-bot commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2008933641 ## CI report: * 71941da6eb713bc672a28f4c81ff814f2106acb2 UNKNOWN * 9cdd961e7583a51d8e94f78f22ff357b2d864516 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

hudi-bot commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2008924710 ## CI report: * 71941da6eb713bc672a28f4c81ff814f2106acb2 UNKNOWN * 9cdd961e7583a51d8e94f78f22ff357b2d864516 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

hudi-bot commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2007928202 ## CI report: * 71941da6eb713bc672a28f4c81ff814f2106acb2 UNKNOWN * 9cdd961e7583a51d8e94f78f22ff357b2d864516 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

hudi-bot commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2007839070 ## CI report: * 71941da6eb713bc672a28f4c81ff814f2106acb2 UNKNOWN * 9cdd961e7583a51d8e94f78f22ff357b2d864516 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

hudi-bot commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2007824816 ## CI report: * 71941da6eb713bc672a28f4c81ff814f2106acb2 UNKNOWN * 9cdd961e7583a51d8e94f78f22ff357b2d864516 UNKNOWN Bot commands @hudi-bot supports the followi

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

rmahindra123 commented on code in PR #10890: URL: https://github.com/apache/hudi/pull/10890#discussion_r1530819437 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/helpers/TestKafkaOffsetGen.java: ## @@ -119,6 +122,28 @@ public void testGetNextOffsetRangesFromCh

Re: [PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

hudi-bot commented on PR #10890: URL: https://github.com/apache/hudi/pull/10890#issuecomment-2007740495 ## CI report: * 71941da6eb713bc672a28f4c81ff814f2106acb2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[PR] [HUDI-7517] Add ability to reset the checkpoint for kafka source [hudi]

sampan-s-nayak opened a new pull request, #10890: URL: https://github.com/apache/hudi/pull/10890 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any per