nsivabalan commented on a change in pull request #2438:
URL: https://github.com/apache/hudi/pull/2438#discussion_r604840433
##########
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java
##########
@@ -553,6 +555,11 @@ public DeltaSyncService(Config cfg, JavaSparkContext jssc,
FileSystem fs, Config
"'--filter-dupes' needs to be disabled when '--op' is 'UPSERT' to
ensure updates are not missed.");
this.props = properties.get();
+ String kafkaCheckpointTimestamp =
props.getString(KafkaOffsetGen.Config.KAFKA_CHECKPOINT_TIMESTAMP, "");
Review comment:
Let me think more on this. Wondering if we should just rely on existing
"HoodieDeltaStreamer.Config.checkpoint" only and add another config named
"checkpoint.type" or something which could be set to timestamp for this
purpose.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
