Basically agree with that, but before that we may need some refactoring to the existing code:
Move the HoodieFlinkStreamer from the hudi-flink module into the hudi-utilities to be together with the HoodieDeltaStreamer. We are planning to add separate flink compaction programs too, which has the same problem. Best, Danny Chan Vinay Patil <vinay18.pa...@gmail.com> 于2021年6月9日周三 下午3:42写道： > Hi Team, > > Currently, Hudi supports Flink as well Spark, there are two different > classes > 1. HoodieDeltaStreamer > 2. FlinkHoodieDeltaStreamer > > Should we have a provision to pass the flag like --runner to choose between > Flink or Spark and have a single entry point class which will take all the > common configs. > > Based on the runner flag, we can call HoodieDeltaStreamer or > FlinkHoodieDeltaStreamer > > Thoughts? > > Regards, > Vinay Patil >
