hudi-bot opened a new issue, #14616: URL: https://github.com/apache/hudi/issues/14616
Currently, Hudi supports Flink as well Spark engine, there are two different classes for DeltaStreamer 1. HoodieDeltaStreamer 2.HoodieFlinkStreamer We should have a provision to pass the flag like --runner to choose between Flink or Spark and have a single entry point class which will take all the common configs. Based on the runner flag, we can call HoodieDeltaStreamer or HoodieFlinkStreamer This also takes care of making DeltaStreamer generic ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-2082 - Type: New Feature --- ## Comments 30/Jun/21 22:01;vinoth;First step is to see if we can use `HoodieEngineContext` instead of SparkContext everywhere in the utilities module. We may have to split the module again into common/spark/flink ;;; -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
