[ https://issues.apache.org/jira/browse/HUDI-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372216#comment-17372216 ]
Vinoth Chandar commented on HUDI-2082: -------------------------------------- First step is to see if we can use `HoodieEngineContext` instead of SparkContext everywhere in the utilities module. We may have to split the module again into common/spark/flink > Provide option to choose Spark or Flink Delta Streamer > ------------------------------------------------------ > > Key: HUDI-2082 > URL: https://issues.apache.org/jira/browse/HUDI-2082 > Project: Apache Hudi > Issue Type: New Feature > Components: DeltaStreamer > Reporter: Vinay > Assignee: Vinay > Priority: Major > > Currently, Hudi supports Flink as well Spark engine, there are two different > classes for DeltaStreamer > 1. HoodieDeltaStreamer > 2.HoodieFlinkStreamer > > We should have a provision to pass the flag like --runner to choose between > Flink or Spark and have a single entry point class which will take all the > common configs. > > Based on the runner flag, we can call HoodieDeltaStreamer or > HoodieFlinkStreamer > > This also takes care of making DeltaStreamer generic -- This message was sent by Atlassian Jira (v8.3.4#803005)