Jiezhi opened a new issue #5731: URL: https://github.com/apache/dolphinscheduler/issues/5731
**Describe the feature** DS submit job to YARN like Oozie. **Describe the solution you'd like** > Oozie workflow actions start jobs in remote systems (i.e. Hadoop, Pig). Upon action completion, the remote systems callback Oozie to notify the action completion, at this point Oozie proceeds to the next action in the workflow. Besides Sqoop or other MR jobs, Oozie would start jobs like normal Java program (not MR job) directly to YARN. Oozie supplys a Yarn ApplicationMaster layer to its jobs. In other words, any jobs running on Oozie would be a YARN application. But DS run jobs just in local way (please correct me if I'm wrong)，a normal Java program would run in DS worker node, and the node resource is hard to manage like YARN. May be DS can provide this option when start a job. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
