EricGao888 opened a new issue, #9814: URL: https://github.com/apache/dolphinscheduler/issues/9814
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement. ### Description By Integrating Apache Dolphin Scheduler with Apache Zeppelin through `zeppelin task plugin`, we aim to provide Dolphin users, especially those big data engineers, with so-called `Big Data Studio` experience, which means users can develop and debug big data related tasks in `zeppelin notebook` interactively and schedule them directly from dolphin with 'one click'. This feature will significantly boost development efficiency of big data engineers and lower the bar for those who do not have much experience in the big data area. However, currently dolphin only has basic integration with zeppelin and we need more features in zeppelin task plugin to achieve our goal. Here are a few points I come up with at the moment: * Enable note-level zeppelin task scheduling, which is already described here: #9798 * Add authentication feature to zeppelin task plugin so that a dolphin user will only have access to the notes of whose username is the same in zeppelin. * Add `custom variables` support in zeppelin task plugin. * Enable users to switch zeppelin server endpoint. Specifically speaking, add an `endpoint` field in UI and by filling different endpoints, users use dolphin to schedule zeppelin tasks to zeppelin servers deployed on different remote clusters. In this way, once configurations are completed on zeppelin side, users will be able to schedule big data tasks on different environment without worrying about configurations. I would like to invite Apache Zeppelin PMC, Jeff Zhang @zjffdu to help with the review. BTW, the idea of zeppelin task plugin is inspired by Jeff's previous work on `Apache Airflow Zeppelin Operator`, kudos to Jeff.  ### Use case * Already described above ### Related issues releated: #9201 #9798 #5271 ### Are you willing to submit a PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
