icefery opened a new issue, #14737:
URL: https://github.com/apache/dolphinscheduler/issues/14737

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and 
found no similar feature requirement.
   
   
   ### Description
   
   If I want to process some thing in batch, suck as sql batch insert, there is 
no out-of-the-box task type to use.
   
   There are two alternative ways:
   
   - Pack a program with batch processing code, then upload to dolphinscheduler 
context, use `Shell` task to execute it.
   
   - Use additional external context to store batch task progress informations 
(such as `for (i : range)`), task need to update these external context 
informations.
   
   But neither of them is easy-to-use, hope that dolphinscheduler would provide 
a `for`/`loop` task type to wrap existing tasks, or get existing tasks 
`for`/`loop` supported natively.
   
   
   ### Use case
   
   Loop execute task.
   
   ```js
   // before task
   exec(`truncate table t_target`)
   
   // range task
   for(let key of ['a', 'b', 'c', 'd']) {
       exec(`
           insert into t_target
           select *
           from t_some_complex_from_expression
           where key = ${key}`
       )
   }
   
   // after task
   ```
   
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: 
[email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to