loftiest opened a new pull request, #18273:
URL: https://github.com/apache/dolphinscheduler/pull/18273

   <!--Thanks very much for contributing to Apache DolphinScheduler, we are 
happy that you want to help us improve DolphinScheduler! -->
   
   ## Was this PR generated or assisted by AI?
   
   NO
   
   ## Purpose of the pull request
   
   Fix #18166 – Restore the file parameter transfer feature
   
   ## Brief change log
   
   - Add `TaskFilesTransferUtils` to transfer file paramter.
   - Integrate upstream file download in 
`PhysicalTaskExecutor#initializeTaskContext`.
   - Add success hook in `PhysicalTaskExecutor#trackTaskExecutorState` to 
trigger output file upload only on `SUCCEEDED`.
   - Update `CuringParamsServiceImpl` to map input file parameter values as 
keys, so they can be matched against the workflow `varPool` output file 
parameters and resolved from `prepareParamsMap`.
   - Add unit tests for `TaskFilesTransferUtils` and `PhysicalTaskExecutor`.
   
   ## Verify this pull request
   
   This change added tests and can be verified as follows:
   
   - Added unit tests covering download/upload with `FILE` parameters, 
including edge cases.
   - Added integration test verifying that file transfer and `varPool` can 
coexist and work correctly together.
   - Manually tested with Shell tasks on a local cluster, confirming downstream 
task receives the file.
   
   ## Pull Request Notice
   [Pull Request 
Notice](https://github.com/apache/dolphinscheduler/blob/dev/docs/docs/en/contribute/join/pull-request.md)
   
   If your pull request contains incompatible change, you should also add it to 
`docs/docs/en/guide/upgrade/incompatible.md`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to