CarlosJuncher03 opened a new issue, #8592: URL: https://github.com/apache/hop/issues/8592
### What would you like to happen? Currently, the Serialize To File transform can write Hop data to a binary file, but its support for multiple transform copies is limited when separate files need to be generated in parallel. The proposal is to add proper support for parallel execution, allowing each transform copy to write to a separate file, similar to the behavior available in other Apache Hop output transforms. Additionally, the De-Serialize From File transform should support receiving the input filename from a field provided by a previous transform. This would make it possible to dynamically generate a list of files and process them, including the use of multiple transform copies for parallel reading. Proposed functionality: Allow multiple copies of Serialize To File to generate independent output files. Add an option to include the transform copy number in the output filename. Allow De-Serialize From File to receive the filename from an input field. Allow De-Serialize From File to process filenames provided by a previous transform. Enable parallel reading and writing of multiple .cube files. The goal is to improve pipeline scalability for large data volumes by enabling parallel file processing while preventing multiple transform copies from attempting to access the same file simultaneously. ### Issue Priority Priority: 3 ### Issue Component Component: Transforms -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
