Thanks again for the information!
We are trying to process very large files and I’ve reviewed the online examples that explain that the Smooks mediator should be used to split the larger file into smaller files using the smooks configuration <file:outputStream>, with the output file name defined in the <file:fileNamePattern>. All the examples show the file name pattern derived using data from the record being processed. Is it possible to access the source file name? I need the split files to have a name that includes the original file name. The expression you mention below returns the original file name, but how can this property be access from within the Smooks configuration <file:fileNamePattern>? Regards, - Rudy From: Malaka Silva [mailto:[email protected]] Sent: Thursday, August 06, 2015 11:58 AM To: Rudy Hilado Cc: WSO2 Developers' List Subject: Re: [Dev] Pause/restart when processing a large file Hi Rudy, With [1] you can retrieve the processing file name, and with [2] you can set the response (out) file name. [1] <property name="Processing_File_Name" expression="get-property('transport','FILE_NAME')" type="STRING"/> [2] <property name="transport.vfs.ReplyFileName" value="out_response.xml" scope="transport" type="STRING"/> On Thu, Aug 6, 2015 at 2:29 PM, Rudy Hilado <[email protected]> wrote: Malaka, Thanks for the information! When splitting the larger file into smaller files, how do you create the smaller files with a name based on the parent file? For example, if the source file is named “documentABC.txt”, I would like the smaller files to be named “documentABC_0001.txt” and “documentABC_0002.txt” etc. I’m having a difficult time figuring out how to access the name of the current file being processed by the VFS listener. Thanks, - Rudy From: Malaka Silva [mailto:[email protected]] Sent: Thursday, August 06, 2015 1:57 AM To: Rudy Hilado Cc: WSO2 Developers' List Subject: Re: [Dev] Pause/restart when processing a large file Hi Rudy, I am afraid currently this is not supported out of the box. However you can achieve your requirement with the following solution. You can split the file and put in a separate folder (One entry in a file). eg:- VFS Listerner [3] -> Iterator mediator [4] -> File Connector [1][2] Take one file and process it. eg:- VFS listener [3] Following doc links will help you to do this. [1] https://storepreview.wso2.com/store/assets/esbconnector/f0550184-88c4-4d5e-b73f-ea51b1b5ab98 [2] https://docs.wso2.com/display/ESBCONNECTORS/Working+with+the+File+Connector#WorkingwiththeFileConnector-create [3] https://docs.wso2.com/display/ESB481/VFS+Transport [4] https://docs.wso2.com/display/ESB481/Iterate+Mediator On Wed, Aug 5, 2015 at 8:52 PM, Rudy Hilado <[email protected]> wrote: Is it possible in the WSO2 ESB to process a large file (with each line representing a single record/message), and stop or pause the processing within the file, then restart where it left off? (using the Smooks mediator and/or Iterate mediator, or any other mechanism) It appears that if you are processing a large file (say with 10K entries) you cannot stop or pause the processing (or if the ESB is brought down in the middle of processing the file), and then restart where it was stopped. Upon restarting either the whole file has to be reprocessed, or the file is dumped to the error folder and skipped. Is this correct? Thanks for any help on this. - Rudy _______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 <tel:%2B94%20777%20219%20791> Tel : 94 11 214 5345 Fax :94 11 <tel:94%2011%C2%A02145300> 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ <http://wso2.com/about/team/malaka-silva/> Save a tree -Conserve nature & Save the world for your future. Print this email only if it is absolutely necessary. -- Best Regards, Malaka Silva Senior Tech Lead M: +94 777 219 791 Tel : 94 11 214 5345 Fax :94 11 2145300 Skype : malaka.sampath.silva LinkedIn : http://www.linkedin.com/pub/malaka-silva/6/33/77 Blog : http://mrmalakasilva.blogspot.com/ WSO2, Inc. lean . enterprise . middleware http://www.wso2.com/ http://www.wso2.com/about/team/malaka-silva/ <http://wso2.com/about/team/malaka-silva/> Save a tree -Conserve nature & Save the world for your future. Print this email only if it is absolutely necessary.
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
