I am being FTped a large EDI (text) file but heap runs out. See below.
In what batch script / file / wrapper / parameter do I specify new heap
size in ?
Yes I know how to set it for Java....
VFS runs out at about 15MB file. Unfortunately we will be getting 100 MB
files !!!!
Want to break these up and submit in smaller chunks to a web service.
Has anyone used Synapse to process large files. I am wondering if Synapse is
just the wrong solution.
May use our SFTP server, as is, and then use UNIX script to split file. Use
these to trigger a synapse VFS file proxy to submit.
Otherwise; for large EDI files a VFS iterator Mediator that streams through
input file and outputs smaller
chunks for processing, in Synapse, may be a solution ?
If the payload was zipped has anyone thought of how to process the file once
in synapse. At the
moment the file doesn't even get into Synapse. If its zipped, then it may
get in, but what then ?
See prior item : "Large Payload: Issues" for background.
2009-03-04 16:57:11,006 [-] [vfs-Worker-1] DEBUG VFSTransportListener
Scanning directory or file : file:///C:/test/in
2009-03-04 16:57:11,037 [-] [vfs-Worker-1] DEBUG VFSTransportListener File
name pattern :.*\.edi
2009-03-04 16:57:11,037 [-] [vfs-Worker-1] DEBUG VFSTransportListener
Matching file :270-Valid-320000-Checks.edi
2009-03-04 16:57:11,037 [-] [vfs-Worker-1] DEBUG VFSTransportListener
Processing file :file:///C:/test/in/270-Valid-320000-Checks.e
Exception in thread "vfs-Worker-1" java.lang.OutOfMemoryError: Java heap
space
at
java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:99)
at
java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:518)
at java.lang.StringBuffer.append(StringBuffer.java:307)
at java.io.StringWriter.write(StringWriter.java:72)
at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1129)
at org.apache.commons.io.IOUtils.copy(IOUtils.java:1104)
at org.apache.commons.io.IOUtils.copy(IOUtils.java:1078)
at org.apache.commons.io.IOUtils.toString(IOUtils.java:382)
at
org.apache.synapse.format.PlainTextBuilder.processDocument(PlainTextBuilder.java:68)
at
org.apache.axis2.transport.TransportUtils.createDocumentElement(TransportUtils.java:164)
at
org.apache.axis2.transport.TransportUtils.createSOAPMessage(TransportUtils.java:112)
at
org.apache.synapse.transport.vfs.VFSTransportListener.processFile(VFSTransportListener.java:433)
at
org.apache.synapse.transport.vfs.VFSTransportListener.scanFileOrDirectory(VFSTransportListener.java:241)
at
org.apache.synapse.transport.vfs.VFSTransportListener.onPoll(VFSTransportListener.java:145)
at
org.apache.synapse.transport.base.AbstractPollingTransportListener$1$1.run(AbstractPollingTransportListener.java:94)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:650)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:675)
at java.lang.Thread.run(Thread.java:595)
--
View this message in context:
http://www.nabble.com/java.lang.OutOfMemoryError---Where-do-U-increase-heap-space.-tp22324403p22324403.html
Sent from the Synapse - User mailing list archive at Nabble.com.
