Thanks, Thilina. The latest Axiom jars make a 3x difference. I'm now seeing about 10mb/minute. Are more optimizations planned? Betsy
-----Original Message----- From: Thilina Gunarathne [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 20, 2007 4:16 AM To: axis-user@ws.apache.org Subject: Re: [AXIS2] MTOM performance Betsy, > > copying it. I continue to see it grow by about 3.7mb/minute. I did some testing after the 1.0 release and the numbers I got were ~20 mb/min... MAy be something went wrong from 1.0 to 1.1... It would be really great if you can let us know the transfer rates you got when using the latest axiom jars [1].. ~Thilina ttp://people.apache.org/repository/org.apache.ws.commons.axiom/jars/axio m-api-SNAPSHOT.jar http://people.apache.org/repository/org.apache.ws.commons.axiom/jars/axi om-dom-SNAPSHOT.jar http://people.apache.org/repository/org.apache.ws.commons.axiom/jars/axi om-impl-SNAPSHOT.jar > On 3/19/07, Betsy Frey <[EMAIL PROTECTED]> wrote: > > Thanks, Rodirigo, but the problem is not my disks. > > I changed the code to generate bytes on the fly, instead of from a > > source file. I changed the reference from localhost to 127.0.0.1. I am > > just looking at the file in the attachment directory; not moving or > > copying it. I continue to see it grow by about 3.7mb/minute. > > Separately, I have confirmed that the transfer is in binary in a MIME > > section; MTOM is enabled. > > So the question remains: why is MTOM performance so sluggish, and is > > there anything to be done about it? > > Thanks. > > Betsy > > > > -----Original Message----- > > From: Rodrigo Ruiz [mailto:[EMAIL PROTECTED] > > Sent: Monday, March 19, 2007 8:57 AM > > To: axis-user@ws.apache.org > > Subject: Re: [AXIS2] MTOM performance > > > > Several reasons :-) > > > > First, a file system copy can make use of low-level OS mechanisms to > > speed up transfers, and even in some cases, delegate the job to the disk > > manager chipset. You will never get these speeds with a web service, as > > it will never have direct access to the client file system. > > > > Said this, if you think about what the client and server do, leaving > > aside the overhead from XML transfer and processing, you will notice > > that having the client and server on the same machine is not a good > > testcase. > > > > On one side, the client must read the file from disk. If the client is > > correctly configured and programmed, the client will send the file > > contents to the server at the same time it is reading it (concurrently), > > so to avoid putting the whole file in memory. > > > > On the other side, the server will write the incoming bytes to a file > > while it is receiving the client request. Finally, once the whole file > > is received in the server side, your service will usually move the file > > to its final destination. If you copy the file instead of moving it, the > > service will perform even worse ;-) > > > > Now, if you join both sides, you will see the system must read and write > > the same file at different locations of the disk. This will make your > > test waste a lot of time just in disk head seeks. > > > > I would propose you to make sure that you follow these guides: > > > > * Make sure reads and writes are, at least, from/to different (physical) > > disks. If you have only one disk per machine, but you have several > > machines, try to put client and server in different hosts. Take into > > account that a fast ethernet bandwidth is far better than 3.7MB per > > minute ;-) > > > > * If you want to do some tests for only one of the sides, another > > approach could be to create mockups for the file readers and writers. > > For example, if you use a DataHandler in the client side, you can > > implement a fake DataSource that generates random bytes on the fly, > > instead of reading them from a file. Such a DataSource will allow you to > > test your server side performance without the client interfering in your > > disk accesses. > > > > * Always use the localhost address (127.0.0.1) to contact the server. In > > many environments you will get different (and worse) results if you use > > the machine public IP address. > > > > * Make sure you do your best to "move" the file in the server side to > > its final location instead of copying it. The performance is totally > > different. > > > > Hope this helps you, > > Rodrigo Ruiz > > > > Betsy Frey wrote: > > > I've just made some measurements, transferring files using MTOM in > > Axis2 > > > on tomcat. My client and servlet are on the same machine. > > Attachments > > > are cached. For files of 1mb or more, the transfer rate, > > > client-to-servlet, is about 3.7mb per minute. In contrast, a file > > > system copy transfers at about 2.5gb per minute: 675 times faster > > than > > > Axis2. > > > Why is MTOM performance is so sluggish? > > > Thanks for any assistance, > > > Betsy > > > > > > > > > > > > ********************************************************************** > > > This email and any files transmitted with it are confidential and > > > intended solely for the use of the individual or entity to whom they > > > are addressed. Any unauthorized review, use, disclosure or > > distribution is prohibited. If you are not the intended recipient, > > please contact the sender by reply e-mail and destroy all copies of the > > original message. > > > > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: [EMAIL PROTECTED] > > > For additional commands, e-mail: [EMAIL PROTECTED] > > > > > > > -- > > ------------------------------------------------------------------- > > GRID SYSTEMS, S.A. Rodrigo Ruiz > > Parc Bit - Edificio 17 Research Coordinator > > 07121 Palma de Mallorca [EMAIL PROTECTED] > > Baleares - Spain Tel: +34 971 435 085 > > http://www.gridsystems.com/ Fax: +34 971 435 082 > > ------------------------------------------------------------------- > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [EMAIL PROTECTED] > > For additional commands, e-mail: [EMAIL PROTECTED] > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: [EMAIL PROTECTED] > > For additional commands, e-mail: [EMAIL PROTECTED] > > > > > > > -- > Thilina Gunarathne - http://www.wso2.com - http://thilinag.blogspot.com > -- Thilina Gunarathne - http://www.wso2.com - http://thilinag.blogspot.com --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
