Thank you for example.
In our case, the file size can vary from 10K to 200MB. About 12000 files make
up of 262GB data.
We are using IBM GPFS for our storage, which is suppose to be faster for this
kind of activity. The parallel performance that we are seeing in our test case
is far from isolat
Hello,
I work on the NRAO ALMA pipeline software. I have recently begun developing
some prototype OODT workflows for use in the production pipeline.
I would like to be able to pass an object between workflows and tasks. The
object is modest in size, serializable in the Java sense, and can be en
Hey Chintu,
Thanks much. One thing you could try to use to speed up as well would be
to:
1. Subclass, or roll your own LocalDataTransfer class -- call it
MoveBasedLocalDataTransfer
2. Replace the class in that class from using FileUtils.copyFile or
FileUtils.moveFile to calls to ExecHelper.execut
Hey Lindsey,
Thanks for your email! Some comments below:
On 12/14/12 7:26 AM, "Lindsey Davis" wrote:
>Hello,
>
>I work on the NRAO ALMA pipeline software. I have recently begun
>developing
>some prototype OODT workflows for use in the production pipeline.
Great to hear!
>
>I would like to be
