Jegan.T,

Instead of porting pvfs2-cp I started from scratch and made a simple program
called "wcp".

It is available here: http://www.orangefs.org/download/orangefs-wcp.zip. 

Example: wcp -s c:\temp\winfile.tst /winfile.tst
(-s shows the transfer rate)

I included the source for your reference, you won't be able to build it
without other stuff. We can get that set up for you if you like.

Run the app from the same box running the Client. However, it doesn't matter
whether the Client is running or not.

It will use the same C:\OrangeFS\Client\orangefstab file used by the client,
unless overridden by the PVFS2TAB_FILE environment variable.

In looking at this, the slowness of the Client is partly due to its
"stateless" nature. Therefore it is doing a file lookup on every I/O
operation. I will have to provide some state-keeping info to speed it up.

You can compare the speed of wcp to pvfs2-cp on a Linux system to see what
the fastest transfer would be.

There is a readme.txt in the ZIP file with some usage info.

If you have any questions, let me know.

Thanks,
Sam Sampson
Omnibond Systems LLC


-----Original Message-----
From: Jeganathan.T [mailto:[email protected]] 
Sent: Wednesday, December 05, 2012 10:57 PM
To: Sam Sampson; [email protected]
Subject: Re: [Pvfs2-users] Fw: Reg:PVFS2-CP

HI Sampson,

Thanks for your support.I am waiting for your solution :)-

Regards
Jegan.T

-----Original Message----- 
From: Sam Sampson
Sent: Thursday, December 06, 2012 12:37 AM
To: [email protected]
Subject: RE: [Pvfs2-users] Fw: Reg:PVFS2-CP

I will work on porting pvfs2-cp, probably also pvfs2-ls. That way we can get
the OS (mostly) out of the way.

Thanks,
Sam Sampson
Omnibond Systems LLC


-----Original Message-----
From: Jeganathan.T [mailto:[email protected]]
Sent: Tuesday, December 04, 2012 8:34 PM
To: Sam Sampson; [email protected]
Cc: Rakesh Sabharwal
Subject: Re: [Pvfs2-users] Fw: Reg:PVFS2-CP

HI Samson,

Thanks for you reply.We have one metadata server and one widows
client(orangeFS client installed).I am trying to copy the 3.GB file from
windows client to PVFS mount point .The speed is 30MB Per second.Our network
speed is 10GBPS,and the storage is fiber channel.please find the below
configuration of pvfs2-fs.conf .


<Defaults>
        UnexpectedRequests 50
        EventLogging none
        EnableTracing no
        LogStamp datetime
        BMIModules bmi_tcp
        FlowModules flowproto_multiqueue
        PerfUpdateInterval 1000
        ServerJobBMITimeoutSecs 30
        ServerJobFlowTimeoutSecs 30
        ClientJobBMITimeoutSecs 300
        ClientJobFlowTimeoutSecs 300
        ClientRetryLimit 5
        ClientRetryDelayMilliSecs 2000
        PrecreateBatchSize 0,32,512,32,32,32,0
        PrecreateLowThreshold 0,16,256,16,16,16,0

        DataStorageSpace /pvfs2-fs
        MetadataStorageSpace /pvfs2-fs

        LogFile /tmp/pvfs2-server.log
</Defaults>

<Aliases>
        Alias pvfs tcp://192.168.103.150:3334
</Aliases>

<Filesystem>
        Name pvfs2-fs
        ID 965318190
        RootHandle 1048576
        FileStuffing yes
        <MetaHandleRanges>
                Range pvfs 3-4611686018427387904
        </MetaHandleRanges>
        <DataHandleRanges>
                Range pvfs 4611686018427387905-9223372036854775806
        </DataHandleRanges>
        <StorageHints>
                TroveSyncMeta no
                TroveSyncData no
                TroveMethod alt-aio
                AttrCacheMaxNumElems 1024
                AttrCacheSize 511
                AttrCacheKeywords dh,md,de,st

        </StorageHints>
</Filesystem>

Regards
Jegan.T
+65-93820860

-----Original Message----- 
From: Sam Sampson
Sent: Wednesday, December 05, 2012 12:05 AM
To: [email protected]
Subject: RE: [Pvfs2-users] Fw: Reg:PVFS2-CP

Hello,
I can look into porting pvfs2-cp. However it may be more practical to
investigate the slowness of the Windows Client. If you could provide some
information:

What is the metadata/data server configuration of your installation? I.e.,
how many of each?

What number/size files are you transferring?

What performance (i.e. MB/s) do you see on Windows? What performance do you
see on Linux/UNIX?

Thanks,
Sam Sampson
Omnibond Systems LLC


-----Original Message-----
From: [email protected]
[mailto:[email protected]] On Behalf Of
Jeganathan.T
Sent: Monday, December 03, 2012 8:00 PM
To: [email protected]
Subject: [Pvfs2-users] Fw: Reg:PVFS2-CP


Hi All

I am trying to copy the files from windows client to PVFS mount point
through normal copy command,its verry slow.I need a pvfs2-cp.exe command for

windows.where can i download or please give me the steps to compile it.

Regards
Jegan.T
+65-93820860

_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users 

_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users

Reply via email to